Jul 13 17:17:41.815565 ip-10-0-134-215 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 17:17:42.174313 ip-10-0-134-215 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:17:42.174313 ip-10-0-134-215 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 17:17:42.174313 ip-10-0-134-215 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:17:42.174313 ip-10-0-134-215 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 17:17:42.174313 ip-10-0-134-215 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:17:42.176423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.176328    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 17:17:42.180933 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180918    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:42.180933 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180932    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180936    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180940    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180942    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180947    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180949    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180953    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180955    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180958    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180961    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180963    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180966    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180970    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180972    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180975    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180978    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180980    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180983    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180985    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180988    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:42.180987 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180991    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180994    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180997    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.180999    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181003    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181005    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181008    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181010    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181013    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181016    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181018    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181020    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181023    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181025    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181028    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181030    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181033    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181035    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181037    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181040    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:42.181457 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181043    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181045    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181047    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181050    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181054    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181058    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181061    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181063    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181066    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181069    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181073    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181076    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181078    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181081    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181083    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181086    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181088    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181091    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181094    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:42.181924 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181096    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181099    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181101    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181104    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181106    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181109    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181112    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181114    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181117    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181119    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181122    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181124    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181127    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181129    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181132    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181134    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181137    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181139    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181142    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:42.182687 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181145    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181148    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181150    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181153    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181157    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181160    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181162    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181166    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181171    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181175    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181178    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181181    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181184    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181186    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181190    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181193    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181196    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181199    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181203    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:42.183265 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.181206    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182287    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182327    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182341    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182347    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182352    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182357    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182362    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182367    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182371    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182376    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182380    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182385    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182389    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182394    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182403    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182408    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182413    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182417    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:42.183735 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182422    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182426    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182430    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182435    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182440    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182444    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182448    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182452    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182456    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182466    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182471    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182475    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182479    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182484    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182488    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182497    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182504    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182509    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182513    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182518    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:42.184208 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182522    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182532    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182537    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182544    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182549    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182554    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182558    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182563    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182567    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182571    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182576    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182580    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182587    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182597    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182602    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182606    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182610    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182615    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182620    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182624    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:42.184697 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182628    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182632    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182637    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182641    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182646    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182655    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182661    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182666    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182671    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182675    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182679    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182683    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182688    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182691    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182696    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182700    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182704    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182716    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182721    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182726    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:42.185194 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182730    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182735    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182739    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182744    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182748    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182752    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182757    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182762    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182766    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182771    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182780    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182785    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182790    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182794    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182798    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182803    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182808    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182812    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182817    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182822    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:42.185685 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.182826    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183593    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183606    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183609    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183613    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183616    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183619    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183622    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183625    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183627    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183644    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183648    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183651    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183654    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183657    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183660    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183663    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183665    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183667    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183670    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:42.186183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183673    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183675    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183678    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183680    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183683    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183685    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183688    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183690    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183693    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183695    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183698    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183701    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183703    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183706    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183709    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183712    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183715    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183717    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183719    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183722    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:42.186682 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183725    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183727    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183730    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183732    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183736    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183740    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183743    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183746    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183749    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183752    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183754    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183757    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183759    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183762    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183765    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183769    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183772    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183775    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183779    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:42.187151 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183781    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183785    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183788    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183791    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183793    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183796    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183798    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183803    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183806    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183808    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183811    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183813    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183816    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183818    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183821    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183823    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183826    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183828    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183831    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183833    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:42.187606 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183835    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183838    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183840    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183843    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183847    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183850    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183852    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183855    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183858    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183860    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183863    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183865    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183869    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183872    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183875    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183878    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183880    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183883    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183885    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183890    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:42.188073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.183893    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183962    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183970    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183976    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183981    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183984    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183988    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183991    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183995    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.183998    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184001    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184005    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184008    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184012    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184017    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184021    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184025    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184031    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184035    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184040    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184043    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184046    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184049    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184053    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 17:17:42.188559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184056    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184059    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184062    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184065    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184068    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184071    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184074    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184079    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184081    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184085    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184088    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184091    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184094    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184097    2577 flags.go:64] FLAG: --enable-server="true"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184100    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184104    2577 flags.go:64] FLAG: --event-burst="100"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184107    2577 flags.go:64] FLAG: --event-qps="50"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184110    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184113    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184115    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184119    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184122    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184125    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184127    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184130    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 17:17:42.189115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184133    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184137    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184139    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184142    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184145    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184147    2577 flags.go:64] FLAG: --feature-gates=""
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184151    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184154    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184157    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184160    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184163    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184165    2577 flags.go:64] FLAG: --help="false"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184168    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184171    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184176    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184178    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184182    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184186    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184189    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184191    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184194    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184197    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184199    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184202    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 17:17:42.189751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184205    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184208    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184211    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184214    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184217    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184220    2577 flags.go:64] FLAG: --lock-file=""
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184223    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184226    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184229    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184239    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184242    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184245    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184248    2577 flags.go:64] FLAG: --logging-format="text"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184251    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184254    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184257    2577 flags.go:64] FLAG: --manifest-url=""
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184260    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184264    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184266    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184270    2577 flags.go:64] FLAG: --max-pods="110"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184273    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184276    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184280    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184282    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184285    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 17:17:42.190368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184288    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184291    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184298    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184316    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184320    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184323    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184326    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184338    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184341    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184344    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184348    2577 flags.go:64] FLAG: --port="10250"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184351    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184354    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01f6cb81af8afc6d0"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184357    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184360    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184363    2577 flags.go:64] FLAG: --register-node="true"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184366    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184374    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184377    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184380    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184383    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184386    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184389    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184392    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184395    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 17:17:42.190982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184398    2577 flags.go:64] FLAG: --runonce="false"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184401    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184405    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184408    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184411    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184414    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184417    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184420    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184423    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184426    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184429    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184432    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184434    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184437    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184441    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184443    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184449    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184454    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184457    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184461    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184464    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184467    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184470    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184472    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184475    2577 flags.go:64] FLAG: --v="2"
Jul 13 17:17:42.191593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184479    2577 flags.go:64] FLAG: --version="false"
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184483    2577 flags.go:64] FLAG: --vmodule=""
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184487    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.184490    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184606    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184611    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184615    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184619    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184623    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184626    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184629    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184631    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184634    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184636    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184640    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184642    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184645    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184647    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184650    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184653    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:42.192176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184656    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184658    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184662    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184665    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184670    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184673    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184676    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184678    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184681    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184684    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184686    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184689    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184692    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184694    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184698    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184701    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184703    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184706    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184709    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:42.192666 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184712    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184714    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184717    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184719    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184722    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184725    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184727    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184730    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184732    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184735    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184738    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184740    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184743    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184745    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184748    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184750    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184753    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184757    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184760    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:42.193117 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184762    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184765    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184768    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184770    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184773    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184775    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184778    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184780    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184783    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184786    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184788    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184791    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184793    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184796    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184798    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184801    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184804    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184807    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184810    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184812    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:42.193569 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184814    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184817    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184820    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184822    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184825    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184827    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184830    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184833    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184837    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184840    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184843    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184846    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184849    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184852    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184854    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184857    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184860    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184863    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184865    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184868    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:42.194031 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184870    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184873    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184876    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184878    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.184881    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.185504    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192049    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192064    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192083    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192089    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192141    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192145    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192148    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192151    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192154    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:42.194532 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192158    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192160    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192163    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192166    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192168    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192171    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192174    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192176    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192179    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192182    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192185    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192188    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192191    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192193    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192196    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192198    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192201    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192204    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192206    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192209    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:42.194927 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192212    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192214    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192217    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192219    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192223    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192226    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192229    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192231    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192234    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192236    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192239    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192241    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192244    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192246    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192249    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192252    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192254    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192257    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192259    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:42.195418 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192263    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192267    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192270    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192273    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192276    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192278    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192281    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192284    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192287    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192290    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192292    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192295    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192297    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192316    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192319    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192322    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192325    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192328    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192332    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192335    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:42.195865 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192337    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192340    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192342    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192345    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192347    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192351    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192353    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192355    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192358    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192361    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192364    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192366    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192369    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192371    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192374    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192376    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192379    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192382    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192384    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192387    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:42.196346 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192390    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192392    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192395    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192397    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192401    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192404    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192407    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192410    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192412    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192415    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192417    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192421    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192424    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192427    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:42.196840 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192431    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192436    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192541    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192545    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192548    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192551    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192554    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192556    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192559    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192562    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192565    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192567    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192570    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192572    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192575    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:42.197168 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192577    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192580    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192582    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192585    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192587    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192590    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192592    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192595    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192597    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192599    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192602    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192604    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192607    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192610    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192612    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192615    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192618    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192620    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192623    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192625    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:42.197540 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192628    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192630    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192633    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192635    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192638    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192640    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192643    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192645    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192648    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192650    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192653    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192656    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192658    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192661    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192663    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192666    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192669    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192672    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192676    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:42.198107 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192679    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192682    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192685    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192687    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192690    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192692    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192695    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192698    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192700    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192703    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192705    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192708    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192710    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192713    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192715    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192718    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192720    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192723    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192725    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192728    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:42.198585 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192730    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192733    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192735    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192738    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192741    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192743    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192746    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192749    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192751    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192755    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192758    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192761    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192764    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192766    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192769    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192772    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192775    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192777    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192780    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192784    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:42.199126 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192788    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192790    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192793    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192796    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192798    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192801    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:42.192804    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192808    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.192905    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.196289    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.197670    2577 server.go:1019] "Starting client certificate rotation"
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.197784    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:17:42.199643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.197827    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:17:42.200852 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.200836    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:17:42.202266 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.202244    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:17:42.210979 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.210963    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 13 17:17:42.213841 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.213827    2577 log.go:25] "Validated CRI v1 image API"
Jul 13 17:17:42.216363 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.216318    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 17:17:42.222763 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.222744    2577 fs.go:135] Filesystem UUIDs: map[036bc1f5-3673-4f84-af6c-08ac59eaa6b5:/dev/nvme0n1p3 07b89ac3-6211-48b6-a65d-b00aa6138d62:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 13 17:17:42.222843 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.222763    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 17:17:42.227780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.227683    2577 manager.go:216] Machine: {Timestamp:2026-07-13 17:17:42.227218948 +0000 UTC m=+0.305410990 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102029 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c40137811da8f651665ddf272119 SystemUUID:ec22c401-3781-1da8-f651-665ddf272119 BootID:746d58a4-6cc8-4001-a43e-edccf696d317 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:d5:86:d1:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:d5:86:d1:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:1d:6a:12:f1:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 17:17:42.227780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.227774    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 17:17:42.227884 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.227839    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 17:17:42.228868 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.228847    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 17:17:42.228988 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.228871    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 17:17:42.229470 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.229459    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 17:17:42.229506 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.229471    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 17:17:42.229506 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.229479    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:17:42.230159 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.230150    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:17:42.231578 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.231568    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 17:17:42.234954 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.234943    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:17:42.235065 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.235056    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 17:17:42.235833 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.235823    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 17:17:42.235863 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.235846    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 17:17:42.235863 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.235858    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 17:17:42.235922 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.235866    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 13 17:17:42.235922 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.235874    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 17:17:42.236175 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.236164    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:17:42.236211 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.236184    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:17:42.238540 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.238522    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:17:42.239257 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.239242    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 17:17:42.241157 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241136    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 17:17:42.241230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241179    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 17:17:42.241376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241363    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 17:17:42.241442 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241382    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 17:17:42.241442 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241392    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 17:17:42.241442 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241401    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 17:17:42.241442 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241412    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 17:17:42.241442 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241421    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 17:17:42.241709 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241699    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 17:17:42.241758 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241711    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 17:17:42.241758 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241721    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 17:17:42.241758 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241730    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 17:17:42.241758 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241743    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 17:17:42.241887 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.241767    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 17:17:42.242443 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.242431    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 17:17:42.242494 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.242446    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 17:17:42.245314 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.245283    2577 server.go:1268] "Started kubelet"
Jul 13 17:17:42.245566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.245424    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 17:17:42.245635 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.245554    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 17:17:42.245719 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.245700    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 17:17:42.246057 ip-10-0-134-215 systemd[1]: Started Kubernetes Kubelet.
Jul 13 17:17:42.247318 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.247287    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 17:17:42.247380 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.247298    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 17:17:42.251892 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.251864    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 17:17:42.254546 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.254531    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 17:17:42.254629 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.254547    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 17:17:42.254629 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.254606    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.255507 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.255393    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 17:17:42.255617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.255398    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 17:17:42.255707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.255688    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 17:17:42.255987 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.255967    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 17:17:42.256136 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256117    2577 factory.go:55] Registering systemd factory
Jul 13 17:17:42.256197 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256142    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 13 17:17:42.256445 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256430    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 17:17:42.256445 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256446    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 17:17:42.256652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256635    2577 factory.go:153] Registering CRI-O factory
Jul 13 17:17:42.256652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256659    2577 factory.go:223] Registration of the crio container factory successfully
Jul 13 17:17:42.256775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256724    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 17:17:42.256775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256750    2577 factory.go:103] Registering Raw factory
Jul 13 17:17:42.256775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.256767    2577 manager.go:1196] Started watching for new ooms in manager
Jul 13 17:17:42.257099 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.255953    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-215.ec2.internal.18c1e8f4098bf1cf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-215.ec2.internal,UID:ip-10-0-134-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-215.ec2.internal,},FirstTimestamp:2026-07-13 17:17:42.245257679 +0000 UTC m=+0.323449719,LastTimestamp:2026-07-13 17:17:42.245257679 +0000 UTC m=+0.323449719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-215.ec2.internal,}"
Jul 13 17:17:42.257227 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.257214    2577 manager.go:349] Starting recovery of all containers
Jul 13 17:17:42.259511 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.259195    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 17:17:42.259511 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.259349    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 17:17:42.266555 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.266507    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 17:17:42.269688 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.269672    2577 manager.go:354] Recovery completed
Jul 13 17:17:42.271547 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.271522    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 17:17:42.271755 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.271728    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 17:17:42.274083 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.274071    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.275909 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.275890    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.275963 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.275921    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.275963 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.275934    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.276492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.276467    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 17:17:42.276492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.276481    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 17:17:42.276653 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.276499    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:17:42.276653 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.276521    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.277244 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.277227    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.277326 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.277253    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.277326 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.277265    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.277820 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.277809    2577 policy_none.go:49] "None policy: Start"
Jul 13 17:17:42.277855 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.277823    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 17:17:42.277855 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.277833    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 17:17:42.278817 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.278807    2577 policy_none.go:47] "Start"
Jul 13 17:17:42.298921 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.298861    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-215.ec2.internal.18c1e8f40b5fa60a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-215.ec2.internal,UID:ip-10-0-134-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-215.ec2.internal,},FirstTimestamp:2026-07-13 17:17:42.27590913 +0000 UTC m=+0.354101173,LastTimestamp:2026-07-13 17:17:42.27590913 +0000 UTC m=+0.354101173,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-215.ec2.internal,}"
Jul 13 17:17:42.310030 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.309972    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-215.ec2.internal.18c1e8f40b5fe84a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-215.ec2.internal,UID:ip-10-0-134-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-215.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-215.ec2.internal,},FirstTimestamp:2026-07-13 17:17:42.27592609 +0000 UTC m=+0.354118130,LastTimestamp:2026-07-13 17:17:42.27592609 +0000 UTC m=+0.354118130,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-215.ec2.internal,}"
Jul 13 17:17:42.318022 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.317916    2577 manager.go:337] "Starting Device Plugin manager"
Jul 13 17:17:42.318102 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.318031    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 17:17:42.318102 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.318041    2577 server.go:87] "Starting device plugin registration server"
Jul 13 17:17:42.318267 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.318246    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 17:17:42.318338 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.318271    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 17:17:42.318391 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.318376    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 17:17:42.318548 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.318529    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 17:17:42.318548 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.318546    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 17:17:42.319066 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.319051    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 17:17:42.319123 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.319091    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.336584 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.336526    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-215.ec2.internal.18c1e8f40b6018ab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-215.ec2.internal,UID:ip-10-0-134-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-215.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-215.ec2.internal,},FirstTimestamp:2026-07-13 17:17:42.275938475 +0000 UTC m=+0.354130517,LastTimestamp:2026-07-13 17:17:42.275938475 +0000 UTC m=+0.354130517,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-215.ec2.internal,}"
Jul 13 17:17:42.345037 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.345017    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtrdh"
Jul 13 17:17:42.348263 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.348204    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-215.ec2.internal.18c1e8f40b5fa60a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-215.ec2.internal.18c1e8f40b5fa60a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-215.ec2.internal,UID:ip-10-0-134-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-215.ec2.internal,},FirstTimestamp:2026-07-13 17:17:42.27590913 +0000 UTC m=+0.354101173,LastTimestamp:2026-07-13 17:17:42.277240459 +0000 UTC m=+0.355432500,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-215.ec2.internal,}"
Jul 13 17:17:42.374489 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.374470    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtrdh"
Jul 13 17:17:42.386008 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.376857    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-215.ec2.internal.18c1e8f40b5fe84a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-215.ec2.internal.18c1e8f40b5fe84a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-215.ec2.internal,UID:ip-10-0-134-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-215.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-215.ec2.internal,},FirstTimestamp:2026-07-13 17:17:42.27592609 +0000 UTC m=+0.354118130,LastTimestamp:2026-07-13 17:17:42.277259201 +0000 UTC m=+0.355451243,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-215.ec2.internal,}"
Jul 13 17:17:42.415397 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.415375    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 17:17:42.415467 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.415408    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 17:17:42.415467 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.415429    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 17:17:42.415467 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.415457    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 17:17:42.418378 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.418362    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.418465 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.418365    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:42.419144 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.419129    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.419217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.419153    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.419217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.419163    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.419217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.419181    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.466741 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.466723    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.466741 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.466742    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-215.ec2.internal\": node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.516430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.516407    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"]
Jul 13 17:17:42.516557 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.516460    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.517259 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.517246    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.517317 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.517271    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.517317 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.517281    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.518763 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.518750    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.518905 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.518889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.518947 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.518919    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.519556 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.519538    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.519647 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.519568    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.519647 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.519581    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.519853 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.519837    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.519897 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.519867    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.519897 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.519883    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.521012 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.520998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.521079 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.521026    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:42.521819 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.521806    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:42.521887 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.521829    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:42.521887 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.521839    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:42.547621 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.547595    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.553090 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.553076    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-215.ec2.internal\" not found" node="ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.556703 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.556688    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-215.ec2.internal\" not found" node="ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.558046 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.558028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449211ff1c81057c17c77af8c685badd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal\" (UID: \"449211ff1c81057c17c77af8c685badd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.558125 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.558065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a25243051a280bc4d5e11c474a5bfe9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-215.ec2.internal\" (UID: \"3a25243051a280bc4d5e11c474a5bfe9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.558125 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.558093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/449211ff1c81057c17c77af8c685badd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal\" (UID: \"449211ff1c81057c17c77af8c685badd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.647863 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.647837    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.658852 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.658833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a25243051a280bc4d5e11c474a5bfe9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-215.ec2.internal\" (UID: \"3a25243051a280bc4d5e11c474a5bfe9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.658916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.658857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/449211ff1c81057c17c77af8c685badd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal\" (UID: \"449211ff1c81057c17c77af8c685badd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.658916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.658876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449211ff1c81057c17c77af8c685badd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal\" (UID: \"449211ff1c81057c17c77af8c685badd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.658990 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.658936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449211ff1c81057c17c77af8c685badd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal\" (UID: \"449211ff1c81057c17c77af8c685badd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.658990 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.658967    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a25243051a280bc4d5e11c474a5bfe9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-215.ec2.internal\" (UID: \"3a25243051a280bc4d5e11c474a5bfe9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.659050 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.658961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/449211ff1c81057c17c77af8c685badd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal\" (UID: \"449211ff1c81057c17c77af8c685badd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.748210 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.748141    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.849164 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.849143    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:42.855496 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.855458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.860953 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:42.860938    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:42.949402 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:42.949375    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:43.053418 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.053334    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:43.154974 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.154923    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-215.ec2.internal\" not found"
Jul 13 17:17:43.183927 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.183905    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:43.196835 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.196808    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 17:17:43.196955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.196924    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 17:17:43.224352 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.224333    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:43.236680 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.236662    2577 apiserver.go:52] "Watching apiserver"
Jul 13 17:17:43.248908 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.248887    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 17:17:43.250817 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.250794    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qhhbz","kube-system/konnectivity-agent-shh99","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t","openshift-dns/node-resolver-t57qd","openshift-multus/multus-additional-cni-plugins-fhmzf","openshift-multus/multus-fjjfz","openshift-ovn-kubernetes/ovnkube-node-ljjdg","openshift-cluster-node-tuning-operator/tuned-vs2jp","openshift-image-registry/node-ca-zmw8f","openshift-multus/network-metrics-daemon-l2jhc","openshift-network-diagnostics/network-check-target-4r6vl","openshift-network-operator/iptables-alerter-mls8j"]
Jul 13 17:17:43.252294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.252271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.252392 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.252366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:43.253526 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.253505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.254701 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.254685    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 17:17:43.254805 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.254707    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:43.254888 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.254868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.256089 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.256068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.257441 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.257426    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.258636 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.258619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.260118 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.260099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.261479 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.261741 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff28572d-d027-4b00-a3fc-7b7377640652-agent-certs\") pod \"konnectivity-agent-shh99\" (UID: \"ff28572d-d027-4b00-a3fc-7b7377640652\") " pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.261741 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff28572d-d027-4b00-a3fc-7b7377640652-konnectivity-ca\") pod \"konnectivity-agent-shh99\" (UID: \"ff28572d-d027-4b00-a3fc-7b7377640652\") " pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.261881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-socket-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.261881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-registration-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.261881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-etc-selinux\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.261881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zmtm\" (UniqueName: \"kubernetes.io/projected/a54538de-834a-4158-8bc2-2b170c735291-kube-api-access-6zmtm\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.262097 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.262097 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-device-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.262097 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-sys-fs\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.262300 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.261987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-tmp-dir\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.262484 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.262436    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gt2zw\""
Jul 13 17:17:43.262554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.262494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.262554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.262538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-hosts-file\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.262657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.262571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbwc\" (UniqueName: \"kubernetes.io/projected/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-kube-api-access-9tbwc\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.262657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.262599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/023edfbb-2391-40bb-bc9a-712c33630581-kubelet-config\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.262657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.262629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/023edfbb-2391-40bb-bc9a-712c33630581-dbus\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.264763 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.264742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.266259 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.266244    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.266354 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.266305    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:43.267667 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.267648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:43.267754 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.267707    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:43.269061 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.269043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.270824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.270791    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 17:17:43.270929 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.270801    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 17:17:43.270929 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.270880    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 17:17:43.270929 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.270826    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 17:17:43.271099 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.270983    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.271222 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.271207    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.272043 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272028    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.272628 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272606    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.272677 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9mg2h\""
Jul 13 17:17:43.272677 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gsbzk\""
Jul 13 17:17:43.272677 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272660    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 17:17:43.272785 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272626    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 17:17:43.272887 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272868    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b74ph\""
Jul 13 17:17:43.272947 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.272947 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.272909    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 17:17:43.273607 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.273591    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.273648 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.273591    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.274075 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.274062    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.274137 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.274081    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.274207 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.274192    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dzjjg\""
Jul 13 17:17:43.274516 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.274500    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 17:17:43.274569 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.274551    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 17:17:43.279048 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.279030    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rk8tm\""
Jul 13 17:17:43.279126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.279048    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-72vfs\""
Jul 13 17:17:43.279126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.279067    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.279126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.279074    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 17:17:43.279126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.279069    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 17:17:43.281779 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.281761    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.281837 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.281813    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.281936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.281917    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 17:17:43.281996 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.281965    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vnd2c\""
Jul 13 17:17:43.282047 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.282022    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 17:17:43.282121 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.282106    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 17:17:43.282295 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.282278    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7krws\""
Jul 13 17:17:43.282369 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.282298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 17:17:43.303008 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.302993    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:17:43.303102 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.303051    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"
Jul 13 17:17:43.305108 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.305059    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal"]
Jul 13 17:17:43.316583 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.316567    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:17:43.343493 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.343476    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal"]
Jul 13 17:17:43.346135 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.346114    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:17:43.357512 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.357490    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 17:17:43.362780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.362757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-os-release\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.362889 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.362794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea6937fd-caba-429e-a900-525b53e84b11-host-slash\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.362889 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.362819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-netns\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.363070 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-conf-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-run\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-var-lib-kubelet\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-socket-dir-parent\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-cni-multus\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-cni-bin\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-cnibin\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-k8s-cni-cncf-io\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.363509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-modprobe-d\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-kubernetes\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysctl-conf\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-hosts-file\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/023edfbb-2391-40bb-bc9a-712c33630581-kubelet-config\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/023edfbb-2391-40bb-bc9a-712c33630581-kubelet-config\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363717    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-hosts-file\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/023edfbb-2391-40bb-bc9a-712c33630581-dbus\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-multus-certs\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysconfig\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-host\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041789df-4e38-442a-8b66-f1e08ca5c7f5-tmp\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72940f3e-a48d-449c-b52e-874ffd84c18d-cni-binary-copy\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.363982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvqq\" (UniqueName: \"kubernetes.io/projected/1b894166-38b3-4df5-aa2a-34397e83cd0d-kube-api-access-dvvqq\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.364021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-sys-fs\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/023edfbb-2391-40bb-bc9a-712c33630581-dbus\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-kubelet\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovnkube-script-lib\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl4k4\" (UniqueName: \"kubernetes.io/projected/ea6937fd-caba-429e-a900-525b53e84b11-kube-api-access-jl4k4\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-os-release\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-daemon-config\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-sys-fs\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-ovn\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovn-node-metrics-cert\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-lib-modules\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-var-lib-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24dcd\" (UniqueName: \"kubernetes.io/projected/e82a21e2-5f47-469a-9e6e-1b736f834a65-kube-api-access-24dcd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.364566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdd75\" (UniqueName: \"kubernetes.io/projected/041789df-4e38-442a-8b66-f1e08ca5c7f5-kube-api-access-pdd75\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-socket-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-etc-selinux\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-system-cni-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2c7\" (UniqueName: \"kubernetes.io/projected/72940f3e-a48d-449c-b52e-874ffd84c18d-kube-api-access-ql2c7\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-log-socket\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovnkube-config\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-socket-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-device-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-device-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-etc-kubernetes\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-systemd-units\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-run-netns\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea6937fd-caba-429e-a900-525b53e84b11-iptables-alerter-script\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365034    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pvv99"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-tmp-dir\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.365188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.364815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-etc-selinux\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-node-log\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/522289d0-6367-4f4e-8531-359bc2c02295-serviceca\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff28572d-d027-4b00-a3fc-7b7377640652-konnectivity-ca\") pod \"konnectivity-agent-shh99\" (UID: \"ff28572d-d027-4b00-a3fc-7b7377640652\") " pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-system-cni-dir\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-cnibin\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-cni-bin\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-sys\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkg5\" (UniqueName: \"kubernetes.io/projected/522289d0-6367-4f4e-8531-359bc2c02295-kube-api-access-4wkg5\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-registration-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zmtm\" (UniqueName: \"kubernetes.io/projected/a54538de-834a-4158-8bc2-2b170c735291-kube-api-access-6zmtm\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-kubelet\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-slash\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-systemd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-cni-netd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-env-overrides\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-tuned\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-hostroot\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-etc-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysctl-d\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-systemd\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365861    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ff28572d-d027-4b00-a3fc-7b7377640652-konnectivity-ca\") pod \"konnectivity-agent-shh99\" (UID: \"ff28572d-d027-4b00-a3fc-7b7377640652\") " pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/522289d0-6367-4f4e-8531-359bc2c02295-host\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpk9\" (UniqueName: \"kubernetes.io/projected/584c10ed-c1ba-4562-adc8-236b7f612a72-kube-api-access-wfpk9\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.365979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.366082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.366096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a54538de-834a-4158-8bc2-2b170c735291-registration-dir\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.366146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-cni-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.366982 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.366181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbwc\" (UniqueName: \"kubernetes.io/projected/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-kube-api-access-9tbwc\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.367829 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.366206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff28572d-d027-4b00-a3fc-7b7377640652-agent-certs\") pod \"konnectivity-agent-shh99\" (UID: \"ff28572d-d027-4b00-a3fc-7b7377640652\") " pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.367829 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.366398    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:43.367829 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.366480    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:43.86645288 +0000 UTC m=+1.944644924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:43.367829 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.366895    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 17:17:43.367829 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.367428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-tmp-dir\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.370595 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.370570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ff28572d-d027-4b00-a3fc-7b7377640652-agent-certs\") pod \"konnectivity-agent-shh99\" (UID: \"ff28572d-d027-4b00-a3fc-7b7377640652\") " pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.379117 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.379076    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:12:43 +0000 UTC" deadline="2028-02-28 03:24:55.845849397 +0000 UTC"
Jul 13 17:17:43.379202 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.379116    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14266h7m12.466737193s"
Jul 13 17:17:43.383469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.383448    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pvv99"
Jul 13 17:17:43.395667 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.395646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbwc\" (UniqueName: \"kubernetes.io/projected/c77fb01f-a5e7-4f84-87c8-248a63b56b0a-kube-api-access-9tbwc\") pod \"node-resolver-t57qd\" (UID: \"c77fb01f-a5e7-4f84-87c8-248a63b56b0a\") " pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.395803 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.395690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zmtm\" (UniqueName: \"kubernetes.io/projected/a54538de-834a-4158-8bc2-2b170c735291-kube-api-access-6zmtm\") pod \"aws-ebs-csi-driver-node-9h65t\" (UID: \"a54538de-834a-4158-8bc2-2b170c735291\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.466452 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466604 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea6937fd-caba-429e-a900-525b53e84b11-iptables-alerter-script\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.466604 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.466604 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-node-log\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466604 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/522289d0-6367-4f4e-8531-359bc2c02295-serviceca\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.466604 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-node-log\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466604 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466566    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-system-cni-dir\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-cnibin\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-cni-bin\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-sys\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-system-cni-dir\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkg5\" (UniqueName: \"kubernetes.io/projected/522289d0-6367-4f4e-8531-359bc2c02295-kube-api-access-4wkg5\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-cnibin\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-cni-bin\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-run-ovn-kubernetes\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-kubelet\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-kubelet\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.466945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-slash\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-slash\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/522289d0-6367-4f4e-8531-359bc2c02295-serviceca\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.466975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-systemd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-cni-netd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-sys\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-systemd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-env-overrides\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-cni-netd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-tuned\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-hostroot\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-etc-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-hostroot\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea6937fd-caba-429e-a900-525b53e84b11-iptables-alerter-script\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysctl-d\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-etc-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-systemd\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.467717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/522289d0-6367-4f4e-8531-359bc2c02295-host\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysctl-d\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/522289d0-6367-4f4e-8531-359bc2c02295-host\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-systemd\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpk9\" (UniqueName: \"kubernetes.io/projected/584c10ed-c1ba-4562-adc8-236b7f612a72-kube-api-access-wfpk9\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-env-overrides\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-cni-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-os-release\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea6937fd-caba-429e-a900-525b53e84b11-host-slash\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-netns\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-cni-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-conf-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea6937fd-caba-429e-a900-525b53e84b11-host-slash\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-os-release\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.468469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-run\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-netns\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-var-lib-kubelet\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-conf-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-run\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-var-lib-kubelet\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-socket-dir-parent\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-cni-multus\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-cni-bin\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-socket-dir-parent\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.467926    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-cni-multus\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-cnibin\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.467999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-cni-bin\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.468031    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:17:43.96800774 +0000 UTC m=+2.046199781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:43.469925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/584c10ed-c1ba-4562-adc8-236b7f612a72-cnibin\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-k8s-cni-cncf-io\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-modprobe-d\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-k8s-cni-cncf-io\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-kubernetes\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysctl-conf\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-modprobe-d\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-multus-certs\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468214    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-kubernetes\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysconfig\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-host\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysctl-conf\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-sysconfig\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041789df-4e38-442a-8b66-f1e08ca5c7f5-tmp\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-host\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-run-multus-certs\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72940f3e-a48d-449c-b52e-874ffd84c18d-cni-binary-copy\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.470915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvqq\" (UniqueName: \"kubernetes.io/projected/1b894166-38b3-4df5-aa2a-34397e83cd0d-kube-api-access-dvvqq\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-kubelet\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovnkube-script-lib\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl4k4\" (UniqueName: \"kubernetes.io/projected/ea6937fd-caba-429e-a900-525b53e84b11-kube-api-access-jl4k4\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-os-release\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-daemon-config\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-ovn\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovn-node-metrics-cert\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-lib-modules\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-var-lib-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24dcd\" (UniqueName: \"kubernetes.io/projected/e82a21e2-5f47-469a-9e6e-1b736f834a65-kube-api-access-24dcd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdd75\" (UniqueName: \"kubernetes.io/projected/041789df-4e38-442a-8b66-f1e08ca5c7f5-kube-api-access-pdd75\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-system-cni-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2c7\" (UniqueName: \"kubernetes.io/projected/72940f3e-a48d-449c-b52e-874ffd84c18d-kube-api-access-ql2c7\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-log-socket\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovnkube-config\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.471694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-etc-kubernetes\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-systemd-units\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-run-netns\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.468943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-var-lib-openvswitch\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-run-ovn\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-log-socket\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovnkube-script-lib\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-os-release\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72940f3e-a48d-449c-b52e-874ffd84c18d-cni-binary-copy\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-host-var-lib-kubelet\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-host-run-netns\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041789df-4e38-442a-8b66-f1e08ca5c7f5-lib-modules\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e82a21e2-5f47-469a-9e6e-1b736f834a65-systemd-units\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-etc-kubernetes\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovnkube-config\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72940f3e-a48d-449c-b52e-874ffd84c18d-system-cni-dir\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469679    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/041789df-4e38-442a-8b66-f1e08ca5c7f5-etc-tuned\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.472188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.469940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/584c10ed-c1ba-4562-adc8-236b7f612a72-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.472775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.470644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041789df-4e38-442a-8b66-f1e08ca5c7f5-tmp\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.472775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.471529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e82a21e2-5f47-469a-9e6e-1b736f834a65-ovn-node-metrics-cert\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.472775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.471572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72940f3e-a48d-449c-b52e-874ffd84c18d-multus-daemon-config\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.488005 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.487982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkg5\" (UniqueName: \"kubernetes.io/projected/522289d0-6367-4f4e-8531-359bc2c02295-kube-api-access-4wkg5\") pod \"node-ca-zmw8f\" (UID: \"522289d0-6367-4f4e-8531-359bc2c02295\") " pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.488347 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.488314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdd75\" (UniqueName: \"kubernetes.io/projected/041789df-4e38-442a-8b66-f1e08ca5c7f5-kube-api-access-pdd75\") pod \"tuned-vs2jp\" (UID: \"041789df-4e38-442a-8b66-f1e08ca5c7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.491138 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.491113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2c7\" (UniqueName: \"kubernetes.io/projected/72940f3e-a48d-449c-b52e-874ffd84c18d-kube-api-access-ql2c7\") pod \"multus-fjjfz\" (UID: \"72940f3e-a48d-449c-b52e-874ffd84c18d\") " pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.491585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.491564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvqq\" (UniqueName: \"kubernetes.io/projected/1b894166-38b3-4df5-aa2a-34397e83cd0d-kube-api-access-dvvqq\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.492563 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.492549    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:43.492617 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.492566    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:43.492617 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.492578    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:43.492687 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.492632    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:43.992617884 +0000 UTC m=+2.070809913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:43.495503 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.495484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpk9\" (UniqueName: \"kubernetes.io/projected/584c10ed-c1ba-4562-adc8-236b7f612a72-kube-api-access-wfpk9\") pod \"multus-additional-cni-plugins-fhmzf\" (UID: \"584c10ed-c1ba-4562-adc8-236b7f612a72\") " pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.498239 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.498210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl4k4\" (UniqueName: \"kubernetes.io/projected/ea6937fd-caba-429e-a900-525b53e84b11-kube-api-access-jl4k4\") pod \"iptables-alerter-mls8j\" (UID: \"ea6937fd-caba-429e-a900-525b53e84b11\") " pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.498753 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.498736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24dcd\" (UniqueName: \"kubernetes.io/projected/e82a21e2-5f47-469a-9e6e-1b736f834a65-kube-api-access-24dcd\") pod \"ovnkube-node-ljjdg\" (UID: \"e82a21e2-5f47-469a-9e6e-1b736f834a65\") " pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.508693 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.508654    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a25243051a280bc4d5e11c474a5bfe9.slice/crio-a0270da0058c764363331e35c9ec833a3d08f867be89c1c39a28b2450da7a21f WatchSource:0}: Error finding container a0270da0058c764363331e35c9ec833a3d08f867be89c1c39a28b2450da7a21f: Status 404 returned error can't find the container with id a0270da0058c764363331e35c9ec833a3d08f867be89c1c39a28b2450da7a21f
Jul 13 17:17:43.515884 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.515868    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:17:43.521230 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.521210    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449211ff1c81057c17c77af8c685badd.slice/crio-ad1073d2dee17a2d22f87e3a032f8bc6cd66aa67e730a00d4ad6d5c356d58770 WatchSource:0}: Error finding container ad1073d2dee17a2d22f87e3a032f8bc6cd66aa67e730a00d4ad6d5c356d58770: Status 404 returned error can't find the container with id ad1073d2dee17a2d22f87e3a032f8bc6cd66aa67e730a00d4ad6d5c356d58770
Jul 13 17:17:43.591684 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.591627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:17:43.596726 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.596708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t"
Jul 13 17:17:43.599808 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.599785    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff28572d_d027_4b00_a3fc_7b7377640652.slice/crio-acd0fda820646dbbdaea03b9865df0b4639bfc052e59290d4734d49cc9ba7120 WatchSource:0}: Error finding container acd0fda820646dbbdaea03b9865df0b4639bfc052e59290d4734d49cc9ba7120: Status 404 returned error can't find the container with id acd0fda820646dbbdaea03b9865df0b4639bfc052e59290d4734d49cc9ba7120
Jul 13 17:17:43.604746 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.604716    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54538de_834a_4158_8bc2_2b170c735291.slice/crio-2b3a5ddfb58d4914491ce00779d8e80bd7ed633cdd08afc470366156946a98b3 WatchSource:0}: Error finding container 2b3a5ddfb58d4914491ce00779d8e80bd7ed633cdd08afc470366156946a98b3: Status 404 returned error can't find the container with id 2b3a5ddfb58d4914491ce00779d8e80bd7ed633cdd08afc470366156946a98b3
Jul 13 17:17:43.610500 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.610485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t57qd"
Jul 13 17:17:43.617620 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.617600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhmzf"
Jul 13 17:17:43.619627 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.619609    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77fb01f_a5e7_4f84_87c8_248a63b56b0a.slice/crio-10511b92ef4e455a54552f7193079a822e00e57a0cb25175844723a3bd150c8a WatchSource:0}: Error finding container 10511b92ef4e455a54552f7193079a822e00e57a0cb25175844723a3bd150c8a: Status 404 returned error can't find the container with id 10511b92ef4e455a54552f7193079a822e00e57a0cb25175844723a3bd150c8a
Jul 13 17:17:43.626340 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.626320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584c10ed_c1ba_4562_adc8_236b7f612a72.slice/crio-4ee0ba157323c911aab30195baf347e8a7f41386345b8862d2bff82d1f9f2efe WatchSource:0}: Error finding container 4ee0ba157323c911aab30195baf347e8a7f41386345b8862d2bff82d1f9f2efe: Status 404 returned error can't find the container with id 4ee0ba157323c911aab30195baf347e8a7f41386345b8862d2bff82d1f9f2efe
Jul 13 17:17:43.644163 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.644143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fjjfz"
Jul 13 17:17:43.647144 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.647108    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:43.652577 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.652557    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72940f3e_a48d_449c_b52e_874ffd84c18d.slice/crio-61827f46cd85eed153e34ee534ea9afd9bc97ab9304bd8eb76c581e7dce74b49 WatchSource:0}: Error finding container 61827f46cd85eed153e34ee534ea9afd9bc97ab9304bd8eb76c581e7dce74b49: Status 404 returned error can't find the container with id 61827f46cd85eed153e34ee534ea9afd9bc97ab9304bd8eb76c581e7dce74b49
Jul 13 17:17:43.662425 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.662409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:17:43.670091 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.670073    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82a21e2_5f47_469a_9e6e_1b736f834a65.slice/crio-1f7b3a478692f1145f507d2a2293a29d3a8d8615b5d68d27c2e766b7bba29b58 WatchSource:0}: Error finding container 1f7b3a478692f1145f507d2a2293a29d3a8d8615b5d68d27c2e766b7bba29b58: Status 404 returned error can't find the container with id 1f7b3a478692f1145f507d2a2293a29d3a8d8615b5d68d27c2e766b7bba29b58
Jul 13 17:17:43.671393 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.671305    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vs2jp"
Jul 13 17:17:43.679437 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.679412    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041789df_4e38_442a_8b66_f1e08ca5c7f5.slice/crio-91266d5b03cc7a67107c59a1b523e23616f6d151a01cde274dfce077594037a1 WatchSource:0}: Error finding container 91266d5b03cc7a67107c59a1b523e23616f6d151a01cde274dfce077594037a1: Status 404 returned error can't find the container with id 91266d5b03cc7a67107c59a1b523e23616f6d151a01cde274dfce077594037a1
Jul 13 17:17:43.693109 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.693089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zmw8f"
Jul 13 17:17:43.701580 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.701557    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522289d0_6367_4f4e_8531_359bc2c02295.slice/crio-58a9a8cb2329f27551cd8aef585bbffeb3d72bf69382b55ebb1a658abd71aeaa WatchSource:0}: Error finding container 58a9a8cb2329f27551cd8aef585bbffeb3d72bf69382b55ebb1a658abd71aeaa: Status 404 returned error can't find the container with id 58a9a8cb2329f27551cd8aef585bbffeb3d72bf69382b55ebb1a658abd71aeaa
Jul 13 17:17:43.702377 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.702356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mls8j"
Jul 13 17:17:43.710757 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:17:43.710740    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6937fd_caba_429e_a900_525b53e84b11.slice/crio-449c11e99c8b33133254661c555999d7143f63f057df385acd113f5f661d0a8a WatchSource:0}: Error finding container 449c11e99c8b33133254661c555999d7143f63f057df385acd113f5f661d0a8a: Status 404 returned error can't find the container with id 449c11e99c8b33133254661c555999d7143f63f057df385acd113f5f661d0a8a
Jul 13 17:17:43.713763 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.713745    2577 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-mls8j_openshift-network-operator(ea6937fd-caba-429e-a900-525b53e84b11): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 13 17:17:43.713826 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.713775    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-mls8j" podUID="ea6937fd-caba-429e-a900-525b53e84b11"
Jul 13 17:17:43.870736 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.870670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:43.870830 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.870807    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:43.870871 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.870861    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:44.870844228 +0000 UTC m=+2.949036265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:43.971739 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:43.971703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:43.971902 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.971811    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:43.971902 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:43.971860    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:17:44.971847004 +0000 UTC m=+3.050039034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:44.072936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.072897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:44.073136 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.073081    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:44.073136 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.073106    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:44.073136 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.073119    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:44.073314 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.073188    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:45.073167597 +0000 UTC m=+3.151359630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:44.301026 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.300995    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:44.385017 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.384979    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:12:44 +0000 UTC" deadline="2027-12-29 21:34:36.392128475 +0000 UTC"
Jul 13 17:17:44.385017 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.385015    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12820h16m52.007118345s"
Jul 13 17:17:44.425950 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.425744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fjjfz" event={"ID":"72940f3e-a48d-449c-b52e-874ffd84c18d","Type":"ContainerStarted","Data":"61827f46cd85eed153e34ee534ea9afd9bc97ab9304bd8eb76c581e7dce74b49"}
Jul 13 17:17:44.428463 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.427800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t" event={"ID":"a54538de-834a-4158-8bc2-2b170c735291","Type":"ContainerStarted","Data":"2b3a5ddfb58d4914491ce00779d8e80bd7ed633cdd08afc470366156946a98b3"}
Jul 13 17:17:44.431042 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.431016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal" event={"ID":"449211ff1c81057c17c77af8c685badd","Type":"ContainerStarted","Data":"ad1073d2dee17a2d22f87e3a032f8bc6cd66aa67e730a00d4ad6d5c356d58770"}
Jul 13 17:17:44.432803 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.432777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mls8j" event={"ID":"ea6937fd-caba-429e-a900-525b53e84b11","Type":"ContainerStarted","Data":"449c11e99c8b33133254661c555999d7143f63f057df385acd113f5f661d0a8a"}
Jul 13 17:17:44.435965 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.435938    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-mls8j" podUID="ea6937fd-caba-429e-a900-525b53e84b11"
Jul 13 17:17:44.438730 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.438703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zmw8f" event={"ID":"522289d0-6367-4f4e-8531-359bc2c02295","Type":"ContainerStarted","Data":"58a9a8cb2329f27551cd8aef585bbffeb3d72bf69382b55ebb1a658abd71aeaa"}
Jul 13 17:17:44.451187 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.451161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerStarted","Data":"4ee0ba157323c911aab30195baf347e8a7f41386345b8862d2bff82d1f9f2efe"}
Jul 13 17:17:44.456373 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.456349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t57qd" event={"ID":"c77fb01f-a5e7-4f84-87c8-248a63b56b0a","Type":"ContainerStarted","Data":"10511b92ef4e455a54552f7193079a822e00e57a0cb25175844723a3bd150c8a"}
Jul 13 17:17:44.468987 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.468959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-shh99" event={"ID":"ff28572d-d027-4b00-a3fc-7b7377640652","Type":"ContainerStarted","Data":"acd0fda820646dbbdaea03b9865df0b4639bfc052e59290d4734d49cc9ba7120"}
Jul 13 17:17:44.478488 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.478415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal" event={"ID":"3a25243051a280bc4d5e11c474a5bfe9","Type":"ContainerStarted","Data":"a0270da0058c764363331e35c9ec833a3d08f867be89c1c39a28b2450da7a21f"}
Jul 13 17:17:44.493003 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.492819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vs2jp" event={"ID":"041789df-4e38-442a-8b66-f1e08ca5c7f5","Type":"ContainerStarted","Data":"91266d5b03cc7a67107c59a1b523e23616f6d151a01cde274dfce077594037a1"}
Jul 13 17:17:44.514830 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.514803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"1f7b3a478692f1145f507d2a2293a29d3a8d8615b5d68d27c2e766b7bba29b58"}
Jul 13 17:17:44.880731 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.880693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:44.880945 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.880863    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:44.880945 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.880942    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:46.880919528 +0000 UTC m=+4.959111561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:44.982057 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:44.982015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:44.982254 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.982220    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:44.982326 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:44.982286    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:17:46.982266178 +0000 UTC m=+5.060458228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:45.082913 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:45.082876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:45.083099 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.083050    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:45.083099 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.083073    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:45.083099 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.083087    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:45.083274 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.083146    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:47.083127715 +0000 UTC m=+5.161319749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:45.385622 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:45.385557    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:12:44 +0000 UTC" deadline="2028-04-07 22:59:28.362936468 +0000 UTC"
Jul 13 17:17:45.385622 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:45.385620    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15221h41m42.977321242s"
Jul 13 17:17:45.415992 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:45.415965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:45.416164 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.416099    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:45.416558 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:45.416527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:45.416654 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.416627    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:45.416727 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:45.416695    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:45.416809 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:45.416791    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:46.896833 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:46.896729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:46.897303 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:46.896878    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:46.897303 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:46.896941    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:50.896922317 +0000 UTC m=+8.975114349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:46.997825 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:46.997789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:46.997997 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:46.997949    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:46.998060 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:46.998013    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:17:50.997993937 +0000 UTC m=+9.076185969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:47.098925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:47.098883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:47.099645 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.099116    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:47.099645 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.099176    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:47.099645 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.099192    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:47.099645 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.099265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:51.099244127 +0000 UTC m=+9.177436161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:47.416084 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:47.416051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:47.416272 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:47.416051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:47.416272 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.416191    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:47.416435 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:47.416058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:47.416475 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.416452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:47.416513 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:47.416299    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:49.416554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:49.416522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:49.417092 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:49.416565    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:49.417092 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:49.416532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:49.417092 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:49.416664    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:49.417092 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:49.416738    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:49.417092 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:49.416863    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:50.928975 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:50.928933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:50.929538 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:50.929119    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:50.929538 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:50.929195    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:58.929173186 +0000 UTC m=+17.007365232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:51.030233 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:51.030081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:51.030233 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.030233    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:51.030499 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.030301    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:17:59.030283013 +0000 UTC m=+17.108475058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:51.131169 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:51.131133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:51.131376 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.131353    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:51.131435 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.131384    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:51.131435 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.131400    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:51.131533 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.131469    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:59.131449052 +0000 UTC m=+17.209641096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:51.416573 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:51.416536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:51.416771 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.416680    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:51.417106 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:51.417087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:51.417204 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.417184    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:51.417294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:51.417252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:51.417409 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:51.417371    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:53.416657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:53.416574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:53.417160 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:53.416577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:53.417160 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:53.416707    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:53.417160 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:53.416792    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:53.417160 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:53.416841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:53.417160 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:53.416908    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:55.415621 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:55.415589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:55.416046 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:55.415688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:55.416046 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:55.415696    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:55.416046 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:55.415791    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:55.416046 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:55.415694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:55.416046 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:55.415875    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:57.416422 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:57.416388    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:57.416871 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:57.416500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:57.416871 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:57.416634    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:17:57.416871 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:57.416634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:57.416871 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:57.416757    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:57.416871 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:57.416850    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:58.990340 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:58.990287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:58.990827 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:58.990414    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:58.990827 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:58.990492    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:14.990472741 +0000 UTC m=+33.068664785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:59.091074 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:59.091038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:59.091241 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.091211    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:59.091324 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.091277    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:18:15.091256315 +0000 UTC m=+33.169448343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:59.191575 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:59.191543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:59.191743 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.191692    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:59.191743 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.191708    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:59.191743 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.191717    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:59.191883 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.191770    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:15.191757375 +0000 UTC m=+33.269949403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:59.416164 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:59.416131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:17:59.416430 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.416233    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:17:59.416430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:59.416144    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:17:59.416430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:17:59.416139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:17:59.416430 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.416336    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:17:59.416430 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:17:59.416415    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:01.416278 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:01.416078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:01.416767 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:01.416130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:01.416767 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:01.416130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:01.416767 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:01.416387    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:01.416767 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:01.416496    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:01.416767 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:01.416578    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:03.416345 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:03.416289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:03.416345 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:03.416346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:03.416824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:03.416409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:03.416824 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:03.416423    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:03.416824 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:03.416506    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:03.416824 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:03.416596    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:04.564689 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:04.564344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal" event={"ID":"3a25243051a280bc4d5e11c474a5bfe9","Type":"ContainerStarted","Data":"2abaed86901d74135612b6b515b964bf1dce6cd8a34fc62309326b51aec4965f"}
Jul 13 17:18:04.568146 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:04.568120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vs2jp" event={"ID":"041789df-4e38-442a-8b66-f1e08ca5c7f5","Type":"ContainerStarted","Data":"8619f5ea3686acee63d12012fc4c15ded30e7baad130fa8b1561a1afdfaf46ca"}
Jul 13 17:18:04.573068 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:04.573033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fjjfz" event={"ID":"72940f3e-a48d-449c-b52e-874ffd84c18d","Type":"ContainerStarted","Data":"7177ecf5797ab91e62c0cf970aa8db9d4c2c2903654b4d567aec546ae646cb6d"}
Jul 13 17:18:04.584358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:04.584066    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-215.ec2.internal" podStartSLOduration=21.584050071 podStartE2EDuration="21.584050071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:04.583486797 +0000 UTC m=+22.661678849" watchObservedRunningTime="2026-07-13 17:18:04.584050071 +0000 UTC m=+22.662242121"
Jul 13 17:18:04.615590 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:04.615468    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fjjfz" podStartSLOduration=0.811642691 podStartE2EDuration="21.615446024s" totalImagesPullingTime="20.803803333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:04.614988515 +0000 UTC m=+22.693180565" watchObservedRunningTime="2026-07-13 17:18:04.615446024 +0000 UTC m=+22.693638079"
Jul 13 17:18:04.650448 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:04.649934    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vs2jp" podStartSLOduration=0.92067418 podStartE2EDuration="21.6499145s" totalImagesPullingTime="20.72924032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:04.648781134 +0000 UTC m=+22.726973184" watchObservedRunningTime="2026-07-13 17:18:04.6499145 +0000 UTC m=+22.728106551"
Jul 13 17:18:05.416876 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.416575    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:05.417121 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.416618    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:05.417121 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:05.416946    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:05.417121 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:05.417022    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:05.417121 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.416623    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:05.417121 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:05.417106    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:05.583023 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.582986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t" event={"ID":"a54538de-834a-4158-8bc2-2b170c735291","Type":"ContainerStarted","Data":"685e886dd831e9aac33c6de829f6ed65b446c0710bfe7d4a1aa9d8d8cc027ae2"}
Jul 13 17:18:05.584355 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.584333    2577 generic.go:356] "Generic (PLEG): container finished" podID="449211ff1c81057c17c77af8c685badd" containerID="f0c81cb7372bf2adbea7e50aca36fc072c0b8c28b32a0d239bbeab1afb6c9605" exitCode=0
Jul 13 17:18:05.584460 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.584412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal" event={"ID":"449211ff1c81057c17c77af8c685badd","Type":"ContainerDied","Data":"f0c81cb7372bf2adbea7e50aca36fc072c0b8c28b32a0d239bbeab1afb6c9605"}
Jul 13 17:18:05.585756 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.585720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zmw8f" event={"ID":"522289d0-6367-4f4e-8531-359bc2c02295","Type":"ContainerStarted","Data":"06c7be0a01c95a8f0dc0658a22b012bfe56ddff9a0e4c1d136f57db936d10f40"}
Jul 13 17:18:05.586992 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.586972    2577 generic.go:356] "Generic (PLEG): container finished" podID="584c10ed-c1ba-4562-adc8-236b7f612a72" containerID="1db637f41acdc8456f361bad159ebdf760158efd5e9476ff180d7c81e133f67f" exitCode=0
Jul 13 17:18:05.587097 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.587035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerDied","Data":"1db637f41acdc8456f361bad159ebdf760158efd5e9476ff180d7c81e133f67f"}
Jul 13 17:18:05.588295 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.588264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t57qd" event={"ID":"c77fb01f-a5e7-4f84-87c8-248a63b56b0a","Type":"ContainerStarted","Data":"63761aff5e385215b8ec6681477e2622b61ebcf048d2166beea00e0d5e40d5a3"}
Jul 13 17:18:05.589697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.589669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-shh99" event={"ID":"ff28572d-d027-4b00-a3fc-7b7377640652","Type":"ContainerStarted","Data":"06bfb954125b40645f15fdad64f12d02b2831c9df3ea2f475da796e6670625b1"}
Jul 13 17:18:05.592247 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592225    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:18:05.592535 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592519    2577 generic.go:356] "Generic (PLEG): container finished" podID="e82a21e2-5f47-469a-9e6e-1b736f834a65" containerID="fc8541d6d10d4e4b235d2348fa2324b1dcf78779db5331972bb6d28bd5040d2c" exitCode=1
Jul 13 17:18:05.592626 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"76437b0b72eed73217df03319abf593283b6ff796d144085bdd0918787187685"}
Jul 13 17:18:05.592672 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"b84a9d423525ac122c5f819a6fe878cbbfbfb9224b48d27ff77f5335e4f48b3c"}
Jul 13 17:18:05.592718 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"0f9f5a7ef29000f343c41c8c2dc385c554e6a10e8f63c18a77176176d63d333d"}
Jul 13 17:18:05.592718 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592709    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"84015c8693a5ce5485fea6a89e1f097cef0f9edf712a3c85930c9cd5c0ace0af"}
Jul 13 17:18:05.592846 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerDied","Data":"fc8541d6d10d4e4b235d2348fa2324b1dcf78779db5331972bb6d28bd5040d2c"}
Jul 13 17:18:05.592846 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.592776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"b4fd004f620e001f78c752303a7f9aaaabc36519601ec40644a355a728661f00"}
Jul 13 17:18:05.660939 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.660901    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-shh99" podStartSLOduration=6.084944233 podStartE2EDuration="22.660887742s" totalImagesPullingTime="16.575943509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.633399541 +0000 UTC m=+23.711591587" watchObservedRunningTime="2026-07-13 17:18:05.660887742 +0000 UTC m=+23.739079792"
Jul 13 17:18:05.699653 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:05.699615    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t57qd" podStartSLOduration=1.92653154 podStartE2EDuration="22.699600602s" totalImagesPullingTime="20.773069062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.661249502 +0000 UTC m=+23.739441552" watchObservedRunningTime="2026-07-13 17:18:05.699600602 +0000 UTC m=+23.777792653"
Jul 13 17:18:06.021007 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.020984    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 17:18:06.330830 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.330737    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T17:18:06.021004452Z","UUID":"97f60bbb-1744-41c6-9f4f-ecbbdbe61462","Handler":null,"Name":"","Endpoint":""}
Jul 13 17:18:06.332326 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.332289    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 17:18:06.332445 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.332347    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 17:18:06.599129 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.598348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mls8j" event={"ID":"ea6937fd-caba-429e-a900-525b53e84b11","Type":"ContainerStarted","Data":"3f7abaf7a869dda3447662bc2165ad94560b843a80b21f917623d6da2dc162e7"}
Jul 13 17:18:06.606922 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.606893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t" event={"ID":"a54538de-834a-4158-8bc2-2b170c735291","Type":"ContainerStarted","Data":"0f046d68e55f6471009c2aab66c4065f63cf16f693e520179ed4b44a31853466"}
Jul 13 17:18:06.608952 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.608926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal" event={"ID":"449211ff1c81057c17c77af8c685badd","Type":"ContainerStarted","Data":"a02816c935bdad1c0715a79d872f9d4fea021e56e918c34c5674b60228fda96d"}
Jul 13 17:18:06.624101 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.624048    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zmw8f" podStartSLOduration=2.928109498 podStartE2EDuration="23.62402874s" totalImagesPullingTime="20.695919242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.726403467 +0000 UTC m=+23.804595517" watchObservedRunningTime="2026-07-13 17:18:06.62402874 +0000 UTC m=+24.702220797"
Jul 13 17:18:06.647688 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.647643    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mls8j" podStartSLOduration=23.647625482 podStartE2EDuration="23.647625482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-13 17:18:06.624611282 +0000 UTC m=+24.702803342" watchObservedRunningTime="2026-07-13 17:18:06.647625482 +0000 UTC m=+24.725817533"
Jul 13 17:18:06.647821 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.647741    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-215.ec2.internal" podStartSLOduration=23.647733157 podStartE2EDuration="23.647733157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:06.646900853 +0000 UTC m=+24.725092907" watchObservedRunningTime="2026-07-13 17:18:06.647733157 +0000 UTC m=+24.725925208"
Jul 13 17:18:06.893749 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.893678    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:18:06.894422 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:06.894397    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:18:07.415661 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.415619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:07.415785 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.415726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:07.415785 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:07.415734    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:07.415785 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.415760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:07.415930 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:07.415853    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:07.415973 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:07.415947    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:07.614376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.614353    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:18:07.614799 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.614770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"5dab51c884cbb598d864464ad4cd009f279f5c588ef474aa57b541b5b94b2dc5"}
Jul 13 17:18:07.619343 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.619296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t" event={"ID":"a54538de-834a-4158-8bc2-2b170c735291","Type":"ContainerStarted","Data":"09e67b56b99df2c0398f2b6fac082fc8095b52296f0c63ae7ea759d0a62e135e"}
Jul 13 17:18:07.620360 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.620243    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:18:07.620819 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.620759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-shh99"
Jul 13 17:18:07.668878 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:07.668831    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9h65t" podStartSLOduration=1.483792775 podStartE2EDuration="24.668818514s" totalImagesPullingTime="23.185025739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:07.668502536 +0000 UTC m=+25.746694585" watchObservedRunningTime="2026-07-13 17:18:07.668818514 +0000 UTC m=+25.747010558"
Jul 13 17:18:09.416145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:09.415976    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:09.416634 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:09.416017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:09.416634 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:09.416220    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:09.416634 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:09.416019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:09.416634 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:09.416293    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:09.416634 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:09.416408    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:10.629688 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.629539    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:18:10.630473 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.630059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"de15499a2a12da8fc568d0395c24c8281a26c71cd769f7e2163fc16675197eed"}
Jul 13 17:18:10.630473 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.630324    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:18:10.630473 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.630388    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:18:10.630473 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.630434    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:18:10.630649 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.630474    2577 scope.go:117] "RemoveContainer" containerID="fc8541d6d10d4e4b235d2348fa2324b1dcf78779db5331972bb6d28bd5040d2c"
Jul 13 17:18:10.632246 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.632224    2577 generic.go:356] "Generic (PLEG): container finished" podID="584c10ed-c1ba-4562-adc8-236b7f612a72" containerID="4ed4647b3eab32c6e2ef2a9b0b818cc9b1dc241301b2c0ea530e3d6ef20a88a7" exitCode=0
Jul 13 17:18:10.632437 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.632266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerDied","Data":"4ed4647b3eab32c6e2ef2a9b0b818cc9b1dc241301b2c0ea530e3d6ef20a88a7"}
Jul 13 17:18:10.648054 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.648035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:18:10.648213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:10.648194    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:18:11.415719 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:11.415691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:11.415919 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:11.415781    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:11.415919 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:11.415789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:11.415919 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:11.415787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:11.415919 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:11.415863    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:11.416050 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:11.415930    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:11.638238 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:11.638215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:18:11.638630 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:11.638608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" event={"ID":"e82a21e2-5f47-469a-9e6e-1b736f834a65","Type":"ContainerStarted","Data":"3b82e311664df1d1e2ca1117f17b0f4a72f76b16174193ac2560f97f28853deb"}
Jul 13 17:18:11.707688 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:11.707609    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg" podStartSLOduration=7.91121258 podStartE2EDuration="28.707592504s" totalImagesPullingTime="20.796379924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:11.705288289 +0000 UTC m=+29.783480340" watchObservedRunningTime="2026-07-13 17:18:11.707592504 +0000 UTC m=+29.785784554"
Jul 13 17:18:12.302561 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:12.302533    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhhbz"]
Jul 13 17:18:12.302728 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:12.302640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:12.302824 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:12.302800    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:12.311924 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:12.311858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4r6vl"]
Jul 13 17:18:12.312048 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:12.311963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:12.312107 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:12.312057    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:12.312546 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:12.312523    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l2jhc"]
Jul 13 17:18:12.312637 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:12.312620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:12.312742 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:12.312722    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:13.416000 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:13.415965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:13.416464 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:13.416069    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:13.416464 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:13.416127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:13.416464 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:13.416223    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:13.644390 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:13.644355    2577 generic.go:356] "Generic (PLEG): container finished" podID="584c10ed-c1ba-4562-adc8-236b7f612a72" containerID="f8a1576538f439e683dd742ea7630f6e52112a6d8a9c0531b722d5af16b465d2" exitCode=0
Jul 13 17:18:13.644531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:13.644412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerDied","Data":"f8a1576538f439e683dd742ea7630f6e52112a6d8a9c0531b722d5af16b465d2"}
Jul 13 17:18:14.416090 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:14.415930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:14.416461 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:14.416163    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:15.012244 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.012176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:15.012429 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.012341    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:18:15.012429 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.012403    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret podName:023edfbb-2391-40bb-bc9a-712c33630581 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:47.012383738 +0000 UTC m=+65.090575767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret") pod "global-pull-secret-syncer-qhhbz" (UID: "023edfbb-2391-40bb-bc9a-712c33630581") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:18:15.113111 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.113084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:15.113240 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.113187    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:18:15.113240 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.113230    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:18:47.113217544 +0000 UTC m=+65.191409571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:18:15.214099 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.214076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:15.214210 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.214193    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:18:15.214210 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.214205    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:18:15.214277 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.214214    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p7g28 for pod openshift-network-diagnostics/network-check-target-4r6vl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:18:15.214277 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.214253    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28 podName:498f0300-e18f-45aa-9075-3fc7b1316052 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:47.214242468 +0000 UTC m=+65.292434495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7g28" (UniqueName: "kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28") pod "network-check-target-4r6vl" (UID: "498f0300-e18f-45aa-9075-3fc7b1316052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:18:15.415964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.415915    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:15.415964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.415928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:15.416087 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.416001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:15.416138 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:15.416119    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:15.650968 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.650939    2577 generic.go:356] "Generic (PLEG): container finished" podID="584c10ed-c1ba-4562-adc8-236b7f612a72" containerID="9abb2839b17e269088d0f92f2875e29d8d9d48e2b8e9726ed88ade5145f0d815" exitCode=0
Jul 13 17:18:15.651056 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:15.651004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerDied","Data":"9abb2839b17e269088d0f92f2875e29d8d9d48e2b8e9726ed88ade5145f0d815"}
Jul 13 17:18:16.415836 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:16.415811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:16.416025 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:16.415931    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r6vl" podUID="498f0300-e18f-45aa-9075-3fc7b1316052"
Jul 13 17:18:17.416481 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:17.416451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:17.417050 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:17.416453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:17.417050 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:17.416673    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:18:17.417050 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:17.416557    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhhbz" podUID="023edfbb-2391-40bb-bc9a-712c33630581"
Jul 13 17:18:18.221591 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.221526    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-215.ec2.internal" event="NodeReady"
Jul 13 17:18:18.221737 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.221659    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 17:18:18.376351 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.376218    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hjl7l"]
Jul 13 17:18:18.379429 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.379407    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vxf7m"]
Jul 13 17:18:18.379545 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.379523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.381340 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.381319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.390372 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.390174    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvlgt\""
Jul 13 17:18:18.390372 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.390225    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 17:18:18.390372 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.390256    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 17:18:18.390372 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.390291    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7qlt\""
Jul 13 17:18:18.390636 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.390525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 17:18:18.390636 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.390559    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 17:18:18.391576 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.391558    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 17:18:18.416627 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.416606    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:18.423818 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.423793    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:18:18.423916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.423800    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:18:18.423981 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.423962    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56qtx\""
Jul 13 17:18:18.468643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.468612    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hjl7l"]
Jul 13 17:18:18.510746 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.510718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vxf7m"]
Jul 13 17:18:18.539136 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.539103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc777f4-36c8-4b05-9af6-233aa44610f7-config-volume\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.539279 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.539144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcc777f4-36c8-4b05-9af6-233aa44610f7-tmp-dir\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.539279 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.539188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fzs5\" (UniqueName: \"kubernetes.io/projected/bb0b0830-f3e8-4af8-ab48-3793dbf26e7e-kube-api-access-2fzs5\") pod \"ingress-canary-vxf7m\" (UID: \"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e\") " pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.539279 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.539218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb0b0830-f3e8-4af8-ab48-3793dbf26e7e-cert\") pod \"ingress-canary-vxf7m\" (UID: \"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e\") " pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.539279 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.539249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.539481 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.539284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5hwk\" (UniqueName: \"kubernetes.io/projected/fcc777f4-36c8-4b05-9af6-233aa44610f7-kube-api-access-t5hwk\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.639985 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.639955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb0b0830-f3e8-4af8-ab48-3793dbf26e7e-cert\") pod \"ingress-canary-vxf7m\" (UID: \"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e\") " pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.640145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.640145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5hwk\" (UniqueName: \"kubernetes.io/projected/fcc777f4-36c8-4b05-9af6-233aa44610f7-kube-api-access-t5hwk\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.640145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc777f4-36c8-4b05-9af6-233aa44610f7-config-volume\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.640273 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:18.640178    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:18.640273 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:18.640257    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:19.14023671 +0000 UTC m=+37.218428760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:18.640358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcc777f4-36c8-4b05-9af6-233aa44610f7-tmp-dir\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.640358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fzs5\" (UniqueName: \"kubernetes.io/projected/bb0b0830-f3e8-4af8-ab48-3793dbf26e7e-kube-api-access-2fzs5\") pod \"ingress-canary-vxf7m\" (UID: \"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e\") " pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.640647 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640620    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcc777f4-36c8-4b05-9af6-233aa44610f7-tmp-dir\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.640764 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.640621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fcc777f4-36c8-4b05-9af6-233aa44610f7-config-volume\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.645504 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.645483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb0b0830-f3e8-4af8-ab48-3793dbf26e7e-cert\") pod \"ingress-canary-vxf7m\" (UID: \"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e\") " pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.659383 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.659357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fzs5\" (UniqueName: \"kubernetes.io/projected/bb0b0830-f3e8-4af8-ab48-3793dbf26e7e-kube-api-access-2fzs5\") pod \"ingress-canary-vxf7m\" (UID: \"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e\") " pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:18.659911 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.659891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5hwk\" (UniqueName: \"kubernetes.io/projected/fcc777f4-36c8-4b05-9af6-233aa44610f7-kube-api-access-t5hwk\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:18.697018 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:18.696991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vxf7m"
Jul 13 17:18:19.144631 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.144593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:19.144798 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:19.144714    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:19.144798 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:19.144766    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:20.144752565 +0000 UTC m=+38.222944594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:19.415926 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.415848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:19.416085 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.416031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:19.420073 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.420048    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:18:19.420073 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.420062    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:18:19.421028 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.421004    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gkqtt\""
Jul 13 17:18:19.760934 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:19.760786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vxf7m"]
Jul 13 17:18:19.763777 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:18:19.763724    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0b0830_f3e8_4af8_ab48_3793dbf26e7e.slice/crio-9a63c75b039b1a3bfb8981963d44c0d032b56dcd7d144717d8848b03abb131e4 WatchSource:0}: Error finding container 9a63c75b039b1a3bfb8981963d44c0d032b56dcd7d144717d8848b03abb131e4: Status 404 returned error can't find the container with id 9a63c75b039b1a3bfb8981963d44c0d032b56dcd7d144717d8848b03abb131e4
Jul 13 17:18:20.153009 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:20.152979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:20.153164 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:20.153111    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:20.153203 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:20.153194    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:22.153179454 +0000 UTC m=+40.231371482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:20.664045 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:20.664001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vxf7m" event={"ID":"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e","Type":"ContainerStarted","Data":"9a63c75b039b1a3bfb8981963d44c0d032b56dcd7d144717d8848b03abb131e4"}
Jul 13 17:18:20.667059 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:20.667034    2577 generic.go:356] "Generic (PLEG): container finished" podID="584c10ed-c1ba-4562-adc8-236b7f612a72" containerID="2da4c4cc82c29aad1067c815ccf2f12ff5b5735452873247317be40662e47ac5" exitCode=0
Jul 13 17:18:20.667184 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:20.667070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerDied","Data":"2da4c4cc82c29aad1067c815ccf2f12ff5b5735452873247317be40662e47ac5"}
Jul 13 17:18:21.675768 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:21.675735    2577 generic.go:356] "Generic (PLEG): container finished" podID="584c10ed-c1ba-4562-adc8-236b7f612a72" containerID="ff83d54a5aac6754f6b657f1b60186b6d84a2a9640d76320197255fcbd0585f3" exitCode=0
Jul 13 17:18:21.676177 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:21.675779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerDied","Data":"ff83d54a5aac6754f6b657f1b60186b6d84a2a9640d76320197255fcbd0585f3"}
Jul 13 17:18:22.170037 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:22.169900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:22.170133 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:22.170038    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:22.170133 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:22.170117    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:26.170096151 +0000 UTC m=+44.248288199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:22.681195 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:22.681108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" event={"ID":"584c10ed-c1ba-4562-adc8-236b7f612a72","Type":"ContainerStarted","Data":"d513d84be4429d981b3c77833b7013a7bb18f0f1ef372f182f2450610b80fce1"}
Jul 13 17:18:22.682585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:22.682561    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vxf7m" event={"ID":"bb0b0830-f3e8-4af8-ab48-3793dbf26e7e","Type":"ContainerStarted","Data":"70146d86f30c9b8f33148ea3c1cc88bba3c3af4057b3b9e66301ec5b46c3e0df"}
Jul 13 17:18:22.721132 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:22.721081    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fhmzf" podStartSLOduration=7.061853459 podStartE2EDuration="39.721064815s" totalImagesPullingTime="32.659211356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:22.718255491 +0000 UTC m=+40.796447542" watchObservedRunningTime="2026-07-13 17:18:22.721064815 +0000 UTC m=+40.799256864"
Jul 13 17:18:26.196227 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:26.196191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:26.196597 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:26.196315    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:26.196597 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:26.196366    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:34.196351467 +0000 UTC m=+52.274543496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:34.252749 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:34.252712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:34.253238 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:34.252817    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:34.253238 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:34.252866    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:50.25285188 +0000 UTC m=+68.331043908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:42.651112 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:42.651084    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ljjdg"
Jul 13 17:18:42.693783 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:42.693741    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vxf7m" podStartSLOduration=22.188799547 podStartE2EDuration="24.693727291s" totalImagesPullingTime="2.504927744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:22.780331083 +0000 UTC m=+40.858523149" watchObservedRunningTime="2026-07-13 17:18:42.693727291 +0000 UTC m=+60.771919343"
Jul 13 17:18:47.039707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.039671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:47.043068 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.043050    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:18:47.053990 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.053965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/023edfbb-2391-40bb-bc9a-712c33630581-original-pull-secret\") pod \"global-pull-secret-syncer-qhhbz\" (UID: \"023edfbb-2391-40bb-bc9a-712c33630581\") " pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:47.140127 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.140105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:18:47.143246 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.143230    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:18:47.150473 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:47.150455    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 17:18:47.150516 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:47.150508    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:19:51.150492771 +0000 UTC m=+129.228684798 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : secret "metrics-daemon-secret" not found
Jul 13 17:18:47.240605 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.240581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:47.245265 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.245247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:18:47.255061 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.255047    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:18:47.264539 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.264515    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7g28\" (UniqueName: \"kubernetes.io/projected/498f0300-e18f-45aa-9075-3fc7b1316052-kube-api-access-p7g28\") pod \"network-check-target-4r6vl\" (UID: \"498f0300-e18f-45aa-9075-3fc7b1316052\") " pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:47.334384 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.334333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhhbz"
Jul 13 17:18:47.479291 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.479261    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhhbz"]
Jul 13 17:18:47.482777 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:18:47.482752    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023edfbb_2391_40bb_bc9a_712c33630581.slice/crio-01f9e1cf2a034e477dde069f487b8c857fc739e07f2257518b4896397305b9e4 WatchSource:0}: Error finding container 01f9e1cf2a034e477dde069f487b8c857fc739e07f2257518b4896397305b9e4: Status 404 returned error can't find the container with id 01f9e1cf2a034e477dde069f487b8c857fc739e07f2257518b4896397305b9e4
Jul 13 17:18:47.528773 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.528750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56qtx\""
Jul 13 17:18:47.536889 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.536874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:47.667419 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.667393    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4r6vl"]
Jul 13 17:18:47.670017 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:18:47.669996    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498f0300_e18f_45aa_9075_3fc7b1316052.slice/crio-e3a2fde40253f1de7bd73dc11c78d459464f36d9b0ad9de2b82b1a8c9d27cd86 WatchSource:0}: Error finding container e3a2fde40253f1de7bd73dc11c78d459464f36d9b0ad9de2b82b1a8c9d27cd86: Status 404 returned error can't find the container with id e3a2fde40253f1de7bd73dc11c78d459464f36d9b0ad9de2b82b1a8c9d27cd86
Jul 13 17:18:47.741168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.741145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhhbz" event={"ID":"023edfbb-2391-40bb-bc9a-712c33630581","Type":"ContainerStarted","Data":"01f9e1cf2a034e477dde069f487b8c857fc739e07f2257518b4896397305b9e4"}
Jul 13 17:18:47.742440 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:47.742417    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4r6vl" event={"ID":"498f0300-e18f-45aa-9075-3fc7b1316052","Type":"ContainerStarted","Data":"e3a2fde40253f1de7bd73dc11c78d459464f36d9b0ad9de2b82b1a8c9d27cd86"}
Jul 13 17:18:50.259254 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:50.259211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:18:50.259698 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:50.259392    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:50.259698 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:18:50.259478    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:19:22.259454466 +0000 UTC m=+100.337646519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:52.757626 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:52.757593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhhbz" event={"ID":"023edfbb-2391-40bb-bc9a-712c33630581","Type":"ContainerStarted","Data":"aa52f6cab383b9ca8180c7cbf092895625089a87327037b539e958cc227cf567"}
Jul 13 17:18:52.759065 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:52.759040    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4r6vl" event={"ID":"498f0300-e18f-45aa-9075-3fc7b1316052","Type":"ContainerStarted","Data":"9d98d747c3b3824cf3005b7a74a624086652f5d618eb96f96886f20ca022bfcd"}
Jul 13 17:18:52.759171 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:52.759099    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:18:52.782574 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:52.782525    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qhhbz" podStartSLOduration=64.669455353 podStartE2EDuration="1m9.782506497s" totalImagesPullingTime="5.113051144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:52.780809542 +0000 UTC m=+70.859001593" watchObservedRunningTime="2026-07-13 17:18:52.782506497 +0000 UTC m=+70.860698547"
Jul 13 17:18:52.819754 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:18:52.819714    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4r6vl" podStartSLOduration=64.90429732 podStartE2EDuration="1m9.81969765s" totalImagesPullingTime="4.91540033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:52.819295694 +0000 UTC m=+70.897487744" watchObservedRunningTime="2026-07-13 17:18:52.81969765 +0000 UTC m=+70.897889695"
Jul 13 17:19:22.269790 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:19:22.269755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:19:22.270202 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:19:22.269853    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:19:22.270202 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:19:22.269900    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:20:26.269887143 +0000 UTC m=+164.348079171 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:19:23.763841 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:19:23.763813    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4r6vl"
Jul 13 17:19:51.164634 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:19:51.164595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:19:51.165096 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:19:51.164741    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 17:19:51.165096 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:19:51.164821    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs podName:1b894166-38b3-4df5-aa2a-34397e83cd0d nodeName:}" failed. No retries permitted until 2026-07-13 17:21:53.164804793 +0000 UTC m=+251.242996823 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs") pod "network-metrics-daemon-l2jhc" (UID: "1b894166-38b3-4df5-aa2a-34397e83cd0d") : secret "metrics-daemon-secret" not found
Jul 13 17:20:21.391501 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:20:21.391448    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hjl7l" podUID="fcc777f4-36c8-4b05-9af6-233aa44610f7"
Jul 13 17:20:21.964126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:20:21.964052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:20:22.427922 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:20:22.427888    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l2jhc" podUID="1b894166-38b3-4df5-aa2a-34397e83cd0d"
Jul 13 17:20:26.294039 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:20:26.294008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:20:26.294435 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:20:26.294125    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:20:26.294435 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:20:26.294173    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls podName:fcc777f4-36c8-4b05-9af6-233aa44610f7 nodeName:}" failed. No retries permitted until 2026-07-13 17:22:28.294159872 +0000 UTC m=+286.372351900 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls") pod "dns-default-hjl7l" (UID: "fcc777f4-36c8-4b05-9af6-233aa44610f7") : secret "dns-default-metrics-tls" not found
Jul 13 17:20:35.416098 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:20:35.416014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:21:24.835415 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.835383    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"]
Jul 13 17:21:24.837353 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.837315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:24.838540 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.838515    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"]
Jul 13 17:21:24.839589 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.839567    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 17:21:24.839701 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.839657    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:21:24.839749 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.839660    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 17:21:24.839909 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.839893    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 17:21:24.840367 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.840352    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vqtlm"]
Jul 13 17:21:24.840494 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.840479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"
Jul 13 17:21:24.840752 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.840739    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h9wx5\""
Jul 13 17:21:24.841975 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.841962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:24.855163 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.855146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qqnx4\""
Jul 13 17:21:24.855878 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.855857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:21:24.856617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.856604    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 17:21:24.857021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.857009    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 17:21:24.857090 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.857070    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 17:21:24.857139 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.857123    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ncvfq\""
Jul 13 17:21:24.867307 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.867285    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"]
Jul 13 17:21:24.869700 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.869653    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 17:21:24.870284 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.870265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vqtlm"]
Jul 13 17:21:24.873422 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.873405    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"]
Jul 13 17:21:24.930665 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.930640    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d88dfb4c9-67r27"]
Jul 13 17:21:24.932656 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.932641    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"]
Jul 13 17:21:24.932777 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.932764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:24.934387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.934372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:24.939231 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939003    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 17:21:24.939231 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939093    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:21:24.939231 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939093    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2rlnn\""
Jul 13 17:21:24.939231 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939201    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 17:21:24.939449 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939438    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 17:21:24.939533 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939517    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 17:21:24.939593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 17:21:24.939650 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.939600    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cnlbq\""
Jul 13 17:21:24.940680 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.940660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 17:21:24.955968 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.955949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d88dfb4c9-67r27"]
Jul 13 17:21:24.960660 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.960639    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"]
Jul 13 17:21:24.961547 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.961530    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 17:21:24.964470 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/352a6492-b04e-4e6a-ae13-d00773349230-serving-cert\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:24.964554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc10f3b4-76cf-4772-95bc-58415046c84b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:24.964554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/352a6492-b04e-4e6a-ae13-d00773349230-config\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:24.964554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dtf\" (UniqueName: \"kubernetes.io/projected/4115c2e7-5e7b-4ec7-9a33-7f335694adc2-kube-api-access-46dtf\") pod \"network-check-source-869dcfcdcd-nq4wv\" (UID: \"4115c2e7-5e7b-4ec7-9a33-7f335694adc2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"
Jul 13 17:21:24.964554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc10f3b4-76cf-4772-95bc-58415046c84b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:24.964695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68ddx\" (UniqueName: \"kubernetes.io/projected/bc10f3b4-76cf-4772-95bc-58415046c84b-kube-api-access-68ddx\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:24.964695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/352a6492-b04e-4e6a-ae13-d00773349230-trusted-ca\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:24.964695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:24.964673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfhpf\" (UniqueName: \"kubernetes.io/projected/352a6492-b04e-4e6a-ae13-d00773349230-kube-api-access-xfhpf\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.065096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f57b7329-106b-48d5-8662-4cde8fdc3b9e-ca-trust-extracted\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065185 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68ddx\" (UniqueName: \"kubernetes.io/projected/bc10f3b4-76cf-4772-95bc-58415046c84b-kube-api-access-68ddx\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.065185 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/352a6492-b04e-4e6a-ae13-d00773349230-trusted-ca\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.065185 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-image-registry-private-configuration\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065185 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-certificates\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/658019d0-2699-4f9a-8477-a97148d0e9e0-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.065361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhpf\" (UniqueName: \"kubernetes.io/projected/352a6492-b04e-4e6a-ae13-d00773349230-kube-api-access-xfhpf\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.065361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/658019d0-2699-4f9a-8477-a97148d0e9e0-config\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.065361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/352a6492-b04e-4e6a-ae13-d00773349230-serving-cert\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.065361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc10f3b4-76cf-4772-95bc-58415046c84b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.065585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/352a6492-b04e-4e6a-ae13-d00773349230-config\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.065585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dtf\" (UniqueName: \"kubernetes.io/projected/4115c2e7-5e7b-4ec7-9a33-7f335694adc2-kube-api-access-46dtf\") pod \"network-check-source-869dcfcdcd-nq4wv\" (UID: \"4115c2e7-5e7b-4ec7-9a33-7f335694adc2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"
Jul 13 17:21:25.065585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-trusted-ca\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-installation-pull-secrets\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxdd\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-kube-api-access-4mxdd\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srxfl\" (UniqueName: \"kubernetes.io/projected/658019d0-2699-4f9a-8477-a97148d0e9e0-kube-api-access-srxfl\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.065875 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.065875 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc10f3b4-76cf-4772-95bc-58415046c84b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.065875 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-bound-sa-token\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.066026 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc10f3b4-76cf-4772-95bc-58415046c84b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.066071 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.065992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/352a6492-b04e-4e6a-ae13-d00773349230-config\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.066134 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.066116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/352a6492-b04e-4e6a-ae13-d00773349230-trusted-ca\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.067330 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.067312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/352a6492-b04e-4e6a-ae13-d00773349230-serving-cert\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.067631 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.067614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc10f3b4-76cf-4772-95bc-58415046c84b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.075237 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.075213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfhpf\" (UniqueName: \"kubernetes.io/projected/352a6492-b04e-4e6a-ae13-d00773349230-kube-api-access-xfhpf\") pod \"console-operator-7866497494-vqtlm\" (UID: \"352a6492-b04e-4e6a-ae13-d00773349230\") " pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.075927 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.075907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dtf\" (UniqueName: \"kubernetes.io/projected/4115c2e7-5e7b-4ec7-9a33-7f335694adc2-kube-api-access-46dtf\") pod \"network-check-source-869dcfcdcd-nq4wv\" (UID: \"4115c2e7-5e7b-4ec7-9a33-7f335694adc2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"
Jul 13 17:21:25.075927 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.075912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68ddx\" (UniqueName: \"kubernetes.io/projected/bc10f3b4-76cf-4772-95bc-58415046c84b-kube-api-access-68ddx\") pod \"kube-storage-version-migrator-operator-799cb7f958-kwpqp\" (UID: \"bc10f3b4-76cf-4772-95bc-58415046c84b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.146769 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.146721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"
Jul 13 17:21:25.152998 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.152980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"
Jul 13 17:21:25.157737 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.157703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:25.166569 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srxfl\" (UniqueName: \"kubernetes.io/projected/658019d0-2699-4f9a-8477-a97148d0e9e0-kube-api-access-srxfl\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.166710 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166710 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-bound-sa-token\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166710 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f57b7329-106b-48d5-8662-4cde8fdc3b9e-ca-trust-extracted\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166710 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:25.166682    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:21:25.166710 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:25.166701    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d88dfb4c9-67r27: secret "image-registry-tls" not found
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-image-registry-private-configuration\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:25.166751    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls podName:f57b7329-106b-48d5-8662-4cde8fdc3b9e nodeName:}" failed. No retries permitted until 2026-07-13 17:21:25.666732061 +0000 UTC m=+223.744924107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls") pod "image-registry-6d88dfb4c9-67r27" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e") : secret "image-registry-tls" not found
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-certificates\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/658019d0-2699-4f9a-8477-a97148d0e9e0-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/658019d0-2699-4f9a-8477-a97148d0e9e0-config\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-trusted-ca\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-installation-pull-secrets\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.166971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.166934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxdd\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-kube-api-access-4mxdd\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.167381 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.167323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f57b7329-106b-48d5-8662-4cde8fdc3b9e-ca-trust-extracted\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.167790 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.167698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/658019d0-2699-4f9a-8477-a97148d0e9e0-config\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.168317 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.168263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-trusted-ca\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.168607 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.168584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-certificates\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.169656 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.169612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-image-registry-private-configuration\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.169889 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.169864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/658019d0-2699-4f9a-8477-a97148d0e9e0-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.170632 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.170607    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-installation-pull-secrets\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.178835 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.178813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-bound-sa-token\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.179293 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.179273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srxfl\" (UniqueName: \"kubernetes.io/projected/658019d0-2699-4f9a-8477-a97148d0e9e0-kube-api-access-srxfl\") pod \"service-ca-operator-7695fc6c8c-bgqft\" (UID: \"658019d0-2699-4f9a-8477-a97148d0e9e0\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.180364 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.180345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxdd\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-kube-api-access-4mxdd\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.250936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.250907    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"
Jul 13 17:21:25.289930 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.289905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv"]
Jul 13 17:21:25.310475 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.308991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp"]
Jul 13 17:21:25.312182 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:25.312155    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc10f3b4_76cf_4772_95bc_58415046c84b.slice/crio-988db114d15eb458d899f4b565070a78002ec735d37d310552aa448494c55c8b WatchSource:0}: Error finding container 988db114d15eb458d899f4b565070a78002ec735d37d310552aa448494c55c8b: Status 404 returned error can't find the container with id 988db114d15eb458d899f4b565070a78002ec735d37d310552aa448494c55c8b
Jul 13 17:21:25.334242 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.334217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vqtlm"]
Jul 13 17:21:25.338183 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:25.338155    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352a6492_b04e_4e6a_ae13_d00773349230.slice/crio-a8a777f68eed518358e22fbefdbc58c1eadf7b78fecc13eb1e177d89c28b4691 WatchSource:0}: Error finding container a8a777f68eed518358e22fbefdbc58c1eadf7b78fecc13eb1e177d89c28b4691: Status 404 returned error can't find the container with id a8a777f68eed518358e22fbefdbc58c1eadf7b78fecc13eb1e177d89c28b4691
Jul 13 17:21:25.388671 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.388638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft"]
Jul 13 17:21:25.391875 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:25.391850    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658019d0_2699_4f9a_8477_a97148d0e9e0.slice/crio-9530db18b22e0c481a41ceef7bd858140aa6a36a9bbaaaa7a4f37e065f2ed265 WatchSource:0}: Error finding container 9530db18b22e0c481a41ceef7bd858140aa6a36a9bbaaaa7a4f37e065f2ed265: Status 404 returned error can't find the container with id 9530db18b22e0c481a41ceef7bd858140aa6a36a9bbaaaa7a4f37e065f2ed265
Jul 13 17:21:25.671167 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:25.671134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:25.671288 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:25.671271    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:21:25.671353 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:25.671290    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d88dfb4c9-67r27: secret "image-registry-tls" not found
Jul 13 17:21:25.671353 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:25.671349    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls podName:f57b7329-106b-48d5-8662-4cde8fdc3b9e nodeName:}" failed. No retries permitted until 2026-07-13 17:21:26.671334996 +0000 UTC m=+224.749527024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls") pod "image-registry-6d88dfb4c9-67r27" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e") : secret "image-registry-tls" not found
Jul 13 17:21:26.109471 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.109438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft" event={"ID":"658019d0-2699-4f9a-8477-a97148d0e9e0","Type":"ContainerStarted","Data":"9530db18b22e0c481a41ceef7bd858140aa6a36a9bbaaaa7a4f37e065f2ed265"}
Jul 13 17:21:26.110921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.110897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vqtlm" event={"ID":"352a6492-b04e-4e6a-ae13-d00773349230","Type":"ContainerStarted","Data":"a8a777f68eed518358e22fbefdbc58c1eadf7b78fecc13eb1e177d89c28b4691"}
Jul 13 17:21:26.113093 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.113065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv" event={"ID":"4115c2e7-5e7b-4ec7-9a33-7f335694adc2","Type":"ContainerStarted","Data":"4bbdc34d3f5dbc3208e68cd6e7f8fea7ab37983668b3d8414086dcbff874fa5a"}
Jul 13 17:21:26.113204 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.113113    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv" event={"ID":"4115c2e7-5e7b-4ec7-9a33-7f335694adc2","Type":"ContainerStarted","Data":"712c57ef294553528fcd229dddc13d3ac2f25c875b4a29a94fe3a823ce73239b"}
Jul 13 17:21:26.115101 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.115002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp" event={"ID":"bc10f3b4-76cf-4772-95bc-58415046c84b","Type":"ContainerStarted","Data":"988db114d15eb458d899f4b565070a78002ec735d37d310552aa448494c55c8b"}
Jul 13 17:21:26.131733 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.131614    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nq4wv" podStartSLOduration=2.131600487 podStartE2EDuration="2.131600487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:26.129930348 +0000 UTC m=+224.208122399" watchObservedRunningTime="2026-07-13 17:21:26.131600487 +0000 UTC m=+224.209792537"
Jul 13 17:21:26.678234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:26.678138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:26.678417 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:26.678261    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:21:26.678417 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:26.678279    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d88dfb4c9-67r27: secret "image-registry-tls" not found
Jul 13 17:21:26.678417 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:26.678376    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls podName:f57b7329-106b-48d5-8662-4cde8fdc3b9e nodeName:}" failed. No retries permitted until 2026-07-13 17:21:28.678357889 +0000 UTC m=+226.756549935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls") pod "image-registry-6d88dfb4c9-67r27" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e") : secret "image-registry-tls" not found
Jul 13 17:21:28.695041 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.695008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:28.695324 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.695174    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:21:28.695324 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.695196    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d88dfb4c9-67r27: secret "image-registry-tls" not found
Jul 13 17:21:28.695324 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.695260    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls podName:f57b7329-106b-48d5-8662-4cde8fdc3b9e nodeName:}" failed. No retries permitted until 2026-07-13 17:21:32.695240186 +0000 UTC m=+230.773432217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls") pod "image-registry-6d88dfb4c9-67r27" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e") : secret "image-registry-tls" not found
Jul 13 17:21:28.876802 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.876740    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b99hh"]
Jul 13 17:21:28.879212 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.879196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.881268 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.881244    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 17:21:28.883170 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.883148    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4nm5\""
Jul 13 17:21:28.883434 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.883415    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 17:21:28.883513 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.883433    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 17:21:28.883513 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.883424    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 17:21:28.897159 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.897135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-data-volume\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.897264 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.897192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-crio-socket\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.897264 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.897230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.897264 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.897254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.897440 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.897274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmjp\" (UniqueName: \"kubernetes.io/projected/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-api-access-xmmjp\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.903915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.903895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b99hh"]
Jul 13 17:21:28.997734 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.997710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-crio-socket\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.997844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.997751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.997844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.997780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.997844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.997810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmjp\" (UniqueName: \"kubernetes.io/projected/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-api-access-xmmjp\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.997844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.997832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-crio-socket\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.998026 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.997845    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:28.998026 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.997910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-data-volume\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:28.998026 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.997921    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:28.998026 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.997921    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:29.497902126 +0000 UTC m=+227.576094170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:28.998026 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:28.998017    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:29.497981157 +0000 UTC m=+227.576173200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:28.998213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:28.998196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-data-volume\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:29.007130 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.007111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmjp\" (UniqueName: \"kubernetes.io/projected/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-api-access-xmmjp\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:29.124848 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.124815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft" event={"ID":"658019d0-2699-4f9a-8477-a97148d0e9e0","Type":"ContainerStarted","Data":"3450279bcecd13f1faef9501b38c3a8da4d3de59b25784932a9648b0893b6e13"}
Jul 13 17:21:29.126561 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.126538    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/0.log"
Jul 13 17:21:29.126646 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.126575    2577 generic.go:356] "Generic (PLEG): container finished" podID="352a6492-b04e-4e6a-ae13-d00773349230" containerID="15f93554d549fe351f462f3afa0f93f5521c6241a72764d02289651c3e462fbd" exitCode=255
Jul 13 17:21:29.126691 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.126666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vqtlm" event={"ID":"352a6492-b04e-4e6a-ae13-d00773349230","Type":"ContainerDied","Data":"15f93554d549fe351f462f3afa0f93f5521c6241a72764d02289651c3e462fbd"}
Jul 13 17:21:29.126849 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.126798    2577 scope.go:117] "RemoveContainer" containerID="15f93554d549fe351f462f3afa0f93f5521c6241a72764d02289651c3e462fbd"
Jul 13 17:21:29.128283 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.128250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp" event={"ID":"bc10f3b4-76cf-4772-95bc-58415046c84b","Type":"ContainerStarted","Data":"00ccb361cb07168aedc422d55505fb94c8e02d0abff82e96d2e6d58d32299670"}
Jul 13 17:21:29.145171 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.144828    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft" podStartSLOduration=2.028589084 podStartE2EDuration="5.144813032s" totalImagesPullingTime="3.116223948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:29.144470849 +0000 UTC m=+227.222662900" watchObservedRunningTime="2026-07-13 17:21:29.144813032 +0000 UTC m=+227.223005085"
Jul 13 17:21:29.184735 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.184687    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp" podStartSLOduration=1.9850804979999999 podStartE2EDuration="5.184668407s" totalImagesPullingTime="3.199587909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:29.18422431 +0000 UTC m=+227.262416361" watchObservedRunningTime="2026-07-13 17:21:29.184668407 +0000 UTC m=+227.262860458"
Jul 13 17:21:29.500870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.500835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:29.501045 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:29.500885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:29.501045 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:29.500965    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:29.501045 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:29.501031    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:29.501188 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:29.501034    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:30.501016579 +0000 UTC m=+228.579208620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:29.501188 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:29.501074    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:30.501064408 +0000 UTC m=+228.579256435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:30.132501 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.132475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:21:30.132884 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.132870    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/0.log"
Jul 13 17:21:30.132934 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.132911    2577 generic.go:356] "Generic (PLEG): container finished" podID="352a6492-b04e-4e6a-ae13-d00773349230" containerID="dbc27295d672f99612ba627162776e9d77008e2ea264a36bc9ce34b17e7e8ff3" exitCode=255
Jul 13 17:21:30.133002 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.132981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vqtlm" event={"ID":"352a6492-b04e-4e6a-ae13-d00773349230","Type":"ContainerDied","Data":"dbc27295d672f99612ba627162776e9d77008e2ea264a36bc9ce34b17e7e8ff3"}
Jul 13 17:21:30.133046 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.133036    2577 scope.go:117] "RemoveContainer" containerID="15f93554d549fe351f462f3afa0f93f5521c6241a72764d02289651c3e462fbd"
Jul 13 17:21:30.133230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.133209    2577 scope.go:117] "RemoveContainer" containerID="dbc27295d672f99612ba627162776e9d77008e2ea264a36bc9ce34b17e7e8ff3"
Jul 13 17:21:30.133468 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:30.133439    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vqtlm_openshift-console-operator(352a6492-b04e-4e6a-ae13-d00773349230)\"" pod="openshift-console-operator/console-operator-7866497494-vqtlm" podUID="352a6492-b04e-4e6a-ae13-d00773349230"
Jul 13 17:21:30.508288 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.508260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:30.508518 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.508292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:30.508518 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:30.508383    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:30.508518 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:30.508404    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:30.508518 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:30.508442    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:32.508427212 +0000 UTC m=+230.586619241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:30.508518 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:30.508455    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:32.508449351 +0000 UTC m=+230.586641379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:30.823469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:30.823401    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t57qd_c77fb01f-a5e7-4f84-87c8-248a63b56b0a/dns-node-resolver/0.log"
Jul 13 17:21:31.138133 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.138059    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:21:31.138488 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.138344    2577 scope.go:117] "RemoveContainer" containerID="dbc27295d672f99612ba627162776e9d77008e2ea264a36bc9ce34b17e7e8ff3"
Jul 13 17:21:31.138488 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:31.138474    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vqtlm_openshift-console-operator(352a6492-b04e-4e6a-ae13-d00773349230)\"" pod="openshift-console-operator/console-operator-7866497494-vqtlm" podUID="352a6492-b04e-4e6a-ae13-d00773349230"
Jul 13 17:21:31.957322 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.957271    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-t9wzx"]
Jul 13 17:21:31.960248 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.960228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:31.963237 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.963217    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 17:21:31.963367 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.963345    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 17:21:31.964102 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.964086    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 17:21:31.964148 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.964100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qbdzq\""
Jul 13 17:21:31.964148 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.964140    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 17:21:31.968984 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:31.968965    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-t9wzx"]
Jul 13 17:21:32.018839 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.018819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eb327adc-f192-411c-90d6-10af79d115de-signing-key\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.018933 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.018845    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ss8\" (UniqueName: \"kubernetes.io/projected/eb327adc-f192-411c-90d6-10af79d115de-kube-api-access-d5ss8\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.018933 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.018888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eb327adc-f192-411c-90d6-10af79d115de-signing-cabundle\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.022844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.022828    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zmw8f_522289d0-6367-4f4e-8531-359bc2c02295/node-ca/0.log"
Jul 13 17:21:32.119896 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.119874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eb327adc-f192-411c-90d6-10af79d115de-signing-key\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.119984 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.119906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ss8\" (UniqueName: \"kubernetes.io/projected/eb327adc-f192-411c-90d6-10af79d115de-kube-api-access-d5ss8\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.119984 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.119965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eb327adc-f192-411c-90d6-10af79d115de-signing-cabundle\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.120669 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.120648    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eb327adc-f192-411c-90d6-10af79d115de-signing-cabundle\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.122151 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.122135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eb327adc-f192-411c-90d6-10af79d115de-signing-key\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.129150 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.129134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ss8\" (UniqueName: \"kubernetes.io/projected/eb327adc-f192-411c-90d6-10af79d115de-kube-api-access-d5ss8\") pod \"service-ca-79f68b9f4f-t9wzx\" (UID: \"eb327adc-f192-411c-90d6-10af79d115de\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.268807 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.268789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx"
Jul 13 17:21:32.390582 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.390446    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-t9wzx"]
Jul 13 17:21:32.392723 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:32.392698    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb327adc_f192_411c_90d6_10af79d115de.slice/crio-bf1f263debd8a9f82b8a20f0532193d0f1a59abddfd30cabef9e7d162f8a1fcd WatchSource:0}: Error finding container bf1f263debd8a9f82b8a20f0532193d0f1a59abddfd30cabef9e7d162f8a1fcd: Status 404 returned error can't find the container with id bf1f263debd8a9f82b8a20f0532193d0f1a59abddfd30cabef9e7d162f8a1fcd
Jul 13 17:21:32.522944 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.522883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:32.522944 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.522913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:32.523134 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.522997    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:32.523134 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.523019    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:32.523134 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.523060    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:36.523041094 +0000 UTC m=+234.601233131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:32.523134 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.523073    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:36.523066765 +0000 UTC m=+234.601258796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:32.724324 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.724267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:32.724472 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.724421    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:21:32.724472 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.724443    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d88dfb4c9-67r27: secret "image-registry-tls" not found
Jul 13 17:21:32.724576 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:32.724504    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls podName:f57b7329-106b-48d5-8662-4cde8fdc3b9e nodeName:}" failed. No retries permitted until 2026-07-13 17:21:40.72448495 +0000 UTC m=+238.802676980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls") pod "image-registry-6d88dfb4c9-67r27" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e") : secret "image-registry-tls" not found
Jul 13 17:21:32.827230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:32.827130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxf7m_bb0b0830-f3e8-4af8-ab48-3793dbf26e7e/serve-healthcheck-canary/0.log"
Jul 13 17:21:33.145754 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:33.145683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx" event={"ID":"eb327adc-f192-411c-90d6-10af79d115de","Type":"ContainerStarted","Data":"8ac709fc5374797314ba6ada43a4d0a28a1ba26ae4105730997f88c8b4ae1899"}
Jul 13 17:21:33.145754 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:33.145727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx" event={"ID":"eb327adc-f192-411c-90d6-10af79d115de","Type":"ContainerStarted","Data":"bf1f263debd8a9f82b8a20f0532193d0f1a59abddfd30cabef9e7d162f8a1fcd"}
Jul 13 17:21:33.165966 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:33.165891    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-t9wzx" podStartSLOduration=2.165872694 podStartE2EDuration="2.165872694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:33.164534219 +0000 UTC m=+231.242726269" watchObservedRunningTime="2026-07-13 17:21:33.165872694 +0000 UTC m=+231.244064745"
Jul 13 17:21:35.158230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:35.158161    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:35.158230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:35.158210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:35.158609 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:35.158526    2577 scope.go:117] "RemoveContainer" containerID="dbc27295d672f99612ba627162776e9d77008e2ea264a36bc9ce34b17e7e8ff3"
Jul 13 17:21:35.158684 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:35.158665    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vqtlm_openshift-console-operator(352a6492-b04e-4e6a-ae13-d00773349230)\"" pod="openshift-console-operator/console-operator-7866497494-vqtlm" podUID="352a6492-b04e-4e6a-ae13-d00773349230"
Jul 13 17:21:36.552502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:36.552469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:36.552502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:36.552504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:36.552897 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:36.552582    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:36.552897 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:36.552604    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:36.552897 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:36.552641    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:44.55262507 +0000 UTC m=+242.630817098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:36.552897 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:21:36.552655    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls podName:69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:44.552648573 +0000 UTC m=+242.630840601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b99hh" (UID: "69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:40.784337 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:40.784284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:40.786444 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:40.786419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"image-registry-6d88dfb4c9-67r27\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") " pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:40.842280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:40.842257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:40.964046 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:40.963990    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d88dfb4c9-67r27"]
Jul 13 17:21:40.966473 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:40.966440    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57b7329_106b_48d5_8662_4cde8fdc3b9e.slice/crio-3d7ca6d344ba25689bfb576f0f3825f49b5d7e53fb221847c307315c50b53584 WatchSource:0}: Error finding container 3d7ca6d344ba25689bfb576f0f3825f49b5d7e53fb221847c307315c50b53584: Status 404 returned error can't find the container with id 3d7ca6d344ba25689bfb576f0f3825f49b5d7e53fb221847c307315c50b53584
Jul 13 17:21:41.173687 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:41.173617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" event={"ID":"f57b7329-106b-48d5-8662-4cde8fdc3b9e","Type":"ContainerStarted","Data":"0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8"}
Jul 13 17:21:41.173687 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:41.173662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" event={"ID":"f57b7329-106b-48d5-8662-4cde8fdc3b9e","Type":"ContainerStarted","Data":"3d7ca6d344ba25689bfb576f0f3825f49b5d7e53fb221847c307315c50b53584"}
Jul 13 17:21:41.173864 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:41.173754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:21:41.193369 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:41.193323    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" podStartSLOduration=17.193291419 podStartE2EDuration="17.193291419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:41.192526447 +0000 UTC m=+239.270718498" watchObservedRunningTime="2026-07-13 17:21:41.193291419 +0000 UTC m=+239.271483468"
Jul 13 17:21:44.612903 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.612872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:44.613254 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.612909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:44.613375 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.613355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:44.614914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.614895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b99hh\" (UID: \"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7\") " pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:44.790912 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.790887    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4nm5\""
Jul 13 17:21:44.799092 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.799073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b99hh"
Jul 13 17:21:44.922036 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:44.922011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b99hh"]
Jul 13 17:21:44.924820 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:44.924797    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b07c7e_2ddd_4dbb_80e7_f57dcaa2a5b7.slice/crio-3b8404db5849512536aba5ee32a91630e5d2ba764b70ab5caed20d39f75cf89a WatchSource:0}: Error finding container 3b8404db5849512536aba5ee32a91630e5d2ba764b70ab5caed20d39f75cf89a: Status 404 returned error can't find the container with id 3b8404db5849512536aba5ee32a91630e5d2ba764b70ab5caed20d39f75cf89a
Jul 13 17:21:45.187709 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:45.187646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b99hh" event={"ID":"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7","Type":"ContainerStarted","Data":"3b8404db5849512536aba5ee32a91630e5d2ba764b70ab5caed20d39f75cf89a"}
Jul 13 17:21:46.416450 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:46.416427    2577 scope.go:117] "RemoveContainer" containerID="dbc27295d672f99612ba627162776e9d77008e2ea264a36bc9ce34b17e7e8ff3"
Jul 13 17:21:49.203642 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:49.203617    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:21:49.204039 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:49.203729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vqtlm" event={"ID":"352a6492-b04e-4e6a-ae13-d00773349230","Type":"ContainerStarted","Data":"2c4f821318d0d95046327878785dbf8b31157383071f61da01c7507adf33f8a4"}
Jul 13 17:21:49.204153 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:49.204133    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:49.205485 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:49.205452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b99hh" event={"ID":"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7","Type":"ContainerStarted","Data":"9623661614cecd7f6b556182bed8bf57249ac9329ac678a61cb8bacf7d49cb95"}
Jul 13 17:21:49.209174 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:49.209155    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vqtlm"
Jul 13 17:21:49.248044 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:49.245752    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vqtlm" podStartSLOduration=22.072116466 podStartE2EDuration="25.245727574s" totalImagesPullingTime="3.173611108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:49.225519668 +0000 UTC m=+247.303711721" watchObservedRunningTime="2026-07-13 17:21:49.245727574 +0000 UTC m=+247.323919625"
Jul 13 17:21:50.210985 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:50.210950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b99hh" event={"ID":"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7","Type":"ContainerStarted","Data":"afe5b3af6112871ce804d5bef9322c14f47c27934d0ad60954270c7f70aba56c"}
Jul 13 17:21:52.218210 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:52.218186    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b99hh" event={"ID":"69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7","Type":"ContainerStarted","Data":"8952daab194799e548de3997b2ab7f5cec5bd39f228b15c504d95428fa946d93"}
Jul 13 17:21:52.238748 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:52.238709    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b99hh" podStartSLOduration=17.155562956 podStartE2EDuration="24.238696576s" totalImagesPullingTime="7.08313362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:21:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:52.238249736 +0000 UTC m=+250.316441786" watchObservedRunningTime="2026-07-13 17:21:52.238696576 +0000 UTC m=+250.316888625"
Jul 13 17:21:53.176704 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:53.176675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:21:53.178833 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:53.178816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b894166-38b3-4df5-aa2a-34397e83cd0d-metrics-certs\") pod \"network-metrics-daemon-l2jhc\" (UID: \"1b894166-38b3-4df5-aa2a-34397e83cd0d\") " pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:21:53.418667 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:53.418642    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gkqtt\""
Jul 13 17:21:53.426641 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:53.426627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2jhc"
Jul 13 17:21:53.545268 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:53.545234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l2jhc"]
Jul 13 17:21:53.547838 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:53.547809    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b894166_38b3_4df5_aa2a_34397e83cd0d.slice/crio-e3e7fc1e42208807d2690d0a0e98d714aef11022534118ae1f0afc11acc99a1a WatchSource:0}: Error finding container e3e7fc1e42208807d2690d0a0e98d714aef11022534118ae1f0afc11acc99a1a: Status 404 returned error can't find the container with id e3e7fc1e42208807d2690d0a0e98d714aef11022534118ae1f0afc11acc99a1a
Jul 13 17:21:54.226370 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:54.226341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2jhc" event={"ID":"1b894166-38b3-4df5-aa2a-34397e83cd0d","Type":"ContainerStarted","Data":"e3e7fc1e42208807d2690d0a0e98d714aef11022534118ae1f0afc11acc99a1a"}
Jul 13 17:21:55.231480 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.231449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2jhc" event={"ID":"1b894166-38b3-4df5-aa2a-34397e83cd0d","Type":"ContainerStarted","Data":"4212971c5fac63cb72a001252e19dc15aa8360558463b90e80ee25217b4f0f15"}
Jul 13 17:21:55.231912 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.231520    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2jhc" event={"ID":"1b894166-38b3-4df5-aa2a-34397e83cd0d","Type":"ContainerStarted","Data":"57e090a7550dfbc1989fd84e2153a91102e0b958bafded9fb4c05dc5d446c375"}
Jul 13 17:21:55.246987 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.246944    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l2jhc" podStartSLOduration=251.447423382 podStartE2EDuration="4m12.246930625s" totalImagesPullingTime="799.507243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:55.246038269 +0000 UTC m=+253.324230319" watchObservedRunningTime="2026-07-13 17:21:55.246930625 +0000 UTC m=+253.325122668"
Jul 13 17:21:55.823590 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.823555    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d88dfb4c9-67r27"]
Jul 13 17:21:55.922744 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.922708    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56d8f667d-ggddw"]
Jul 13 17:21:55.924742 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.924728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:55.938765 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:55.938733    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56d8f667d-ggddw"]
Jul 13 17:21:56.002213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7818b9cf-311e-43dc-b399-5c7858eefb9d-ca-trust-extracted\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002364 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7818b9cf-311e-43dc-b399-5c7858eefb9d-installation-pull-secrets\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002364 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhw6\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-kube-api-access-mhhw6\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002364 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7818b9cf-311e-43dc-b399-5c7858eefb9d-trusted-ca\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002364 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7818b9cf-311e-43dc-b399-5c7858eefb9d-registry-certificates\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002364 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-bound-sa-token\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002533 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7818b9cf-311e-43dc-b399-5c7858eefb9d-image-registry-private-configuration\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.002533 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.002425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-registry-tls\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103805 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-registry-tls\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103805 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103779    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7818b9cf-311e-43dc-b399-5c7858eefb9d-ca-trust-extracted\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103994 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7818b9cf-311e-43dc-b399-5c7858eefb9d-installation-pull-secrets\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103994 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhw6\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-kube-api-access-mhhw6\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103994 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7818b9cf-311e-43dc-b399-5c7858eefb9d-trusted-ca\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103994 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7818b9cf-311e-43dc-b399-5c7858eefb9d-registry-certificates\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.103994 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.103966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-bound-sa-token\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.104253 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.104042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7818b9cf-311e-43dc-b399-5c7858eefb9d-image-registry-private-configuration\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.104524 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.104499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7818b9cf-311e-43dc-b399-5c7858eefb9d-ca-trust-extracted\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.105007 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.104980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7818b9cf-311e-43dc-b399-5c7858eefb9d-registry-certificates\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.105641 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.105613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7818b9cf-311e-43dc-b399-5c7858eefb9d-trusted-ca\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.106253 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.106231    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-registry-tls\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.106417 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.106400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7818b9cf-311e-43dc-b399-5c7858eefb9d-installation-pull-secrets\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.106665 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.106646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7818b9cf-311e-43dc-b399-5c7858eefb9d-image-registry-private-configuration\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.114109 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.114084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-bound-sa-token\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.114429 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.114414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhw6\" (UniqueName: \"kubernetes.io/projected/7818b9cf-311e-43dc-b399-5c7858eefb9d-kube-api-access-mhhw6\") pod \"image-registry-56d8f667d-ggddw\" (UID: \"7818b9cf-311e-43dc-b399-5c7858eefb9d\") " pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.232783 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.232762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:56.359144 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:56.359078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56d8f667d-ggddw"]
Jul 13 17:21:56.361742 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:21:56.361717    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7818b9cf_311e_43dc_b399_5c7858eefb9d.slice/crio-59fa3ab85d802752c03b6a47d2990c21c3d7c420dc18d6f3903bffc8a9892c8c WatchSource:0}: Error finding container 59fa3ab85d802752c03b6a47d2990c21c3d7c420dc18d6f3903bffc8a9892c8c: Status 404 returned error can't find the container with id 59fa3ab85d802752c03b6a47d2990c21c3d7c420dc18d6f3903bffc8a9892c8c
Jul 13 17:21:57.238914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:57.238880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d8f667d-ggddw" event={"ID":"7818b9cf-311e-43dc-b399-5c7858eefb9d","Type":"ContainerStarted","Data":"f3e57a511dc857d8d42b31f2cb409de0a5f24227c7e404706d54e3eff5e014b3"}
Jul 13 17:21:57.239280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:57.238930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d8f667d-ggddw" event={"ID":"7818b9cf-311e-43dc-b399-5c7858eefb9d","Type":"ContainerStarted","Data":"59fa3ab85d802752c03b6a47d2990c21c3d7c420dc18d6f3903bffc8a9892c8c"}
Jul 13 17:21:57.239280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:57.238991    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:21:57.258411 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:57.258363    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56d8f667d-ggddw" podStartSLOduration=2.258349013 podStartE2EDuration="2.258349013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:57.257420542 +0000 UTC m=+255.335612593" watchObservedRunningTime="2026-07-13 17:21:57.258349013 +0000 UTC m=+255.336541062"
Jul 13 17:21:59.696575 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.696539    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"]
Jul 13 17:21:59.700433 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.700411    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:21:59.702783 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.702763    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 13 17:21:59.702876 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.702800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gqwqc\""
Jul 13 17:21:59.708645 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.708622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"]
Jul 13 17:21:59.829944 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.829920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61c4e2d2-8030-4402-a532-934191c033bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-k8sxq\" (UID: \"61c4e2d2-8030-4402-a532-934191c033bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:21:59.930563 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.930538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61c4e2d2-8030-4402-a532-934191c033bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-k8sxq\" (UID: \"61c4e2d2-8030-4402-a532-934191c033bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:21:59.932738 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:21:59.932719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/61c4e2d2-8030-4402-a532-934191c033bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-k8sxq\" (UID: \"61c4e2d2-8030-4402-a532-934191c033bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:22:00.029607 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:00.029579    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:22:00.152762 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:00.152734    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"]
Jul 13 17:22:00.156044 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:00.156022    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c4e2d2_8030_4402_a532_934191c033bc.slice/crio-968c6acb06d8e5681c909ec8a4be6f4a8b9238b884fc6d5142ce827a16b2fc6c WatchSource:0}: Error finding container 968c6acb06d8e5681c909ec8a4be6f4a8b9238b884fc6d5142ce827a16b2fc6c: Status 404 returned error can't find the container with id 968c6acb06d8e5681c909ec8a4be6f4a8b9238b884fc6d5142ce827a16b2fc6c
Jul 13 17:22:00.249396 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:00.249367    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq" event={"ID":"61c4e2d2-8030-4402-a532-934191c033bc","Type":"ContainerStarted","Data":"968c6acb06d8e5681c909ec8a4be6f4a8b9238b884fc6d5142ce827a16b2fc6c"}
Jul 13 17:22:02.258095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:02.258062    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq" event={"ID":"61c4e2d2-8030-4402-a532-934191c033bc","Type":"ContainerStarted","Data":"a95d340d023f19aeceb4e358c94e1965c1b500fd461d65cc57502fae195280fa"}
Jul 13 17:22:02.258565 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:02.258119    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:22:02.262769 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:02.262744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq"
Jul 13 17:22:02.274520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:02.274480    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-k8sxq" podStartSLOduration=2.069057846 podStartE2EDuration="3.274466353s" totalImagesPullingTime="1.205408507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:02.273425337 +0000 UTC m=+260.351617386" watchObservedRunningTime="2026-07-13 17:22:02.274466353 +0000 UTC m=+260.352658402"
Jul 13 17:22:04.298845 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.298773    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d7f5c8bb-r2vcn"]
Jul 13 17:22:04.300847 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.300826    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.304502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.304479    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 17:22:04.304600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.304515    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 17:22:04.304600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.304517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 17:22:04.305228 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.305213    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 17:22:04.305391 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.305327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 17:22:04.305629 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.305609    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 17:22:04.305711 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.305657    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 17:22:04.305940 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.305920    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5bpwm\""
Jul 13 17:22:04.309680 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.309661    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 17:22:04.312602 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.312581    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d7f5c8bb-r2vcn"]
Jul 13 17:22:04.364313 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-trusted-ca-bundle\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.364394 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-oauth-config\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.364394 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-service-ca\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.364483 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-oauth-serving-cert\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.364520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-serving-cert\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.364561 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-console-config\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.364561 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.364539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtgr\" (UniqueName: \"kubernetes.io/projected/cdf117be-0c39-4a2a-831e-9442905eced5-kube-api-access-jwtgr\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465443 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-console-config\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465538 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwtgr\" (UniqueName: \"kubernetes.io/projected/cdf117be-0c39-4a2a-831e-9442905eced5-kube-api-access-jwtgr\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465538 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-trusted-ca-bundle\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465538 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-oauth-config\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465538 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-service-ca\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465682 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-oauth-serving-cert\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.465682 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.465573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-serving-cert\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.466251 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.466230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-service-ca\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.466379 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.466249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-console-config\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.466379 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.466344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-oauth-serving-cert\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.466543 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.466523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-trusted-ca-bundle\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.468070 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.468051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-oauth-config\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.468133 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.468053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-serving-cert\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.474343 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.474325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwtgr\" (UniqueName: \"kubernetes.io/projected/cdf117be-0c39-4a2a-831e-9442905eced5-kube-api-access-jwtgr\") pod \"console-86d7f5c8bb-r2vcn\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") " pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.610711 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.610661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:04.733442 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:04.733397    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d7f5c8bb-r2vcn"]
Jul 13 17:22:04.736063 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:04.736039    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf117be_0c39_4a2a_831e_9442905eced5.slice/crio-8fa9f71e4936c2e8eb0f0daa8216eb7bf1b955c4fb844f44551776e4557af751 WatchSource:0}: Error finding container 8fa9f71e4936c2e8eb0f0daa8216eb7bf1b955c4fb844f44551776e4557af751: Status 404 returned error can't find the container with id 8fa9f71e4936c2e8eb0f0daa8216eb7bf1b955c4fb844f44551776e4557af751
Jul 13 17:22:05.269806 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:05.269771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d7f5c8bb-r2vcn" event={"ID":"cdf117be-0c39-4a2a-831e-9442905eced5","Type":"ContainerStarted","Data":"8fa9f71e4936c2e8eb0f0daa8216eb7bf1b955c4fb844f44551776e4557af751"}
Jul 13 17:22:05.829951 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:05.829911    2577 patch_prober.go:28] interesting pod/image-registry-6d88dfb4c9-67r27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:22:05.830357 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:05.829975    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:22:07.140943 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.140897    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5s6nz"]
Jul 13 17:22:07.143617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.143598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.146294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.146087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 17:22:07.146476 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.146325    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 17:22:07.147010 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.146971    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 17:22:07.147527 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.147165    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 17:22:07.147527 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.147365    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 17:22:07.147687 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.147585    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 17:22:07.147856 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.147840    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wlrkx\""
Jul 13 17:22:07.289196 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-root\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289401 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdkpr\" (UniqueName: \"kubernetes.io/projected/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-kube-api-access-rdkpr\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289401 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-metrics-client-ca\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289401 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-textfile\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289401 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289620 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-sys\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289620 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-wtmp\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289620 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-tls\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.289620 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.289557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-sys\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-wtmp\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-tls\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-root\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdkpr\" (UniqueName: \"kubernetes.io/projected/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-kube-api-access-rdkpr\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-metrics-client-ca\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-textfile\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.391840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-textfile\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.392779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.392859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-sys\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.392982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-wtmp\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:07.393091    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:07.393162    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-tls podName:02e7a3e1-b38f-4bf3-b988-9e56515c99ef nodeName:}" failed. No retries permitted until 2026-07-13 17:22:07.893144053 +0000 UTC m=+265.971336096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-tls") pod "node-exporter-5s6nz" (UID: "02e7a3e1-b38f-4bf3-b988-9e56515c99ef") : secret "node-exporter-tls" not found
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.393698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-root\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.396234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.394165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-metrics-client-ca\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.398767 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.398741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.404429 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.404408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdkpr\" (UniqueName: \"kubernetes.io/projected/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-kube-api-access-rdkpr\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.897101 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.897079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-tls\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:07.899724 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:07.899698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e7a3e1-b38f-4bf3-b988-9e56515c99ef-node-exporter-tls\") pod \"node-exporter-5s6nz\" (UID: \"02e7a3e1-b38f-4bf3-b988-9e56515c99ef\") " pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:08.056528 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.056493    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5s6nz"
Jul 13 17:22:08.066893 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:08.066867    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e7a3e1_b38f_4bf3_b988_9e56515c99ef.slice/crio-56188933dbea881398d7d46b8c8830c5e31c2ce71f066160faa0d060f23a9a02 WatchSource:0}: Error finding container 56188933dbea881398d7d46b8c8830c5e31c2ce71f066160faa0d060f23a9a02: Status 404 returned error can't find the container with id 56188933dbea881398d7d46b8c8830c5e31c2ce71f066160faa0d060f23a9a02
Jul 13 17:22:08.196423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.196361    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:22:08.199099 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.199083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.201751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.201728    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 17:22:08.201858 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.201788    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nc9tw\""
Jul 13 17:22:08.201858 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.201789    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 17:22:08.202217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202201    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 17:22:08.202343 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 17:22:08.202343 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202286    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 17:22:08.202343 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 17:22:08.202538 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202525    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 17:22:08.202794 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202777    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 17:22:08.202869 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.202811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 17:22:08.218740 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.218720    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:22:08.281375 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.281346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5s6nz" event={"ID":"02e7a3e1-b38f-4bf3-b988-9e56515c99ef","Type":"ContainerStarted","Data":"56188933dbea881398d7d46b8c8830c5e31c2ce71f066160faa0d060f23a9a02"}
Jul 13 17:22:08.282845 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.282811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d7f5c8bb-r2vcn" event={"ID":"cdf117be-0c39-4a2a-831e-9442905eced5","Type":"ContainerStarted","Data":"6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1"}
Jul 13 17:22:08.300721 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/12249230-7332-4472-9f7e-a3086bb296ed-config-out\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.300819 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/12249230-7332-4472-9f7e-a3086bb296ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.300864 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-web-config\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.300901 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12249230-7332-4472-9f7e-a3086bb296ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.300901 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/12249230-7332-4472-9f7e-a3086bb296ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.300958 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12249230-7332-4472-9f7e-a3086bb296ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.300990 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.301038 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.300988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.301038 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.301025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpsz\" (UniqueName: \"kubernetes.io/projected/12249230-7332-4472-9f7e-a3086bb296ed-kube-api-access-pmpsz\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.301134 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.301045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.301134 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.301072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.301134 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.301097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.301134 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.301116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.306413 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.306377    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d7f5c8bb-r2vcn" podStartSLOduration=1.155744348 podStartE2EDuration="4.306364408s" totalImagesPullingTime="3.15062006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:08.305641583 +0000 UTC m=+266.383833634" watchObservedRunningTime="2026-07-13 17:22:08.306364408 +0000 UTC m=+266.384556458"
Jul 13 17:22:08.401944 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.401915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402030 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.401952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402030 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.401970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/12249230-7332-4472-9f7e-a3086bb296ed-config-out\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402152 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/12249230-7332-4472-9f7e-a3086bb296ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402152 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-web-config\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402152 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12249230-7332-4472-9f7e-a3086bb296ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402152 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/12249230-7332-4472-9f7e-a3086bb296ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12249230-7332-4472-9f7e-a3086bb296ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpsz\" (UniqueName: \"kubernetes.io/projected/12249230-7332-4472-9f7e-a3086bb296ed-kube-api-access-pmpsz\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402631 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.402387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.402631 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:08.402507    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 13 17:22:08.402631 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:08.402565    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-main-tls podName:12249230-7332-4472-9f7e-a3086bb296ed nodeName:}" failed. No retries permitted until 2026-07-13 17:22:08.902547697 +0000 UTC m=+266.980739724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "12249230-7332-4472-9f7e-a3086bb296ed") : secret "alertmanager-main-tls" not found
Jul 13 17:22:08.403188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.403165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12249230-7332-4472-9f7e-a3086bb296ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.403975 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.403946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12249230-7332-4472-9f7e-a3086bb296ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.404913 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.404887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/12249230-7332-4472-9f7e-a3086bb296ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.406387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.405550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-web-config\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.406387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.405666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.406387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.405884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.406387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.405919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.406625 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.406508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.406760 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.406732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/12249230-7332-4472-9f7e-a3086bb296ed-config-out\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.407149 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.407118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.407751 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.407731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/12249230-7332-4472-9f7e-a3086bb296ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.410615 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.410587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpsz\" (UniqueName: \"kubernetes.io/projected/12249230-7332-4472-9f7e-a3086bb296ed-kube-api-access-pmpsz\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.908359 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.908316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:08.911481 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:08.911450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/12249230-7332-4472-9f7e-a3086bb296ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"12249230-7332-4472-9f7e-a3086bb296ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:09.108188 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.108161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 17:22:09.115455 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.115434    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-647d4c7849-kqpbm"]
Jul 13 17:22:09.118495 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.118298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.120882 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.120858    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 17:22:09.121615 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.121592    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-auppgk4l60fjn\""
Jul 13 17:22:09.121615 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.121602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 17:22:09.121821 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.121802    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 17:22:09.121821 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.121810    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 17:22:09.122125 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.122105    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6t4sm\""
Jul 13 17:22:09.122232 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.122132    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 17:22:09.133048 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.133014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-647d4c7849-kqpbm"]
Jul 13 17:22:09.210186 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgpc\" (UniqueName: \"kubernetes.io/projected/606e3951-c87a-4633-87c9-cde3750d21e0-kube-api-access-ktgpc\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-grpc-tls\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-tls\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/606e3951-c87a-4633-87c9-cde3750d21e0-metrics-client-ca\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.210619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.210517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.254482 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.254403    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 17:22:09.256597 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:09.256571    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12249230_7332_4472_9f7e_a3086bb296ed.slice/crio-a726b4f3b261b2d7dc2903e32c50700ad28374c7e14ca3efd9fc04ec6e320ea5 WatchSource:0}: Error finding container a726b4f3b261b2d7dc2903e32c50700ad28374c7e14ca3efd9fc04ec6e320ea5: Status 404 returned error can't find the container with id a726b4f3b261b2d7dc2903e32c50700ad28374c7e14ca3efd9fc04ec6e320ea5
Jul 13 17:22:09.291423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.291394    2577 generic.go:356] "Generic (PLEG): container finished" podID="02e7a3e1-b38f-4bf3-b988-9e56515c99ef" containerID="3e8dd4df838f636d04a370b7cefeda0b95f1bd4fb17c4fc952ffeae50f3179b3" exitCode=0
Jul 13 17:22:09.291520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.291476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5s6nz" event={"ID":"02e7a3e1-b38f-4bf3-b988-9e56515c99ef","Type":"ContainerDied","Data":"3e8dd4df838f636d04a370b7cefeda0b95f1bd4fb17c4fc952ffeae50f3179b3"}
Jul 13 17:22:09.292622 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.292600    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"a726b4f3b261b2d7dc2903e32c50700ad28374c7e14ca3efd9fc04ec6e320ea5"}
Jul 13 17:22:09.310949 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.310924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311053 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.310965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgpc\" (UniqueName: \"kubernetes.io/projected/606e3951-c87a-4633-87c9-cde3750d21e0-kube-api-access-ktgpc\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311053 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.310987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311053 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.311017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311053 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.311040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-grpc-tls\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311276 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.311072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-tls\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311276 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.311115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/606e3951-c87a-4633-87c9-cde3750d21e0-metrics-client-ca\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311276 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.311150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.311978 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.311917    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/606e3951-c87a-4633-87c9-cde3750d21e0-metrics-client-ca\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.313748 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.313723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-grpc-tls\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.313954 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.313929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.314055 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.314033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.314105 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.314091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.314273 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.314251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.314326 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.314262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/606e3951-c87a-4633-87c9-cde3750d21e0-secret-thanos-querier-tls\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.318629 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.318613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgpc\" (UniqueName: \"kubernetes.io/projected/606e3951-c87a-4633-87c9-cde3750d21e0-kube-api-access-ktgpc\") pod \"thanos-querier-647d4c7849-kqpbm\" (UID: \"606e3951-c87a-4633-87c9-cde3750d21e0\") " pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.428906 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.428880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:09.562661 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:09.562639    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-647d4c7849-kqpbm"]
Jul 13 17:22:09.565064 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:09.565037    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606e3951_c87a_4633_87c9_cde3750d21e0.slice/crio-6ed2e9dbeb2ee4957633e19ea2b65070adb74be6ecc10b7cbabaeb701652f615 WatchSource:0}: Error finding container 6ed2e9dbeb2ee4957633e19ea2b65070adb74be6ecc10b7cbabaeb701652f615: Status 404 returned error can't find the container with id 6ed2e9dbeb2ee4957633e19ea2b65070adb74be6ecc10b7cbabaeb701652f615
Jul 13 17:22:10.300781 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:10.300741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5s6nz" event={"ID":"02e7a3e1-b38f-4bf3-b988-9e56515c99ef","Type":"ContainerStarted","Data":"ca4fa37c88e7a7742b30552864accf451b19d0fcff2e429c4f38b40a1bab0591"}
Jul 13 17:22:10.301172 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:10.300817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5s6nz" event={"ID":"02e7a3e1-b38f-4bf3-b988-9e56515c99ef","Type":"ContainerStarted","Data":"72d7014ba4b8435c13ba8cc9c317e12f76a94fa2c76d5bbdce09f2c264166c54"}
Jul 13 17:22:10.302254 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:10.302226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"6ed2e9dbeb2ee4957633e19ea2b65070adb74be6ecc10b7cbabaeb701652f615"}
Jul 13 17:22:10.322448 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:10.322323    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5s6nz" podStartSLOduration=2.316124056 podStartE2EDuration="3.322292449s" totalImagesPullingTime="937.65608ms" totalInitContainerRuntime="68.512313ms" isStatefulPod=true podCreationTimestamp="2026-07-13 17:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:10.32022099 +0000 UTC m=+268.398413053" watchObservedRunningTime="2026-07-13 17:22:10.322292449 +0000 UTC m=+268.400484510"
Jul 13 17:22:11.307820 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:11.307782    2577 generic.go:356] "Generic (PLEG): container finished" podID="12249230-7332-4472-9f7e-a3086bb296ed" containerID="05a2260d6e7198ef0529fc2746325b83209147a30f1519724a880706223d4415" exitCode=0
Jul 13 17:22:11.309132 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:11.309105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerDied","Data":"05a2260d6e7198ef0529fc2746325b83209147a30f1519724a880706223d4415"}
Jul 13 17:22:13.316686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.316659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"dfa99943dff88f5f033bef76e986133ca074f07b696f565a1b861f60b4ef8745"}
Jul 13 17:22:13.316974 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.316741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"f88e8026ddd05d3cde0621322d4c41f2d8465df969fc3fd73a07906238640352"}
Jul 13 17:22:13.316974 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.316791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"2dc008e27a089303bea2c96fe71a1b061cf75bc3aabd876e9e1be53465ab4c93"}
Jul 13 17:22:13.339043 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.339018    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:22:13.342129 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.342110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.344774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.344753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 17:22:13.344856 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.344753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 17:22:13.345011 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.344992    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 17:22:13.345096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 17:22:13.345355 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345335    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 17:22:13.345355 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345345    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 17:22:13.345607 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345591    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 17:22:13.345675 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 17:22:13.345675 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345637    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 17:22:13.345774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 17:22:13.345857 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.345839    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-644c62d18mp9n\""
Jul 13 17:22:13.346096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.346080    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 17:22:13.346242 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.346228    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 17:22:13.346334 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.346240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w4kcl\""
Jul 13 17:22:13.352206 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.351893    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 17:22:13.352206 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.352080    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 17:22:13.354418 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.354400    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 17:22:13.360420 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.360398    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:22:13.450224 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450352 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d581bf-c0d7-436c-af78-85bd6005719c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450352 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450352 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-config\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5vg\" (UniqueName: \"kubernetes.io/projected/f1d581bf-c0d7-436c-af78-85bd6005719c-kube-api-access-5w5vg\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450948 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450948 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450948 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450948 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450948 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d581bf-c0d7-436c-af78-85bd6005719c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.450948 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.450877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551808 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551779    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-config\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551808 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5vg\" (UniqueName: \"kubernetes.io/projected/f1d581bf-c0d7-436c-af78-85bd6005719c-kube-api-access-5w5vg\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.551977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.551973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d581bf-c0d7-436c-af78-85bd6005719c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552292 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552745 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d581bf-c0d7-436c-af78-85bd6005719c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552745 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552745 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552745 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.552929 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.552870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.556870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.553072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.556870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.553611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.556870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.553873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.556870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.553921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.556870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.556613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.557212 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.557195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1d581bf-c0d7-436c-af78-85bd6005719c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.557451 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.557411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.557621 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.557578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1d581bf-c0d7-436c-af78-85bd6005719c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.557881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.557831    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.557964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.557857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-config\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.558227 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.558194    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.558583 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.558519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.558666 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.558642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.558873 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.558839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.559139 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.559116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.559867 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.559844    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1d581bf-c0d7-436c-af78-85bd6005719c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.560451 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.560429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1d581bf-c0d7-436c-af78-85bd6005719c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.561387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.561366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5vg\" (UniqueName: \"kubernetes.io/projected/f1d581bf-c0d7-436c-af78-85bd6005719c-kube-api-access-5w5vg\") pod \"prometheus-k8s-0\" (UID: \"f1d581bf-c0d7-436c-af78-85bd6005719c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.662371 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.662273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:13.826342 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:13.826316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 17:22:13.833912 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:13.833871    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d581bf_c0d7_436c_af78_85bd6005719c.slice/crio-d0497d1c92d3c5a90840087825537dec7f3ce64a9717a0f2e2792dd72322b755 WatchSource:0}: Error finding container d0497d1c92d3c5a90840087825537dec7f3ce64a9717a0f2e2792dd72322b755: Status 404 returned error can't find the container with id d0497d1c92d3c5a90840087825537dec7f3ce64a9717a0f2e2792dd72322b755
Jul 13 17:22:14.323172 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.323140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"0a8ec4468f75bb89839e1593dfc9f2429452a23777f876f067c07b20c978320c"}
Jul 13 17:22:14.323531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.323216    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"1e13e00684b78eee392f583dd3cc3f5d093598a9ecaa63fea583c4bbca05a53d"}
Jul 13 17:22:14.323531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.323260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"bfbc9b3c5ce36ea611376d06525198db26fd184a42f4fcbe2c10511f37014a92"}
Jul 13 17:22:14.323531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.323294    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"66b1bc8742fdbfc71659d7e79b926c31021e18300ba745af471209aada39e694"}
Jul 13 17:22:14.323531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.323353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"920436f109c1307945b3186ebc1d9c5d4f544841b975fc13a776794e7382dacf"}
Jul 13 17:22:14.323531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.323394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"12249230-7332-4472-9f7e-a3086bb296ed","Type":"ContainerStarted","Data":"a3f314e2526cc4653447d7b0ee8a20dbc799689909ca37b9eef3d3b3c321ce7d"}
Jul 13 17:22:14.324657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.324635    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1d581bf-c0d7-436c-af78-85bd6005719c" containerID="3e1adad30dc18e3d06ec858dc24860c87ea40fcfb1653a581b2a781f11dcab14" exitCode=0
Jul 13 17:22:14.324765 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.324704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerDied","Data":"3e1adad30dc18e3d06ec858dc24860c87ea40fcfb1653a581b2a781f11dcab14"}
Jul 13 17:22:14.324765 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.324755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"d0497d1c92d3c5a90840087825537dec7f3ce64a9717a0f2e2792dd72322b755"}
Jul 13 17:22:14.327543 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.327524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"45682516b6861c7d0881a050040c2fd913594b17a24ff32947137acbed2422dc"}
Jul 13 17:22:14.327617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.327574    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"604e1788ed52ed64efbb3e06081ff0410b7dd380b37d1ee2f5835be62eb94395"}
Jul 13 17:22:14.327617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.327600    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" event={"ID":"606e3951-c87a-4633-87c9-cde3750d21e0","Type":"ContainerStarted","Data":"23727476737ad3535add810d59d7e30f53fdf27faba2ab80cb67574a0eb04b6d"}
Jul 13 17:22:14.327738 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.327717    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:14.349631 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.349560    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.62468679 podStartE2EDuration="6.34954676s" totalImagesPullingTime="3.702146465s" totalInitContainerRuntime="22.713505ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:22:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:14.348001926 +0000 UTC m=+272.426193976" watchObservedRunningTime="2026-07-13 17:22:14.34954676 +0000 UTC m=+272.427738788"
Jul 13 17:22:14.370763 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.370725    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm" podStartSLOduration=1.793092847 podStartE2EDuration="5.370711522s" totalImagesPullingTime="3.577618675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:22:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:14.369439744 +0000 UTC m=+272.447631819" watchObservedRunningTime="2026-07-13 17:22:14.370711522 +0000 UTC m=+272.448903600"
Jul 13 17:22:14.610912 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.610843    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:14.610912 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.610906    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:14.611940 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.611916    2577 patch_prober.go:28] interesting pod/console-86d7f5c8bb-r2vcn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Jul 13 17:22:14.612056 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:14.611965    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86d7f5c8bb-r2vcn" podUID="cdf117be-0c39-4a2a-831e-9442905eced5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Jul 13 17:22:15.827665 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:15.827633    2577 patch_prober.go:28] interesting pod/image-registry-6d88dfb4c9-67r27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:22:15.828019 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:15.827683    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:22:16.237317 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:16.237221    2577 patch_prober.go:28] interesting pod/image-registry-56d8f667d-ggddw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:22:16.237317 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:16.237271    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d8f667d-ggddw" podUID="7818b9cf-311e-43dc-b399-5c7858eefb9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:22:18.245664 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:18.245632    2577 patch_prober.go:28] interesting pod/image-registry-56d8f667d-ggddw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:22:18.246039 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:18.245688    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d8f667d-ggddw" podUID="7818b9cf-311e-43dc-b399-5c7858eefb9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:22:18.347741 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:18.347624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"2a5ec2f5aaf51aaa1defdf12f691281698552f506861df33d6df5d7aae4dd7ea"}
Jul 13 17:22:19.355869 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:19.355825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"03b7e37e2f90ecdc7e2ee73c57416c2f02ec6f35d025b5fbcce32a7588a5d45c"}
Jul 13 17:22:19.356280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:19.355973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"68ec15c32a9830a886cf517be157d99c1d9da4ed167e628a6f0655d7be4e8e94"}
Jul 13 17:22:19.356280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:19.356032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"1506fed902c8b84ca2ea20524ae063d54c7861c0565980813d6eeb13424e3913"}
Jul 13 17:22:19.356280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:19.356084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"49087c25457a886a92d93c974a92da13d50dead00a309aac8871e1af127d2e0d"}
Jul 13 17:22:19.356280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:19.356134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1d581bf-c0d7-436c-af78-85bd6005719c","Type":"ContainerStarted","Data":"ab4f4b37fab8b9f6d179011b6088ff379bc8f68adcfeee7085dd76d792dd3f57"}
Jul 13 17:22:19.393017 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:19.392964    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.439691131 podStartE2EDuration="6.392943733s" totalImagesPullingTime="3.931047993s" totalInitContainerRuntime="22.204609ms" isStatefulPod=false podCreationTimestamp="2026-07-13 17:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:19.390715355 +0000 UTC m=+277.468907404" watchObservedRunningTime="2026-07-13 17:22:19.392943733 +0000 UTC m=+277.471135782"
Jul 13 17:22:20.338548 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:20.338519    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-647d4c7849-kqpbm"
Jul 13 17:22:20.848246 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:20.848211    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerName="registry" containerID="cri-o://0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8" gracePeriod=30
Jul 13 17:22:21.086663 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.086643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:22:21.215735 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215674    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-certificates\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.215735 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215711    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f57b7329-106b-48d5-8662-4cde8fdc3b9e-ca-trust-extracted\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.215735 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215734    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mxdd\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-kube-api-access-4mxdd\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.215966 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215771    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.215966 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-installation-pull-secrets\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.215966 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-image-registry-private-configuration\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.216117 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.215975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-bound-sa-token\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.216117 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.216032    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-trusted-ca\") pod \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\" (UID: \"f57b7329-106b-48d5-8662-4cde8fdc3b9e\") "
Jul 13 17:22:21.216117 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.216099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:21.216566 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.216527    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-certificates\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.216661 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.216565    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:21.218186 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.218157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:21.218479 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.218457    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:21.218479 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.218466    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-kube-api-access-4mxdd" (OuterVolumeSpecName: "kube-api-access-4mxdd") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "kube-api-access-4mxdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:21.218614 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.218495    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:22:21.218614 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.218543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:22:21.226679 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.226656    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f57b7329-106b-48d5-8662-4cde8fdc3b9e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f57b7329-106b-48d5-8662-4cde8fdc3b9e" (UID: "f57b7329-106b-48d5-8662-4cde8fdc3b9e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:22:21.317828 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317798    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f57b7329-106b-48d5-8662-4cde8fdc3b9e-ca-trust-extracted\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.317828 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317827    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mxdd\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-kube-api-access-4mxdd\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.317828 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317836    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-registry-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.317977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317846    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-installation-pull-secrets\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.317977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317855    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f57b7329-106b-48d5-8662-4cde8fdc3b9e-image-registry-private-configuration\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.317977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317864    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f57b7329-106b-48d5-8662-4cde8fdc3b9e-bound-sa-token\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.317977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.317872    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f57b7329-106b-48d5-8662-4cde8fdc3b9e-trusted-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:21.367636 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.367608    2577 generic.go:356] "Generic (PLEG): container finished" podID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerID="0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8" exitCode=0
Jul 13 17:22:21.367720 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.367649    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27"
Jul 13 17:22:21.367720 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.367689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" event={"ID":"f57b7329-106b-48d5-8662-4cde8fdc3b9e","Type":"ContainerDied","Data":"0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8"}
Jul 13 17:22:21.367789 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.367735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d88dfb4c9-67r27" event={"ID":"f57b7329-106b-48d5-8662-4cde8fdc3b9e","Type":"ContainerDied","Data":"3d7ca6d344ba25689bfb576f0f3825f49b5d7e53fb221847c307315c50b53584"}
Jul 13 17:22:21.367789 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.367756    2577 scope.go:117] "RemoveContainer" containerID="0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8"
Jul 13 17:22:21.375520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.375505    2577 scope.go:117] "RemoveContainer" containerID="0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8"
Jul 13 17:22:21.375761 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:21.375741    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8\": container with ID starting with 0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8 not found: ID does not exist" containerID="0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8"
Jul 13 17:22:21.375801 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.375768    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8"} err="failed to get container status \"0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8\": rpc error: code = NotFound desc = could not find container \"0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8\": container with ID starting with 0b633b3b005f35b79a0190370523ab6db77c8faf7dbed0ad4f017698a6451ec8 not found: ID does not exist"
Jul 13 17:22:21.387394 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.387375    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d88dfb4c9-67r27"]
Jul 13 17:22:21.391461 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:21.391436    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d88dfb4c9-67r27"]
Jul 13 17:22:22.421083 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:22.421051    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" path="/var/lib/kubelet/pods/f57b7329-106b-48d5-8662-4cde8fdc3b9e/volumes"
Jul 13 17:22:23.663010 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:23.662978    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:22:24.615276 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:24.615250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:24.619055 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:24.619029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:24.964841 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:24.964763    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hjl7l" podUID="fcc777f4-36c8-4b05-9af6-233aa44610f7"
Jul 13 17:22:25.384260 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:25.384232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:22:26.237517 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:26.237486    2577 patch_prober.go:28] interesting pod/image-registry-56d8f667d-ggddw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:22:26.237867 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:26.237531    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d8f667d-ggddw" podUID="7818b9cf-311e-43dc-b399-5c7858eefb9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:22:28.246521 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:28.246495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56d8f667d-ggddw"
Jul 13 17:22:28.372618 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:28.372584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:22:28.374880 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:28.374856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fcc777f4-36c8-4b05-9af6-233aa44610f7-metrics-tls\") pod \"dns-default-hjl7l\" (UID: \"fcc777f4-36c8-4b05-9af6-233aa44610f7\") " pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:22:28.387390 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:28.387369    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7qlt\""
Jul 13 17:22:28.398257 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:28.398230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:22:28.531386 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:28.531330    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hjl7l"]
Jul 13 17:22:28.534200 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:22:28.534175    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc777f4_36c8_4b05_9af6_233aa44610f7.slice/crio-82727afa1cf78853f0656bea8326de01bf306899d4e04fdf7d04263c8749822a WatchSource:0}: Error finding container 82727afa1cf78853f0656bea8326de01bf306899d4e04fdf7d04263c8749822a: Status 404 returned error can't find the container with id 82727afa1cf78853f0656bea8326de01bf306899d4e04fdf7d04263c8749822a
Jul 13 17:22:29.404595 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:29.404556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hjl7l" event={"ID":"fcc777f4-36c8-4b05-9af6-233aa44610f7","Type":"ContainerStarted","Data":"82727afa1cf78853f0656bea8326de01bf306899d4e04fdf7d04263c8749822a"}
Jul 13 17:22:30.410737 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:30.410705    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hjl7l" event={"ID":"fcc777f4-36c8-4b05-9af6-233aa44610f7","Type":"ContainerStarted","Data":"611e4ace40f34614c7f9c1188d0c2bcfb5af26b1dcc38158ac082d3aa9c97e44"}
Jul 13 17:22:30.411066 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:30.410783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hjl7l" event={"ID":"fcc777f4-36c8-4b05-9af6-233aa44610f7","Type":"ContainerStarted","Data":"0d33d0e91437628dd17ae241dbcaf55739b675e75c4babb5f03210756823cd19"}
Jul 13 17:22:30.411066 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:30.410864    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:22:30.427918 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:30.427835    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hjl7l" podStartSLOduration=250.79740306 podStartE2EDuration="4m12.427820783s" totalImagesPullingTime="1.630417723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:30.427109238 +0000 UTC m=+288.505301318" watchObservedRunningTime="2026-07-13 17:22:30.427820783 +0000 UTC m=+288.506012832"
Jul 13 17:22:32.943685 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:32.943658    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d7f5c8bb-r2vcn"]
Jul 13 17:22:34.428466 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:34.428436    2577 generic.go:356] "Generic (PLEG): container finished" podID="bc10f3b4-76cf-4772-95bc-58415046c84b" containerID="00ccb361cb07168aedc422d55505fb94c8e02d0abff82e96d2e6d58d32299670" exitCode=0
Jul 13 17:22:34.428787 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:34.428509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp" event={"ID":"bc10f3b4-76cf-4772-95bc-58415046c84b","Type":"ContainerDied","Data":"00ccb361cb07168aedc422d55505fb94c8e02d0abff82e96d2e6d58d32299670"}
Jul 13 17:22:34.428826 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:34.428818    2577 scope.go:117] "RemoveContainer" containerID="00ccb361cb07168aedc422d55505fb94c8e02d0abff82e96d2e6d58d32299670"
Jul 13 17:22:35.433992 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:35.433958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kwpqp" event={"ID":"bc10f3b4-76cf-4772-95bc-58415046c84b","Type":"ContainerStarted","Data":"25d0749c8bf42469ce708c7a86207431a3930b34d5906b1238c0cc764939ca28"}
Jul 13 17:22:40.420767 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:40.420740    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hjl7l"
Jul 13 17:22:42.273400 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:42.273379    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:22:42.275027 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:42.275010    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:22:42.278817 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:42.278798    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:22:42.279999 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:42.279979    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:22:42.284885 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:42.284866    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 17:22:44.469894 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:44.469816    2577 generic.go:356] "Generic (PLEG): container finished" podID="658019d0-2699-4f9a-8477-a97148d0e9e0" containerID="3450279bcecd13f1faef9501b38c3a8da4d3de59b25784932a9648b0893b6e13" exitCode=0
Jul 13 17:22:44.469894 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:44.469864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft" event={"ID":"658019d0-2699-4f9a-8477-a97148d0e9e0","Type":"ContainerDied","Data":"3450279bcecd13f1faef9501b38c3a8da4d3de59b25784932a9648b0893b6e13"}
Jul 13 17:22:44.470293 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:44.470158    2577 scope.go:117] "RemoveContainer" containerID="3450279bcecd13f1faef9501b38c3a8da4d3de59b25784932a9648b0893b6e13"
Jul 13 17:22:45.476126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:45.476093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgqft" event={"ID":"658019d0-2699-4f9a-8477-a97148d0e9e0","Type":"ContainerStarted","Data":"ad66aa885d0a9ea541aa4bc94f468988b0f83f36b25bf4ce5e47fb515a2bf411"}
Jul 13 17:22:57.964447 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:57.964379    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d7f5c8bb-r2vcn" podUID="cdf117be-0c39-4a2a-831e-9442905eced5" containerName="console" containerID="cri-o://6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1" gracePeriod=15
Jul 13 17:22:58.209252 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.209229    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:58.296678 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296654    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-oauth-serving-cert\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.296800 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-service-ca\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.296800 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296736    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-oauth-config\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.296800 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwtgr\" (UniqueName: \"kubernetes.io/projected/cdf117be-0c39-4a2a-831e-9442905eced5-kube-api-access-jwtgr\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.296800 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296772    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-console-config\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.296978 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296805    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-serving-cert\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.296978 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.296857    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-trusted-ca-bundle\") pod \"cdf117be-0c39-4a2a-831e-9442905eced5\" (UID: \"cdf117be-0c39-4a2a-831e-9442905eced5\") "
Jul 13 17:22:58.297191 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.297161    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:58.297316 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.297284    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-console-config" (OuterVolumeSpecName: "console-config") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:58.297378 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.297324    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:58.297415 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.297389    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:58.298996 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.298975    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:22:58.299339 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.299296    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf117be-0c39-4a2a-831e-9442905eced5-kube-api-access-jwtgr" (OuterVolumeSpecName: "kube-api-access-jwtgr") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "kube-api-access-jwtgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:58.299403 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.299372    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdf117be-0c39-4a2a-831e-9442905eced5" (UID: "cdf117be-0c39-4a2a-831e-9442905eced5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:22:58.397824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397803    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-serving-cert\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.397824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397823    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-trusted-ca-bundle\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.397931 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397833    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-oauth-serving-cert\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.397931 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397842    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.397931 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397851    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdf117be-0c39-4a2a-831e-9442905eced5-console-oauth-config\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.397931 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397859    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwtgr\" (UniqueName: \"kubernetes.io/projected/cdf117be-0c39-4a2a-831e-9442905eced5-kube-api-access-jwtgr\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.397931 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.397868    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdf117be-0c39-4a2a-831e-9442905eced5-console-config\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:22:58.528603 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.528577    2577 generic.go:356] "Generic (PLEG): container finished" podID="cdf117be-0c39-4a2a-831e-9442905eced5" containerID="6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1" exitCode=0
Jul 13 17:22:58.528686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.528623    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d7f5c8bb-r2vcn"
Jul 13 17:22:58.528686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.528640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d7f5c8bb-r2vcn" event={"ID":"cdf117be-0c39-4a2a-831e-9442905eced5","Type":"ContainerDied","Data":"6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1"}
Jul 13 17:22:58.528686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.528676    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d7f5c8bb-r2vcn" event={"ID":"cdf117be-0c39-4a2a-831e-9442905eced5","Type":"ContainerDied","Data":"8fa9f71e4936c2e8eb0f0daa8216eb7bf1b955c4fb844f44551776e4557af751"}
Jul 13 17:22:58.528780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.528695    2577 scope.go:117] "RemoveContainer" containerID="6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1"
Jul 13 17:22:58.536635 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.536620    2577 scope.go:117] "RemoveContainer" containerID="6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1"
Jul 13 17:22:58.536877 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:22:58.536861    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1\": container with ID starting with 6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1 not found: ID does not exist" containerID="6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1"
Jul 13 17:22:58.536921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.536883    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1"} err="failed to get container status \"6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1\": rpc error: code = NotFound desc = could not find container \"6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1\": container with ID starting with 6a19012c89bc16f53eeddaee1f4cdf7142794804d871f8a8a0aa0f81d4f98ad1 not found: ID does not exist"
Jul 13 17:22:58.544988 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.544968    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d7f5c8bb-r2vcn"]
Jul 13 17:22:58.549841 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:22:58.549791    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d7f5c8bb-r2vcn"]
Jul 13 17:23:00.425200 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:00.422560    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf117be-0c39-4a2a-831e-9442905eced5" path="/var/lib/kubelet/pods/cdf117be-0c39-4a2a-831e-9442905eced5/volumes"
Jul 13 17:23:13.663240 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:13.663206    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:23:13.682204 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:13.682182    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:23:14.614493 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:14.614464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 17:23:31.432008 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.431968    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c57f4b964-xgf6l"]
Jul 13 17:23:31.432407 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.432295    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf117be-0c39-4a2a-831e-9442905eced5" containerName="console"
Jul 13 17:23:31.432407 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.432331    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf117be-0c39-4a2a-831e-9442905eced5" containerName="console"
Jul 13 17:23:31.432407 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.432343    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerName="registry"
Jul 13 17:23:31.432407 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.432349    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerName="registry"
Jul 13 17:23:31.432407 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.432408    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f57b7329-106b-48d5-8662-4cde8fdc3b9e" containerName="registry"
Jul 13 17:23:31.432578 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.432443    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdf117be-0c39-4a2a-831e-9442905eced5" containerName="console"
Jul 13 17:23:31.435714 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.435697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.437926 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.437901    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 13 17:23:31.438382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.438358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 13 17:23:31.438560 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.438465    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 13 17:23:31.438682 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.438659    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 13 17:23:31.438798 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.438777    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4ttpj\""
Jul 13 17:23:31.438881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.438778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 13 17:23:31.446130 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.446103    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 13 17:23:31.448749 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.448730    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c57f4b964-xgf6l"]
Jul 13 17:23:31.467794 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-secret-telemeter-client\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.467883 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-federate-client-tls\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.467883 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79v7\" (UniqueName: \"kubernetes.io/projected/63d1cba0-90a2-4e0f-b812-49b0d995616c-kube-api-access-m79v7\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.467955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-telemeter-client-tls\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.467955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.467955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.468043 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.467957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-metrics-client-ca\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.468043 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.468025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-serving-certs-ca-bundle\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568676 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-serving-certs-ca-bundle\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-secret-telemeter-client\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-federate-client-tls\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79v7\" (UniqueName: \"kubernetes.io/projected/63d1cba0-90a2-4e0f-b812-49b0d995616c-kube-api-access-m79v7\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568885 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-telemeter-client-tls\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568885 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.568990 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.568965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.569058 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.569020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-metrics-client-ca\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.569498 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.569476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-serving-certs-ca-bundle\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.569810 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.569788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.569891 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.569789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d1cba0-90a2-4e0f-b812-49b0d995616c-metrics-client-ca\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.571275 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.571253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-federate-client-tls\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.571376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.571358    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.571647 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.571627    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-secret-telemeter-client\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.571765 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.571752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/63d1cba0-90a2-4e0f-b812-49b0d995616c-telemeter-client-tls\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.576716 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.576694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m79v7\" (UniqueName: \"kubernetes.io/projected/63d1cba0-90a2-4e0f-b812-49b0d995616c-kube-api-access-m79v7\") pod \"telemeter-client-c57f4b964-xgf6l\" (UID: \"63d1cba0-90a2-4e0f-b812-49b0d995616c\") " pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.750406 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.750386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l"
Jul 13 17:23:31.881109 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.881084    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c57f4b964-xgf6l"]
Jul 13 17:23:31.886252 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:31.886234    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:23:32.670886 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:32.670842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l" event={"ID":"63d1cba0-90a2-4e0f-b812-49b0d995616c","Type":"ContainerStarted","Data":"3fbba22d6deee01f98bb5bf38ad6d084cbcb8402fa422b4f3fa3ca18f686d5c1"}
Jul 13 17:23:34.680995 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:34.680958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l" event={"ID":"63d1cba0-90a2-4e0f-b812-49b0d995616c","Type":"ContainerStarted","Data":"4b2672e88b719dde97b52262a8de331960db868a751fb9c4029ce8ca71c51a49"}
Jul 13 17:23:34.681394 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:34.681020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l" event={"ID":"63d1cba0-90a2-4e0f-b812-49b0d995616c","Type":"ContainerStarted","Data":"6d4766bbc38b96f0999abf1e100651328fd32d0db4c4c091b5b5046cdd09d565"}
Jul 13 17:23:34.681394 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:34.681049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l" event={"ID":"63d1cba0-90a2-4e0f-b812-49b0d995616c","Type":"ContainerStarted","Data":"bd6a2209dc31cba731f34a7ac3fe06790ebdcc7ae2e782ada4518813207c58d9"}
Jul 13 17:23:34.713768 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:23:34.713726    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c57f4b964-xgf6l" podStartSLOduration=1.363754192 podStartE2EDuration="3.713708393s" totalImagesPullingTime="2.349954201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:23:34.712508731 +0000 UTC m=+352.790700807" watchObservedRunningTime="2026-07-13 17:23:34.713708393 +0000 UTC m=+352.791900451"
Jul 13 17:25:46.240999 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.240969    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"]
Jul 13 17:25:46.244105 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.244089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.247089 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.247070    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8rhtv\""
Jul 13 17:25:46.247955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.247934    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:25:46.247955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.247945    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 17:25:46.262915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.262893    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"]
Jul 13 17:25:46.310502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.310474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187bdd16-be22-46b3-9455-2d39ddef6e0e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-flcbj\" (UID: \"187bdd16-be22-46b3-9455-2d39ddef6e0e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.310614 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.310512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxtw5\" (UniqueName: \"kubernetes.io/projected/187bdd16-be22-46b3-9455-2d39ddef6e0e-kube-api-access-jxtw5\") pod \"openshift-lws-operator-fd8ccff4c-flcbj\" (UID: \"187bdd16-be22-46b3-9455-2d39ddef6e0e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.411168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.411141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187bdd16-be22-46b3-9455-2d39ddef6e0e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-flcbj\" (UID: \"187bdd16-be22-46b3-9455-2d39ddef6e0e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.411278 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.411178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxtw5\" (UniqueName: \"kubernetes.io/projected/187bdd16-be22-46b3-9455-2d39ddef6e0e-kube-api-access-jxtw5\") pod \"openshift-lws-operator-fd8ccff4c-flcbj\" (UID: \"187bdd16-be22-46b3-9455-2d39ddef6e0e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.411539 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.411523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/187bdd16-be22-46b3-9455-2d39ddef6e0e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-flcbj\" (UID: \"187bdd16-be22-46b3-9455-2d39ddef6e0e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.421224 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.421200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxtw5\" (UniqueName: \"kubernetes.io/projected/187bdd16-be22-46b3-9455-2d39ddef6e0e-kube-api-access-jxtw5\") pod \"openshift-lws-operator-fd8ccff4c-flcbj\" (UID: \"187bdd16-be22-46b3-9455-2d39ddef6e0e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.564869 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.564829    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"
Jul 13 17:25:46.693740 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:46.693713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj"]
Jul 13 17:25:46.695739 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:25:46.695712    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod187bdd16_be22_46b3_9455_2d39ddef6e0e.slice/crio-fc57d298e91b277ca53931271e75070ed8fa4771acbbc2def176672f60bdceb0 WatchSource:0}: Error finding container fc57d298e91b277ca53931271e75070ed8fa4771acbbc2def176672f60bdceb0: Status 404 returned error can't find the container with id fc57d298e91b277ca53931271e75070ed8fa4771acbbc2def176672f60bdceb0
Jul 13 17:25:47.202491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:47.202459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj" event={"ID":"187bdd16-be22-46b3-9455-2d39ddef6e0e","Type":"ContainerStarted","Data":"fc57d298e91b277ca53931271e75070ed8fa4771acbbc2def176672f60bdceb0"}
Jul 13 17:25:50.219423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:50.219325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj" event={"ID":"187bdd16-be22-46b3-9455-2d39ddef6e0e","Type":"ContainerStarted","Data":"d77885dacbfc1976b99c4ef663a3b001ea3ca33f96899f0d69288cd35c0c0912"}
Jul 13 17:25:50.248848 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:25:50.248796    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-flcbj" podStartSLOduration=1.033925728 podStartE2EDuration="4.248780515s" totalImagesPullingTime="3.214854787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:25:50.246158113 +0000 UTC m=+488.324350163" watchObservedRunningTime="2026-07-13 17:25:50.248780515 +0000 UTC m=+488.326972642"
Jul 13 17:26:10.497867 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.497836    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"]
Jul 13 17:26:10.501328 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.501293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.506720 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.506695    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 17:26:10.507145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.507124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 17:26:10.507255 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.507123    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2kjrn\""
Jul 13 17:26:10.507255 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.507192    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 17:26:10.507509 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.507493    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 17:26:10.537781 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.537759    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"]
Jul 13 17:26:10.621425 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.621390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce707caf-9364-4fef-add1-a183886d9dfe-tmp\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.621589 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.621465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce707caf-9364-4fef-add1-a183886d9dfe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.621589 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.621496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rl28\" (UniqueName: \"kubernetes.io/projected/ce707caf-9364-4fef-add1-a183886d9dfe-kube-api-access-5rl28\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.621589 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.621522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ce707caf-9364-4fef-add1-a183886d9dfe-manifests\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.621721 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.621606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce707caf-9364-4fef-add1-a183886d9dfe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.722455 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.722426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce707caf-9364-4fef-add1-a183886d9dfe-tmp\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.722644 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.722500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce707caf-9364-4fef-add1-a183886d9dfe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.722644 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.722530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rl28\" (UniqueName: \"kubernetes.io/projected/ce707caf-9364-4fef-add1-a183886d9dfe-kube-api-access-5rl28\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.722644 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.722554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ce707caf-9364-4fef-add1-a183886d9dfe-manifests\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.722644 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.722616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce707caf-9364-4fef-add1-a183886d9dfe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.722970 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.722946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ce707caf-9364-4fef-add1-a183886d9dfe-manifests\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.724626 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.724595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce707caf-9364-4fef-add1-a183886d9dfe-tmp\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.724868 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.724849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce707caf-9364-4fef-add1-a183886d9dfe-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.724941 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.724923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ce707caf-9364-4fef-add1-a183886d9dfe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.733179 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.733160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rl28\" (UniqueName: \"kubernetes.io/projected/ce707caf-9364-4fef-add1-a183886d9dfe-kube-api-access-5rl28\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r\" (UID: \"ce707caf-9364-4fef-add1-a183886d9dfe\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.811529 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.811455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:10.963260 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:10.963234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"]
Jul 13 17:26:10.965644 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:26:10.965621    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce707caf_9364_4fef_add1_a183886d9dfe.slice/crio-f0e34ab4403a5034447a9436114a208d3b27e8f2c28c3211e603edf8be379257 WatchSource:0}: Error finding container f0e34ab4403a5034447a9436114a208d3b27e8f2c28c3211e603edf8be379257: Status 404 returned error can't find the container with id f0e34ab4403a5034447a9436114a208d3b27e8f2c28c3211e603edf8be379257
Jul 13 17:26:11.304081 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:11.304044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r" event={"ID":"ce707caf-9364-4fef-add1-a183886d9dfe","Type":"ContainerStarted","Data":"f0e34ab4403a5034447a9436114a208d3b27e8f2c28c3211e603edf8be379257"}
Jul 13 17:26:14.325123 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:14.325078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r" event={"ID":"ce707caf-9364-4fef-add1-a183886d9dfe","Type":"ContainerStarted","Data":"7231ebff0bf7d31219116a6c8c6e375eb148697c264b19a329dfee871b1e0284"}
Jul 13 17:26:15.330619 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:15.330588    2577 generic.go:356] "Generic (PLEG): container finished" podID="ce707caf-9364-4fef-add1-a183886d9dfe" containerID="7231ebff0bf7d31219116a6c8c6e375eb148697c264b19a329dfee871b1e0284" exitCode=0
Jul 13 17:26:15.331021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:15.330672    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r" event={"ID":"ce707caf-9364-4fef-add1-a183886d9dfe","Type":"ContainerDied","Data":"7231ebff0bf7d31219116a6c8c6e375eb148697c264b19a329dfee871b1e0284"}
Jul 13 17:26:16.337749 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:16.337715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r" event={"ID":"ce707caf-9364-4fef-add1-a183886d9dfe","Type":"ContainerStarted","Data":"1b14f074abc9d8a198b9bbe53ec93606fe5d90e4335ebfc2fbb69799f3e95d64"}
Jul 13 17:26:16.338248 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:16.337841    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:16.368602 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:16.368550    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r" podStartSLOduration=1.808891149 podStartE2EDuration="6.368532561s" totalImagesPullingTime="3.477273977s" totalInitContainerRuntime="1.082367435s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:16.366158026 +0000 UTC m=+514.444350075" watchObservedRunningTime="2026-07-13 17:26:16.368532561 +0000 UTC m=+514.446724610"
Jul 13 17:26:27.344439 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:27.344408    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r"
Jul 13 17:26:33.478833 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.478798    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"]
Jul 13 17:26:33.487110 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.487090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.492290 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.492265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 17:26:33.492290 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.492268    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 17:26:33.492822 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.492806    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 17:26:33.493120 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.493092    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 17:26:33.493216 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.493152    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 17:26:33.493216 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.493205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 17:26:33.493776 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.493760    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jpn6p\""
Jul 13 17:26:33.499601 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.499580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"]
Jul 13 17:26:33.530716 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.530825 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.530825 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9p7\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-kube-api-access-ld9p7\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.530916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-token\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.530916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-cacerts\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.530995 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.530995 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.530972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/718bbb81-1373-437a-b8c6-371801ca5b9b-local-certs\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632013 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.631976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9p7\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-kube-api-access-ld9p7\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-token\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-cacerts\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.632491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/718bbb81-1373-437a-b8c6-371801ca5b9b-local-certs\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.633004 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.632978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.634717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.634689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-cacerts\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.634804 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.634767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.634896 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.634873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/718bbb81-1373-437a-b8c6-371801ca5b9b-local-certs\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.634964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.634942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.642023 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.641994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-token\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.642972 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.642949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9p7\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-kube-api-access-ld9p7\") pod \"istiod-openshift-gateway-7574459656-l8kcd\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.796064 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.796033    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:33.933668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:33.933642    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"]
Jul 13 17:26:33.935596 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:26:33.935568    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718bbb81_1373_437a_b8c6_371801ca5b9b.slice/crio-b46075ab43fea84c219be20a796ee40d16e808e206cab7f452bc7e67d3ee3722 WatchSource:0}: Error finding container b46075ab43fea84c219be20a796ee40d16e808e206cab7f452bc7e67d3ee3722: Status 404 returned error can't find the container with id b46075ab43fea84c219be20a796ee40d16e808e206cab7f452bc7e67d3ee3722
Jul 13 17:26:34.422033 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:34.422002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" event={"ID":"718bbb81-1373-437a-b8c6-371801ca5b9b","Type":"ContainerStarted","Data":"b46075ab43fea84c219be20a796ee40d16e808e206cab7f452bc7e67d3ee3722"}
Jul 13 17:26:36.445011 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:36.444971    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 17:26:36.445388 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:36.445041    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 17:26:37.438369 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:37.438332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" event={"ID":"718bbb81-1373-437a-b8c6-371801ca5b9b","Type":"ContainerStarted","Data":"046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e"}
Jul 13 17:26:37.526213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:37.526151    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" podStartSLOduration=2.019349408 podStartE2EDuration="4.526131205s" totalImagesPullingTime="2.506781797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:37.52174193 +0000 UTC m=+535.599933990" watchObservedRunningTime="2026-07-13 17:26:37.526131205 +0000 UTC m=+535.604323255"
Jul 13 17:26:38.442280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.442249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:38.443920 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.443893    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-l8kcd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 17:26:38.444047 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.443947    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" podUID="718bbb81-1373-437a-b8c6-371801ca5b9b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:26:38.510823 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.510785    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"]
Jul 13 17:26:38.514175 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.514152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.543399 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.543376    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r4m7d\""
Jul 13 17:26:38.543729 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.543612    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 17:26:38.544321 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.544284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 17:26:38.547350 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.547333    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 17:26:38.560177 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.560155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"]
Jul 13 17:26:38.579590 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.579572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6275c508-7800-4179-b3e9-934a1bbaca1e-manager-config\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.579686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.579616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6275c508-7800-4179-b3e9-934a1bbaca1e-cert\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.579686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.579639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6275c508-7800-4179-b3e9-934a1bbaca1e-metrics-cert\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.579796 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.579768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g7fm\" (UniqueName: \"kubernetes.io/projected/6275c508-7800-4179-b3e9-934a1bbaca1e-kube-api-access-8g7fm\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.680955 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.680931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6275c508-7800-4179-b3e9-934a1bbaca1e-manager-config\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.681095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.680995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6275c508-7800-4179-b3e9-934a1bbaca1e-cert\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.681095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.681022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6275c508-7800-4179-b3e9-934a1bbaca1e-metrics-cert\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.681095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.681090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g7fm\" (UniqueName: \"kubernetes.io/projected/6275c508-7800-4179-b3e9-934a1bbaca1e-kube-api-access-8g7fm\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.681671 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.681653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6275c508-7800-4179-b3e9-934a1bbaca1e-manager-config\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.683368 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.683349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6275c508-7800-4179-b3e9-934a1bbaca1e-metrics-cert\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.683480 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.683396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6275c508-7800-4179-b3e9-934a1bbaca1e-cert\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.699336 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.699244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g7fm\" (UniqueName: \"kubernetes.io/projected/6275c508-7800-4179-b3e9-934a1bbaca1e-kube-api-access-8g7fm\") pod \"lws-controller-manager-5df8bf697-s2lfk\" (UID: \"6275c508-7800-4179-b3e9-934a1bbaca1e\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.823445 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.823412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:38.958871 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:38.958847    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"]
Jul 13 17:26:38.961371 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:26:38.961347    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6275c508_7800_4179_b3e9_934a1bbaca1e.slice/crio-c49f456eeca2fa2bf8e45ad986883314a870b140b5cdf5cdeac274afa309910e WatchSource:0}: Error finding container c49f456eeca2fa2bf8e45ad986883314a870b140b5cdf5cdeac274afa309910e: Status 404 returned error can't find the container with id c49f456eeca2fa2bf8e45ad986883314a870b140b5cdf5cdeac274afa309910e
Jul 13 17:26:39.447773 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:39.447736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk" event={"ID":"6275c508-7800-4179-b3e9-934a1bbaca1e","Type":"ContainerStarted","Data":"c49f456eeca2fa2bf8e45ad986883314a870b140b5cdf5cdeac274afa309910e"}
Jul 13 17:26:39.448381 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:39.448362    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:41.459427 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:41.459386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk" event={"ID":"6275c508-7800-4179-b3e9-934a1bbaca1e","Type":"ContainerStarted","Data":"a3e7db9789c8d2196b010618887160cba26c9fb6885ee74e1c79a91328b53902"}
Jul 13 17:26:41.459804 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:41.459524    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:26:43.889644 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:43.889587    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk" podStartSLOduration=4.309366364 podStartE2EDuration="5.889570529s" totalImagesPullingTime="1.580204165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:41.481966679 +0000 UTC m=+539.560158728" watchObservedRunningTime="2026-07-13 17:26:43.889570529 +0000 UTC m=+541.967762582"
Jul 13 17:26:43.890024 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:43.890010    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"]
Jul 13 17:26:43.890224 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:43.890195    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" podUID="718bbb81-1373-437a-b8c6-371801ca5b9b" containerName="discovery" containerID="cri-o://046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e" gracePeriod=30
Jul 13 17:26:44.145029 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.144965    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:44.231614 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231579    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld9p7\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-kube-api-access-ld9p7\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.231793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231628    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-kubeconfig\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.231793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231644    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-token\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.231793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231690    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/718bbb81-1373-437a-b8c6-371801ca5b9b-local-certs\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.231793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231714    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-ca-configmap\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.231970 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231845    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-cacerts\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.232029 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.231968    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-dns-cert\") pod \"718bbb81-1373-437a-b8c6-371801ca5b9b\" (UID: \"718bbb81-1373-437a-b8c6-371801ca5b9b\") "
Jul 13 17:26:44.232087 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.232060    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:26:44.232330 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.232278    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-ca-configmap\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.234080 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.234010    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:26:44.234221 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.234120    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-cacerts" (OuterVolumeSpecName: "cacerts") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:26:44.234358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.234325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/718bbb81-1373-437a-b8c6-371801ca5b9b-local-certs" (OuterVolumeSpecName: "local-certs") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:26:44.234358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.234334    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-kube-api-access-ld9p7" (OuterVolumeSpecName: "kube-api-access-ld9p7") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "kube-api-access-ld9p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:26:44.234493 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.234392    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:26:44.234493 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.234404    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "718bbb81-1373-437a-b8c6-371801ca5b9b" (UID: "718bbb81-1373-437a-b8c6-371801ca5b9b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:26:44.338256 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.333801    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-csr-dns-cert\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.338256 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.333845    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld9p7\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-kube-api-access-ld9p7\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.338256 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.333861    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-kubeconfig\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.338256 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.333876    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718bbb81-1373-437a-b8c6-371801ca5b9b-istio-token\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.338256 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.333892    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/718bbb81-1373-437a-b8c6-371801ca5b9b-local-certs\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.338256 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.333909    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/718bbb81-1373-437a-b8c6-371801ca5b9b-cacerts\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:26:44.473553 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.473521    2577 generic.go:356] "Generic (PLEG): container finished" podID="718bbb81-1373-437a-b8c6-371801ca5b9b" containerID="046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e" exitCode=0
Jul 13 17:26:44.473700 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.473571    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"
Jul 13 17:26:44.473700 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.473611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" event={"ID":"718bbb81-1373-437a-b8c6-371801ca5b9b","Type":"ContainerDied","Data":"046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e"}
Jul 13 17:26:44.473700 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.473668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd" event={"ID":"718bbb81-1373-437a-b8c6-371801ca5b9b","Type":"ContainerDied","Data":"b46075ab43fea84c219be20a796ee40d16e808e206cab7f452bc7e67d3ee3722"}
Jul 13 17:26:44.473700 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.473695    2577 scope.go:117] "RemoveContainer" containerID="046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e"
Jul 13 17:26:44.482773 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.482754    2577 scope.go:117] "RemoveContainer" containerID="046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e"
Jul 13 17:26:44.483148 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:26:44.483125    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e\": container with ID starting with 046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e not found: ID does not exist" containerID="046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e"
Jul 13 17:26:44.483255 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.483157    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e"} err="failed to get container status \"046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e\": rpc error: code = NotFound desc = could not find container \"046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e\": container with ID starting with 046ba6338c3998a44dfdd3db159692f03cbabb930515a02a87a15d2899bd0c2e not found: ID does not exist"
Jul 13 17:26:44.506398 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.506375    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"]
Jul 13 17:26:44.510984 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:44.510963    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l8kcd"]
Jul 13 17:26:46.421695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:46.421668    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="718bbb81-1373-437a-b8c6-371801ca5b9b" path="/var/lib/kubelet/pods/718bbb81-1373-437a-b8c6-371801ca5b9b/volumes"
Jul 13 17:26:52.467108 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:26:52.467078    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-s2lfk"
Jul 13 17:27:31.178314 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.178277    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prv4w"]
Jul 13 17:27:31.178780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.178646    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718bbb81-1373-437a-b8c6-371801ca5b9b" containerName="discovery"
Jul 13 17:27:31.178780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.178657    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="718bbb81-1373-437a-b8c6-371801ca5b9b" containerName="discovery"
Jul 13 17:27:31.178780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.178716    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="718bbb81-1373-437a-b8c6-371801ca5b9b" containerName="discovery"
Jul 13 17:27:31.184142 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.184121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:31.186536 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.186514    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dlks6\""
Jul 13 17:27:31.186800 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.186782    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 17:27:31.186914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.186787    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 17:27:31.194573 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.194552    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prv4w"]
Jul 13 17:27:31.249741 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.249698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsh7j\" (UniqueName: \"kubernetes.io/projected/b0588d47-15b6-4676-a42e-4a77a1aa6f8b-kube-api-access-bsh7j\") pod \"kuadrant-operator-catalog-prv4w\" (UID: \"b0588d47-15b6-4676-a42e-4a77a1aa6f8b\") " pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:31.350378 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.350348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsh7j\" (UniqueName: \"kubernetes.io/projected/b0588d47-15b6-4676-a42e-4a77a1aa6f8b-kube-api-access-bsh7j\") pod \"kuadrant-operator-catalog-prv4w\" (UID: \"b0588d47-15b6-4676-a42e-4a77a1aa6f8b\") " pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:31.359010 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.358977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsh7j\" (UniqueName: \"kubernetes.io/projected/b0588d47-15b6-4676-a42e-4a77a1aa6f8b-kube-api-access-bsh7j\") pod \"kuadrant-operator-catalog-prv4w\" (UID: \"b0588d47-15b6-4676-a42e-4a77a1aa6f8b\") " pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:31.494980 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.494903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:31.529580 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.529542    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prv4w"]
Jul 13 17:27:31.624140 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.624113    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prv4w"]
Jul 13 17:27:31.626622 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:27:31.626595    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0588d47_15b6_4676_a42e_4a77a1aa6f8b.slice/crio-c815ad2f6a6ebe5a8d153ca90dbdab90aafcbf58b1e6179a33280ce84ac51bf7 WatchSource:0}: Error finding container c815ad2f6a6ebe5a8d153ca90dbdab90aafcbf58b1e6179a33280ce84ac51bf7: Status 404 returned error can't find the container with id c815ad2f6a6ebe5a8d153ca90dbdab90aafcbf58b1e6179a33280ce84ac51bf7
Jul 13 17:27:31.684261 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.684228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prv4w" event={"ID":"b0588d47-15b6-4676-a42e-4a77a1aa6f8b","Type":"ContainerStarted","Data":"c815ad2f6a6ebe5a8d153ca90dbdab90aafcbf58b1e6179a33280ce84ac51bf7"}
Jul 13 17:27:31.738551 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.738517    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8xmw7"]
Jul 13 17:27:31.741610 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.741594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:31.752545 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.752518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8xmw7"]
Jul 13 17:27:31.853685 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.853655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6jw\" (UniqueName: \"kubernetes.io/projected/fdb6eab0-5307-49d0-800d-f409c2d324e8-kube-api-access-5g6jw\") pod \"kuadrant-operator-catalog-8xmw7\" (UID: \"fdb6eab0-5307-49d0-800d-f409c2d324e8\") " pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:31.954881 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.954853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6jw\" (UniqueName: \"kubernetes.io/projected/fdb6eab0-5307-49d0-800d-f409c2d324e8-kube-api-access-5g6jw\") pod \"kuadrant-operator-catalog-8xmw7\" (UID: \"fdb6eab0-5307-49d0-800d-f409c2d324e8\") " pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:31.965945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:31.965912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6jw\" (UniqueName: \"kubernetes.io/projected/fdb6eab0-5307-49d0-800d-f409c2d324e8-kube-api-access-5g6jw\") pod \"kuadrant-operator-catalog-8xmw7\" (UID: \"fdb6eab0-5307-49d0-800d-f409c2d324e8\") " pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:32.051295 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:32.051231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:32.184811 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:32.184786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8xmw7"]
Jul 13 17:27:32.186491 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:27:32.186465    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb6eab0_5307_49d0_800d_f409c2d324e8.slice/crio-69b8bcafaa65312a070ef66205c207001ccb7df7de496c8fca40a643b4bf5e1b WatchSource:0}: Error finding container 69b8bcafaa65312a070ef66205c207001ccb7df7de496c8fca40a643b4bf5e1b: Status 404 returned error can't find the container with id 69b8bcafaa65312a070ef66205c207001ccb7df7de496c8fca40a643b4bf5e1b
Jul 13 17:27:32.690926 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:32.690894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7" event={"ID":"fdb6eab0-5307-49d0-800d-f409c2d324e8","Type":"ContainerStarted","Data":"69b8bcafaa65312a070ef66205c207001ccb7df7de496c8fca40a643b4bf5e1b"}
Jul 13 17:27:34.702671 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:34.702640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prv4w" event={"ID":"b0588d47-15b6-4676-a42e-4a77a1aa6f8b","Type":"ContainerStarted","Data":"8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c"}
Jul 13 17:27:34.703131 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:34.702661    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-prv4w" podUID="b0588d47-15b6-4676-a42e-4a77a1aa6f8b" containerName="registry-server" containerID="cri-o://8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c" gracePeriod=2
Jul 13 17:27:34.704248 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:34.704220    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7" event={"ID":"fdb6eab0-5307-49d0-800d-f409c2d324e8","Type":"ContainerStarted","Data":"8b6f4c0ee651e4389a1c7cb1542ee0d6b74a1f1b3341b41331f295bb837e3acd"}
Jul 13 17:27:34.718170 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:34.718128    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-prv4w" podStartSLOduration=1.425769909 podStartE2EDuration="3.71811564s" totalImagesPullingTime="2.292345731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:27:34.717093553 +0000 UTC m=+592.795285607" watchObservedRunningTime="2026-07-13 17:27:34.71811564 +0000 UTC m=+592.796307690"
Jul 13 17:27:34.737343 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:34.737286    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7" podStartSLOduration=2.002372985 podStartE2EDuration="3.737272591s" totalImagesPullingTime="1.734899606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:27:34.735920267 +0000 UTC m=+592.814112317" watchObservedRunningTime="2026-07-13 17:27:34.737272591 +0000 UTC m=+592.815464639"
Jul 13 17:27:34.939576 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:34.939552    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:35.082946 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.082912    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsh7j\" (UniqueName: \"kubernetes.io/projected/b0588d47-15b6-4676-a42e-4a77a1aa6f8b-kube-api-access-bsh7j\") pod \"b0588d47-15b6-4676-a42e-4a77a1aa6f8b\" (UID: \"b0588d47-15b6-4676-a42e-4a77a1aa6f8b\") "
Jul 13 17:27:35.085118 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.085090    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0588d47-15b6-4676-a42e-4a77a1aa6f8b-kube-api-access-bsh7j" (OuterVolumeSpecName: "kube-api-access-bsh7j") pod "b0588d47-15b6-4676-a42e-4a77a1aa6f8b" (UID: "b0588d47-15b6-4676-a42e-4a77a1aa6f8b"). InnerVolumeSpecName "kube-api-access-bsh7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:27:35.184151 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.184110    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsh7j\" (UniqueName: \"kubernetes.io/projected/b0588d47-15b6-4676-a42e-4a77a1aa6f8b-kube-api-access-bsh7j\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:27:35.709950 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.709910    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0588d47-15b6-4676-a42e-4a77a1aa6f8b" containerID="8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c" exitCode=0
Jul 13 17:27:35.710361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.709970    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prv4w"
Jul 13 17:27:35.710361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.709992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prv4w" event={"ID":"b0588d47-15b6-4676-a42e-4a77a1aa6f8b","Type":"ContainerDied","Data":"8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c"}
Jul 13 17:27:35.710361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.710045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prv4w" event={"ID":"b0588d47-15b6-4676-a42e-4a77a1aa6f8b","Type":"ContainerDied","Data":"c815ad2f6a6ebe5a8d153ca90dbdab90aafcbf58b1e6179a33280ce84ac51bf7"}
Jul 13 17:27:35.710361 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.710065    2577 scope.go:117] "RemoveContainer" containerID="8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c"
Jul 13 17:27:35.719907 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.719885    2577 scope.go:117] "RemoveContainer" containerID="8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c"
Jul 13 17:27:35.720165 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:27:35.720147    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c\": container with ID starting with 8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c not found: ID does not exist" containerID="8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c"
Jul 13 17:27:35.720222 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.720173    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c"} err="failed to get container status \"8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c\": rpc error: code = NotFound desc = could not find container \"8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c\": container with ID starting with 8593127293fafbdf2458f2ab2e148b07c36b1f9e55956f3d322f219765b4e78c not found: ID does not exist"
Jul 13 17:27:35.731164 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.731144    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prv4w"]
Jul 13 17:27:35.735254 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:35.735233    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prv4w"]
Jul 13 17:27:36.421906 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:36.421872    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0588d47-15b6-4676-a42e-4a77a1aa6f8b" path="/var/lib/kubelet/pods/b0588d47-15b6-4676-a42e-4a77a1aa6f8b/volumes"
Jul 13 17:27:42.051956 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.051925    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:42.052398 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.051993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:42.074905 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.074881    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:42.307629 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.307553    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:27:42.307780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.307767    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:27:42.312648 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.312555    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:27:42.312648 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.312588    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:27:42.763959 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:42.763927    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8xmw7"
Jul 13 17:27:57.586385 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.586352    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"]
Jul 13 17:27:57.592961 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.586672    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0588d47-15b6-4676-a42e-4a77a1aa6f8b" containerName="registry-server"
Jul 13 17:27:57.592961 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.586682    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0588d47-15b6-4676-a42e-4a77a1aa6f8b" containerName="registry-server"
Jul 13 17:27:57.592961 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.586765    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0588d47-15b6-4676-a42e-4a77a1aa6f8b" containerName="registry-server"
Jul 13 17:27:57.593722 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.593703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:27:57.596537 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.596515    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 13 17:27:57.596764 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.596749    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-g78jg\""
Jul 13 17:27:57.602776 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.602755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"]
Jul 13 17:27:57.686379 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.686342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq9bn\" (UniqueName: \"kubernetes.io/projected/79b0ca46-59b5-4741-a130-e5c1e6f7d4d2-kube-api-access-cq9bn\") pod \"dns-operator-controller-manager-864dd78c4c-jqms9\" (UID: \"79b0ca46-59b5-4741-a130-e5c1e6f7d4d2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:27:57.787146 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.787112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9bn\" (UniqueName: \"kubernetes.io/projected/79b0ca46-59b5-4741-a130-e5c1e6f7d4d2-kube-api-access-cq9bn\") pod \"dns-operator-controller-manager-864dd78c4c-jqms9\" (UID: \"79b0ca46-59b5-4741-a130-e5c1e6f7d4d2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:27:57.799438 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.799403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9bn\" (UniqueName: \"kubernetes.io/projected/79b0ca46-59b5-4741-a130-e5c1e6f7d4d2-kube-api-access-cq9bn\") pod \"dns-operator-controller-manager-864dd78c4c-jqms9\" (UID: \"79b0ca46-59b5-4741-a130-e5c1e6f7d4d2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:27:57.905498 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:57.905415    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:27:58.038047 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:58.038014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"]
Jul 13 17:27:58.042313 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:27:58.042261    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b0ca46_59b5_4741_a130_e5c1e6f7d4d2.slice/crio-e8dfede9abf0a952e81e653f7aae5dc8fe03f38bb25ae69da6baba716cb3a037 WatchSource:0}: Error finding container e8dfede9abf0a952e81e653f7aae5dc8fe03f38bb25ae69da6baba716cb3a037: Status 404 returned error can't find the container with id e8dfede9abf0a952e81e653f7aae5dc8fe03f38bb25ae69da6baba716cb3a037
Jul 13 17:27:58.813872 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:27:58.813838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9" event={"ID":"79b0ca46-59b5-4741-a130-e5c1e6f7d4d2","Type":"ContainerStarted","Data":"e8dfede9abf0a952e81e653f7aae5dc8fe03f38bb25ae69da6baba716cb3a037"}
Jul 13 17:28:00.824195 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:00.824110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9" event={"ID":"79b0ca46-59b5-4741-a130-e5c1e6f7d4d2","Type":"ContainerStarted","Data":"557980bd05e82f24b307318ffbaf680cf05e75a0c1c077ecb92c05923ed47987"}
Jul 13 17:28:00.824195 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:00.824189    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:28:00.848336 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:00.848273    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9" podStartSLOduration=1.376630567 podStartE2EDuration="3.84825777s" totalImagesPullingTime="2.471627203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:00.846344867 +0000 UTC m=+618.924536917" watchObservedRunningTime="2026-07-13 17:28:00.84825777 +0000 UTC m=+618.926449819"
Jul 13 17:28:01.500082 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.500052    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"]
Jul 13 17:28:01.503866 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.503843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:01.506396 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.506375    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dl4r9\""
Jul 13 17:28:01.515600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.515576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"]
Jul 13 17:28:01.525082 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.525064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rjm6\" (UniqueName: \"kubernetes.io/projected/9ff22432-d09b-4f9f-bbbe-5addeb433275-kube-api-access-6rjm6\") pod \"authorino-operator-75cc8d5cb7-57fr2\" (UID: \"9ff22432-d09b-4f9f-bbbe-5addeb433275\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:01.626482 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.626454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rjm6\" (UniqueName: \"kubernetes.io/projected/9ff22432-d09b-4f9f-bbbe-5addeb433275-kube-api-access-6rjm6\") pod \"authorino-operator-75cc8d5cb7-57fr2\" (UID: \"9ff22432-d09b-4f9f-bbbe-5addeb433275\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:01.638921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.638900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rjm6\" (UniqueName: \"kubernetes.io/projected/9ff22432-d09b-4f9f-bbbe-5addeb433275-kube-api-access-6rjm6\") pod \"authorino-operator-75cc8d5cb7-57fr2\" (UID: \"9ff22432-d09b-4f9f-bbbe-5addeb433275\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:01.814479 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.814402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:01.944860 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:01.944772    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"]
Jul 13 17:28:01.947139 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:28:01.947116    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff22432_d09b_4f9f_bbbe_5addeb433275.slice/crio-cde2db79cdf6e8da686d703446ff0c952dfbf4cf671a1961ae29967dd2defad7 WatchSource:0}: Error finding container cde2db79cdf6e8da686d703446ff0c952dfbf4cf671a1961ae29967dd2defad7: Status 404 returned error can't find the container with id cde2db79cdf6e8da686d703446ff0c952dfbf4cf671a1961ae29967dd2defad7
Jul 13 17:28:02.835978 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:02.835930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2" event={"ID":"9ff22432-d09b-4f9f-bbbe-5addeb433275","Type":"ContainerStarted","Data":"cde2db79cdf6e8da686d703446ff0c952dfbf4cf671a1961ae29967dd2defad7"}
Jul 13 17:28:04.846917 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.846885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2" event={"ID":"9ff22432-d09b-4f9f-bbbe-5addeb433275","Type":"ContainerStarted","Data":"52435e724e5b188955971216c570c70710665d6bbcdc5c941ad21ae4cc75c567"}
Jul 13 17:28:04.847384 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.847029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:04.864580 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.864518    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2" podStartSLOduration=1.678022501 podStartE2EDuration="3.864501624s" totalImagesPullingTime="2.186479123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:04.863604542 +0000 UTC m=+622.941796611" watchObservedRunningTime="2026-07-13 17:28:04.864501624 +0000 UTC m=+622.942693674"
Jul 13 17:28:04.965884 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.965854    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"]
Jul 13 17:28:04.969236 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.969217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:04.972836 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.972815    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dv9fm\""
Jul 13 17:28:04.985564 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:04.985542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"]
Jul 13 17:28:05.055726 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:05.055697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7b4\" (UniqueName: \"kubernetes.io/projected/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf-kube-api-access-sn7b4\") pod \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" (UID: \"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:05.156826 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:05.156762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7b4\" (UniqueName: \"kubernetes.io/projected/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf-kube-api-access-sn7b4\") pod \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" (UID: \"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:05.166035 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:05.166015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7b4\" (UniqueName: \"kubernetes.io/projected/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf-kube-api-access-sn7b4\") pod \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" (UID: \"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:05.279113 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:05.279087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:05.420387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:05.420357    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"]
Jul 13 17:28:05.423145 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:28:05.423119    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd029c0b1_8cc6_4530_b0ed_060fe10d0cbf.slice/crio-44bca5271c9b1295e5ae474d3aff7db144cd129f12126425a22292af476afd53 WatchSource:0}: Error finding container 44bca5271c9b1295e5ae474d3aff7db144cd129f12126425a22292af476afd53: Status 404 returned error can't find the container with id 44bca5271c9b1295e5ae474d3aff7db144cd129f12126425a22292af476afd53
Jul 13 17:28:05.853089 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:05.853055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5" event={"ID":"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf","Type":"ContainerStarted","Data":"44bca5271c9b1295e5ae474d3aff7db144cd129f12126425a22292af476afd53"}
Jul 13 17:28:08.870264 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:08.870227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5" event={"ID":"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf","Type":"ContainerStarted","Data":"f74e6e8ec2b92525734bd3489df998daa0784001810d40d93e8fc5374f50cdde"}
Jul 13 17:28:08.870667 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:08.870369    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:08.892226 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:08.892173    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5" podStartSLOduration=2.406390953 podStartE2EDuration="4.892155865s" totalImagesPullingTime="2.485764912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:08.890690986 +0000 UTC m=+626.968883229" watchObservedRunningTime="2026-07-13 17:28:08.892155865 +0000 UTC m=+626.970347975"
Jul 13 17:28:11.831514 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:11.831480    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqms9"
Jul 13 17:28:15.855546 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:15.855510    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-57fr2"
Jul 13 17:28:19.627019 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.626989    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"]
Jul 13 17:28:19.630493 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.630475    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.632816 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.632790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 13 17:28:19.632900 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.632796    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4rw67\""
Jul 13 17:28:19.633120 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.633096    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 13 17:28:19.641496 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.641471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"]
Jul 13 17:28:19.695104 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.695078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.695241 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.695116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql4cz\" (UniqueName: \"kubernetes.io/projected/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-kube-api-access-ql4cz\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.695241 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.695138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.796382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.796352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.796502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.796392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql4cz\" (UniqueName: \"kubernetes.io/projected/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-kube-api-access-ql4cz\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.796502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.796422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.796593 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:19.796568    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 13 17:28:19.796666 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:19.796653    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-plugin-serving-cert podName:e05dfdc6-bc92-40dc-9f3a-21ce429f4231 nodeName:}" failed. No retries permitted until 2026-07-13 17:28:20.296631508 +0000 UTC m=+638.374823540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2tvl2" (UID: "e05dfdc6-bc92-40dc-9f3a-21ce429f4231") : secret "plugin-serving-cert" not found
Jul 13 17:28:19.796989 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.796973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.806911 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.806889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql4cz\" (UniqueName: \"kubernetes.io/projected/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-kube-api-access-ql4cz\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:19.877535 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:19.877478    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:20.300661 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:20.300631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:20.303037 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:20.303013    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05dfdc6-bc92-40dc-9f3a-21ce429f4231-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2tvl2\" (UID: \"e05dfdc6-bc92-40dc-9f3a-21ce429f4231\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:20.542441 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:20.542400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"
Jul 13 17:28:20.696022 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:20.695999    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2"]
Jul 13 17:28:20.698176 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:28:20.698145    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode05dfdc6_bc92_40dc_9f3a_21ce429f4231.slice/crio-f964f649d86eb55d0cb2df0b0bcf3afc91077a99dad98f12e7518e7c3ac584af WatchSource:0}: Error finding container f964f649d86eb55d0cb2df0b0bcf3afc91077a99dad98f12e7518e7c3ac584af: Status 404 returned error can't find the container with id f964f649d86eb55d0cb2df0b0bcf3afc91077a99dad98f12e7518e7c3ac584af
Jul 13 17:28:20.929015 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:20.928939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2" event={"ID":"e05dfdc6-bc92-40dc-9f3a-21ce429f4231","Type":"ContainerStarted","Data":"f964f649d86eb55d0cb2df0b0bcf3afc91077a99dad98f12e7518e7c3ac584af"}
Jul 13 17:28:29.521958 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.521929    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"]
Jul 13 17:28:29.525521 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.525504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.527855 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.527834    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t6clk\""
Jul 13 17:28:29.537438 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.537416    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"]
Jul 13 17:28:29.641876 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.641838    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"]
Jul 13 17:28:29.642204 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:29.642179    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-hhd8q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6" podUID="83e30a62-6349-4e86-a01a-47556dbee235"
Jul 13 17:28:29.690080 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.690047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83e30a62-6349-4e86-a01a-47556dbee235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6mwj6\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.690255 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.690121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhd8q\" (UniqueName: \"kubernetes.io/projected/83e30a62-6349-4e86-a01a-47556dbee235-kube-api-access-hhd8q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6mwj6\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.791468 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.791371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83e30a62-6349-4e86-a01a-47556dbee235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6mwj6\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.791468 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.791435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhd8q\" (UniqueName: \"kubernetes.io/projected/83e30a62-6349-4e86-a01a-47556dbee235-kube-api-access-hhd8q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6mwj6\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.791760 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.791738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83e30a62-6349-4e86-a01a-47556dbee235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6mwj6\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.803499 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.803475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhd8q\" (UniqueName: \"kubernetes.io/projected/83e30a62-6349-4e86-a01a-47556dbee235-kube-api-access-hhd8q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6mwj6\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.979126 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.979093    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:29.986628 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:29.986607    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:30.094913 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.094840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83e30a62-6349-4e86-a01a-47556dbee235-extensions-socket-volume\") pod \"83e30a62-6349-4e86-a01a-47556dbee235\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") "
Jul 13 17:28:30.095073 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.094922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhd8q\" (UniqueName: \"kubernetes.io/projected/83e30a62-6349-4e86-a01a-47556dbee235-kube-api-access-hhd8q\") pod \"83e30a62-6349-4e86-a01a-47556dbee235\" (UID: \"83e30a62-6349-4e86-a01a-47556dbee235\") "
Jul 13 17:28:30.095139 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.095110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83e30a62-6349-4e86-a01a-47556dbee235-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "83e30a62-6349-4e86-a01a-47556dbee235" (UID: "83e30a62-6349-4e86-a01a-47556dbee235"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:28:30.095241 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.095214    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83e30a62-6349-4e86-a01a-47556dbee235-extensions-socket-volume\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:28:30.097313 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.097277    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83e30a62-6349-4e86-a01a-47556dbee235-kube-api-access-hhd8q" (OuterVolumeSpecName: "kube-api-access-hhd8q") pod "83e30a62-6349-4e86-a01a-47556dbee235" (UID: "83e30a62-6349-4e86-a01a-47556dbee235"). InnerVolumeSpecName "kube-api-access-hhd8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:28:30.142357 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.142327    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"]
Jul 13 17:28:30.151268 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.151244    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"]
Jul 13 17:28:30.184245 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.184221    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"]
Jul 13 17:28:30.184445 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.184420    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" containerName="manager" containerID="cri-o://f74e6e8ec2b92525734bd3489df998daa0784001810d40d93e8fc5374f50cdde" gracePeriod=2
Jul 13 17:28:30.190405 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.190385    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"]
Jul 13 17:28:30.196186 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.196154    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhd8q\" (UniqueName: \"kubernetes.io/projected/83e30a62-6349-4e86-a01a-47556dbee235-kube-api-access-hhd8q\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:28:30.234794 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.234765    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"]
Jul 13 17:28:30.235370 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.235352    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" containerName="manager"
Jul 13 17:28:30.235483 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.235374    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" containerName="manager"
Jul 13 17:28:30.235483 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.235478    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" containerName="manager"
Jul 13 17:28:30.238769 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.238749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:30.241906 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:30.241876    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" is forbidden: User \"system:node:ip-10-0-134-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-215.ec2.internal' and this object" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:30.257859 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.257834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"]
Jul 13 17:28:30.397817 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.397658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl9m5\" (UniqueName: \"kubernetes.io/projected/875f8e28-ae6b-4db0-b3d6-7c4befdbce2c-kube-api-access-wl9m5\") pod \"limitador-operator-controller-manager-859d7b78bd-nwn2z\" (UID: \"875f8e28-ae6b-4db0-b3d6-7c4befdbce2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:30.424056 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.424020    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83e30a62-6349-4e86-a01a-47556dbee235" path="/var/lib/kubelet/pods/83e30a62-6349-4e86-a01a-47556dbee235/volumes"
Jul 13 17:28:30.499124 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.499090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl9m5\" (UniqueName: \"kubernetes.io/projected/875f8e28-ae6b-4db0-b3d6-7c4befdbce2c-kube-api-access-wl9m5\") pod \"limitador-operator-controller-manager-859d7b78bd-nwn2z\" (UID: \"875f8e28-ae6b-4db0-b3d6-7c4befdbce2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:30.509558 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.509522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl9m5\" (UniqueName: \"kubernetes.io/projected/875f8e28-ae6b-4db0-b3d6-7c4befdbce2c-kube-api-access-wl9m5\") pod \"limitador-operator-controller-manager-859d7b78bd-nwn2z\" (UID: \"875f8e28-ae6b-4db0-b3d6-7c4befdbce2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:30.565884 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.565852    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:30.985976 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.985941    2577 generic.go:356] "Generic (PLEG): container finished" podID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" containerID="f74e6e8ec2b92525734bd3489df998daa0784001810d40d93e8fc5374f50cdde" exitCode=0
Jul 13 17:28:30.986154 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:30.986066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6mwj6"
Jul 13 17:28:44.325704 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:44.325682    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"]
Jul 13 17:28:44.329460 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:28:44.329434    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875f8e28_ae6b_4db0_b3d6_7c4befdbce2c.slice/crio-1099ec5c087eceac2f7636ab1c18950bed141ba037d38546cf1d45a89cfb66b6 WatchSource:0}: Error finding container 1099ec5c087eceac2f7636ab1c18950bed141ba037d38546cf1d45a89cfb66b6: Status 404 returned error can't find the container with id 1099ec5c087eceac2f7636ab1c18950bed141ba037d38546cf1d45a89cfb66b6
Jul 13 17:28:44.337019 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:44.337000    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:44.339028 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:44.339003    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" is forbidden: User \"system:node:ip-10-0-134-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-215.ec2.internal' and this object" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:44.435553 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:44.435526    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn7b4\" (UniqueName: \"kubernetes.io/projected/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf-kube-api-access-sn7b4\") pod \"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf\" (UID: \"d029c0b1-8cc6-4530-b0ed-060fe10d0cbf\") "
Jul 13 17:28:44.437461 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:44.437433    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf-kube-api-access-sn7b4" (OuterVolumeSpecName: "kube-api-access-sn7b4") pod "d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" (UID: "d029c0b1-8cc6-4530-b0ed-060fe10d0cbf"). InnerVolumeSpecName "kube-api-access-sn7b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:28:44.536289 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:44.536264    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn7b4\" (UniqueName: \"kubernetes.io/projected/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf-kube-api-access-sn7b4\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:28:45.068436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.068411    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:45.068612 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.068439    2577 scope.go:117] "RemoveContainer" containerID="f74e6e8ec2b92525734bd3489df998daa0784001810d40d93e8fc5374f50cdde"
Jul 13 17:28:45.070095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.070068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2" event={"ID":"e05dfdc6-bc92-40dc-9f3a-21ce429f4231","Type":"ContainerStarted","Data":"7b5d0c2a4bdc0e7260e746f44371f2216370d77f5493c194b474333f1b7230a5"}
Jul 13 17:28:45.070721 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:45.070694    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" is forbidden: User \"system:node:ip-10-0-134-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-215.ec2.internal' and this object" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:45.071805 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.071786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z" event={"ID":"875f8e28-ae6b-4db0-b3d6-7c4befdbce2c","Type":"ContainerStarted","Data":"54166b4e69c40f0c1cfb1f10d6acd6692eb39b706efde0c0285b4ab457e6d5b7"}
Jul 13 17:28:45.071915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.071826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z" event={"ID":"875f8e28-ae6b-4db0-b3d6-7c4befdbce2c","Type":"ContainerStarted","Data":"1099ec5c087eceac2f7636ab1c18950bed141ba037d38546cf1d45a89cfb66b6"}
Jul 13 17:28:45.071915 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.071890    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:45.089519 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.089478    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2tvl2" podStartSLOduration=2.5024267399999998 podStartE2EDuration="26.089466459s" totalImagesPullingTime="23.587039719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:45.087661316 +0000 UTC m=+663.165853367" watchObservedRunningTime="2026-07-13 17:28:45.089466459 +0000 UTC m=+663.167658508"
Jul 13 17:28:45.089876 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:45.089855    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" is forbidden: User \"system:node:ip-10-0-134-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-215.ec2.internal' and this object" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:45.092534 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:28:45.092512    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7tn5\" is forbidden: User \"system:node:ip-10-0-134-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-215.ec2.internal' and this object" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7tn5"
Jul 13 17:28:45.114649 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:45.114605    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z" podStartSLOduration=15.114586534 podStartE2EDuration="15.114586534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:45.111884352 +0000 UTC m=+663.190076402" watchObservedRunningTime="2026-07-13 17:28:45.114586534 +0000 UTC m=+663.192778584"
Jul 13 17:28:46.421768 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:46.421738    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d029c0b1-8cc6-4530-b0ed-060fe10d0cbf" path="/var/lib/kubelet/pods/d029c0b1-8cc6-4530-b0ed-060fe10d0cbf/volumes"
Jul 13 17:28:47.290453 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.290421    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ffbbdcd49-jv5bd"]
Jul 13 17:28:47.295127 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.295098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.297433 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.297408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5bpwm\""
Jul 13 17:28:47.298426 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.298396    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 17:28:47.298675 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.298648    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 17:28:47.298780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.298722    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 17:28:47.299638 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.299619    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 17:28:47.299754 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.299631    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 17:28:47.299754 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.299607    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 17:28:47.300815 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.300794    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 17:28:47.304568 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.304546    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 17:28:47.307872 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.307854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffbbdcd49-jv5bd"]
Jul 13 17:28:47.362648 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27e006e6-14f9-4568-94df-81b82e6f966d-console-oauth-config\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.362781 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27e006e6-14f9-4568-94df-81b82e6f966d-console-serving-cert\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.362781 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-service-ca\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.362781 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-console-config\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.362936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck94q\" (UniqueName: \"kubernetes.io/projected/27e006e6-14f9-4568-94df-81b82e6f966d-kube-api-access-ck94q\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.362936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362842    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-trusted-ca-bundle\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.362936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.362874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-oauth-serving-cert\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464109 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-trusted-ca-bundle\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464109 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-oauth-serving-cert\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464681 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27e006e6-14f9-4568-94df-81b82e6f966d-console-oauth-config\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464681 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27e006e6-14f9-4568-94df-81b82e6f966d-console-serving-cert\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464681 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-service-ca\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464681 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-console-config\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464681 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck94q\" (UniqueName: \"kubernetes.io/projected/27e006e6-14f9-4568-94df-81b82e6f966d-kube-api-access-ck94q\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.464947 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.464925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-oauth-serving-cert\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.465082 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.465056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-console-config\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.465220 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.465091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-service-ca\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.465494 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.465472    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e006e6-14f9-4568-94df-81b82e6f966d-trusted-ca-bundle\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.466853 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.466816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27e006e6-14f9-4568-94df-81b82e6f966d-console-oauth-config\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.467401 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.467374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27e006e6-14f9-4568-94df-81b82e6f966d-console-serving-cert\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.473697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.473676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck94q\" (UniqueName: \"kubernetes.io/projected/27e006e6-14f9-4568-94df-81b82e6f966d-kube-api-access-ck94q\") pod \"console-5ffbbdcd49-jv5bd\" (UID: \"27e006e6-14f9-4568-94df-81b82e6f966d\") " pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.606204 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.606111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:47.746916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:47.746883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffbbdcd49-jv5bd"]
Jul 13 17:28:47.749713 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:28:47.749684    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e006e6_14f9_4568_94df_81b82e6f966d.slice/crio-34ea1fbaa77d78b7153b594233001d5be7ce22d4e2aec4b651f2f79b06ef770e WatchSource:0}: Error finding container 34ea1fbaa77d78b7153b594233001d5be7ce22d4e2aec4b651f2f79b06ef770e: Status 404 returned error can't find the container with id 34ea1fbaa77d78b7153b594233001d5be7ce22d4e2aec4b651f2f79b06ef770e
Jul 13 17:28:48.088448 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:48.088414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffbbdcd49-jv5bd" event={"ID":"27e006e6-14f9-4568-94df-81b82e6f966d","Type":"ContainerStarted","Data":"4783402ea73a5aa022fdf3c662f4db07fecdd92a9314e71aab7173edd296c636"}
Jul 13 17:28:48.088621 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:48.088469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffbbdcd49-jv5bd" event={"ID":"27e006e6-14f9-4568-94df-81b82e6f966d","Type":"ContainerStarted","Data":"34ea1fbaa77d78b7153b594233001d5be7ce22d4e2aec4b651f2f79b06ef770e"}
Jul 13 17:28:48.107936 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:48.107890    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ffbbdcd49-jv5bd" podStartSLOduration=1.10787663 podStartE2EDuration="1.10787663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:48.107193414 +0000 UTC m=+666.185385467" watchObservedRunningTime="2026-07-13 17:28:48.10787663 +0000 UTC m=+666.186068680"
Jul 13 17:28:56.079813 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:56.079777    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nwn2z"
Jul 13 17:28:57.606951 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:57.606917    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:57.607457 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:57.606981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:57.611807 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:57.611785    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:28:58.141376 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:28:58.141341    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ffbbdcd49-jv5bd"
Jul 13 17:29:08.088583 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.088548    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:08.112835 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.112807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:08.112975 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.112938    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.115559 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.115535    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 17:29:08.185652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.185623    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:08.255495 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.255467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnmbz\" (UniqueName: \"kubernetes.io/projected/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-kube-api-access-jnmbz\") pod \"limitador-limitador-64c94fd64f-hnsbv\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.255647 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.255578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-config-file\") pod \"limitador-limitador-64c94fd64f-hnsbv\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.356722 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.356639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-config-file\") pod \"limitador-limitador-64c94fd64f-hnsbv\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.356722 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.356707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnmbz\" (UniqueName: \"kubernetes.io/projected/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-kube-api-access-jnmbz\") pod \"limitador-limitador-64c94fd64f-hnsbv\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.357395 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.357368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-config-file\") pod \"limitador-limitador-64c94fd64f-hnsbv\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.365436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.365416    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnmbz\" (UniqueName: \"kubernetes.io/projected/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-kube-api-access-jnmbz\") pod \"limitador-limitador-64c94fd64f-hnsbv\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.424816 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.424792    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:08.832687 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.832667    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:08.834790 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:29:08.834763    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3175bc0_7f7b_479d_b6b2_23472c0d7e71.slice/crio-85fb38ce348dd85e9eba38258c13553a239fae6c0103557c05d3756426c73140 WatchSource:0}: Error finding container 85fb38ce348dd85e9eba38258c13553a239fae6c0103557c05d3756426c73140: Status 404 returned error can't find the container with id 85fb38ce348dd85e9eba38258c13553a239fae6c0103557c05d3756426c73140
Jul 13 17:29:08.836870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:08.836853    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:29:09.073237 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.073196    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-x554v"]
Jul 13 17:29:09.207813 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.207778    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x554v"]
Jul 13 17:29:09.207813 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.207809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv" event={"ID":"e3175bc0-7f7b-479d-b6b2-23472c0d7e71","Type":"ContainerStarted","Data":"85fb38ce348dd85e9eba38258c13553a239fae6c0103557c05d3756426c73140"}
Jul 13 17:29:09.208231 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.207902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:09.210782 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.210702    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lbvw7\""
Jul 13 17:29:09.263482 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.263444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qfmz\" (UniqueName: \"kubernetes.io/projected/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5-kube-api-access-7qfmz\") pod \"authorino-75d556bd77-x554v\" (UID: \"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5\") " pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:09.364486 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.364418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qfmz\" (UniqueName: \"kubernetes.io/projected/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5-kube-api-access-7qfmz\") pod \"authorino-75d556bd77-x554v\" (UID: \"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5\") " pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:09.373314 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.373274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qfmz\" (UniqueName: \"kubernetes.io/projected/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5-kube-api-access-7qfmz\") pod \"authorino-75d556bd77-x554v\" (UID: \"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5\") " pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:09.518476 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.518424    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:09.699033 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:09.697931    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x554v"]
Jul 13 17:29:09.699033 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:29:09.698697    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5bb9b5a_6dcc_4d73_a5a7_c1525bdf99e5.slice/crio-e95fb895c294a6e4bba5cd5389fe98ba80e134b88b2b8598d2359f233f72412c WatchSource:0}: Error finding container e95fb895c294a6e4bba5cd5389fe98ba80e134b88b2b8598d2359f233f72412c: Status 404 returned error can't find the container with id e95fb895c294a6e4bba5cd5389fe98ba80e134b88b2b8598d2359f233f72412c
Jul 13 17:29:10.200669 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:10.200620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x554v" event={"ID":"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5","Type":"ContainerStarted","Data":"e95fb895c294a6e4bba5cd5389fe98ba80e134b88b2b8598d2359f233f72412c"}
Jul 13 17:29:12.212987 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:12.212953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv" event={"ID":"e3175bc0-7f7b-479d-b6b2-23472c0d7e71","Type":"ContainerStarted","Data":"e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e"}
Jul 13 17:29:12.213390 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:12.213026    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:12.237833 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:12.237737    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv" podStartSLOduration=1.100011879 podStartE2EDuration="4.237719252s" totalImagesPullingTime="3.137707373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:12.235717479 +0000 UTC m=+690.313909546" watchObservedRunningTime="2026-07-13 17:29:12.237719252 +0000 UTC m=+690.315911301"
Jul 13 17:29:15.230400 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:15.230359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x554v" event={"ID":"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5","Type":"ContainerStarted","Data":"4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685"}
Jul 13 17:29:15.246276 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:15.246221    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-x554v" podStartSLOduration=1.5355482569999999 podStartE2EDuration="6.246202402s" totalImagesPullingTime="4.710654145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:15.245384214 +0000 UTC m=+693.323576304" watchObservedRunningTime="2026-07-13 17:29:15.246202402 +0000 UTC m=+693.324394454"
Jul 13 17:29:23.219803 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:23.219765    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:24.615294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:24.615263    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:24.615782 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:24.615586    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv" podUID="e3175bc0-7f7b-479d-b6b2-23472c0d7e71" containerName="limitador" containerID="cri-o://e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e" gracePeriod=30
Jul 13 17:29:25.170462 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.170432    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:25.216492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.216404    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-config-file\") pod \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") "
Jul 13 17:29:25.216492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.216452    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnmbz\" (UniqueName: \"kubernetes.io/projected/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-kube-api-access-jnmbz\") pod \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\" (UID: \"e3175bc0-7f7b-479d-b6b2-23472c0d7e71\") "
Jul 13 17:29:25.216855 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.216825    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-config-file" (OuterVolumeSpecName: "config-file") pod "e3175bc0-7f7b-479d-b6b2-23472c0d7e71" (UID: "e3175bc0-7f7b-479d-b6b2-23472c0d7e71"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:29:25.218699 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.218671    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-kube-api-access-jnmbz" (OuterVolumeSpecName: "kube-api-access-jnmbz") pod "e3175bc0-7f7b-479d-b6b2-23472c0d7e71" (UID: "e3175bc0-7f7b-479d-b6b2-23472c0d7e71"). InnerVolumeSpecName "kube-api-access-jnmbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:29:25.279523 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.279490    2577 generic.go:356] "Generic (PLEG): container finished" podID="e3175bc0-7f7b-479d-b6b2-23472c0d7e71" containerID="e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e" exitCode=0
Jul 13 17:29:25.279695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.279531    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"
Jul 13 17:29:25.279695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.279570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv" event={"ID":"e3175bc0-7f7b-479d-b6b2-23472c0d7e71","Type":"ContainerDied","Data":"e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e"}
Jul 13 17:29:25.279695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.279627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hnsbv" event={"ID":"e3175bc0-7f7b-479d-b6b2-23472c0d7e71","Type":"ContainerDied","Data":"85fb38ce348dd85e9eba38258c13553a239fae6c0103557c05d3756426c73140"}
Jul 13 17:29:25.279695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.279656    2577 scope.go:117] "RemoveContainer" containerID="e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e"
Jul 13 17:29:25.288373 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.288353    2577 scope.go:117] "RemoveContainer" containerID="e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e"
Jul 13 17:29:25.288645 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:29:25.288623    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e\": container with ID starting with e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e not found: ID does not exist" containerID="e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e"
Jul 13 17:29:25.288697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.288656    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e"} err="failed to get container status \"e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e\": rpc error: code = NotFound desc = could not find container \"e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e\": container with ID starting with e7a30a1416bdc6d1b135b6f6a0ebbbaac3b3e2135db6148c50f1ea53423e4c1e not found: ID does not exist"
Jul 13 17:29:25.301564 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.301535    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:25.305428 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.305401    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hnsbv"]
Jul 13 17:29:25.317866 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.317837    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-config-file\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:29:25.317866 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:25.317865    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnmbz\" (UniqueName: \"kubernetes.io/projected/e3175bc0-7f7b-479d-b6b2-23472c0d7e71-kube-api-access-jnmbz\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:29:26.422160 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:26.422128    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3175bc0-7f7b-479d-b6b2-23472c0d7e71" path="/var/lib/kubelet/pods/e3175bc0-7f7b-479d-b6b2-23472c0d7e71/volumes"
Jul 13 17:29:27.500943 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.500912    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"]
Jul 13 17:29:27.501349 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.501334    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3175bc0-7f7b-479d-b6b2-23472c0d7e71" containerName="limitador"
Jul 13 17:29:27.501349 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.501347    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3175bc0-7f7b-479d-b6b2-23472c0d7e71" containerName="limitador"
Jul 13 17:29:27.501428 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.501420    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3175bc0-7f7b-479d-b6b2-23472c0d7e71" containerName="limitador"
Jul 13 17:29:27.505884 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.505865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.508631 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.508611    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 17:29:27.508777 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.508758    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 17:29:27.509487 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.509471    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qjl4d\""
Jul 13 17:29:27.510457 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.510431    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 17:29:27.518491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.518466    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"]
Jul 13 17:29:27.639667 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.639631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc2n6\" (UniqueName: \"kubernetes.io/projected/d48577ac-2cce-4ffe-9964-04e6312bde98-kube-api-access-qc2n6\") pod \"postgres-69fb4594cf-kdnss\" (UID: \"d48577ac-2cce-4ffe-9964-04e6312bde98\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.639842 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.639677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d48577ac-2cce-4ffe-9964-04e6312bde98-data\") pod \"postgres-69fb4594cf-kdnss\" (UID: \"d48577ac-2cce-4ffe-9964-04e6312bde98\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.740324 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.740275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc2n6\" (UniqueName: \"kubernetes.io/projected/d48577ac-2cce-4ffe-9964-04e6312bde98-kube-api-access-qc2n6\") pod \"postgres-69fb4594cf-kdnss\" (UID: \"d48577ac-2cce-4ffe-9964-04e6312bde98\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.740528 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.740366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d48577ac-2cce-4ffe-9964-04e6312bde98-data\") pod \"postgres-69fb4594cf-kdnss\" (UID: \"d48577ac-2cce-4ffe-9964-04e6312bde98\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.740699 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.740682    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d48577ac-2cce-4ffe-9964-04e6312bde98-data\") pod \"postgres-69fb4594cf-kdnss\" (UID: \"d48577ac-2cce-4ffe-9964-04e6312bde98\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.752194 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.752138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc2n6\" (UniqueName: \"kubernetes.io/projected/d48577ac-2cce-4ffe-9964-04e6312bde98-kube-api-access-qc2n6\") pod \"postgres-69fb4594cf-kdnss\" (UID: \"d48577ac-2cce-4ffe-9964-04e6312bde98\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.815844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.815800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:27.947147 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:27.947122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"]
Jul 13 17:29:27.949788 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:29:27.949765    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48577ac_2cce_4ffe_9964_04e6312bde98.slice/crio-43d6c94d83df171e0c089a92f71f0b3a0076ec034a95f03042214bd2049e396e WatchSource:0}: Error finding container 43d6c94d83df171e0c089a92f71f0b3a0076ec034a95f03042214bd2049e396e: Status 404 returned error can't find the container with id 43d6c94d83df171e0c089a92f71f0b3a0076ec034a95f03042214bd2049e396e
Jul 13 17:29:28.296313 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:28.296258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss" event={"ID":"d48577ac-2cce-4ffe-9964-04e6312bde98","Type":"ContainerStarted","Data":"43d6c94d83df171e0c089a92f71f0b3a0076ec034a95f03042214bd2049e396e"}
Jul 13 17:29:33.327882 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:33.327842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss" event={"ID":"d48577ac-2cce-4ffe-9964-04e6312bde98","Type":"ContainerStarted","Data":"6970abd8359ce05dc98d94ba70f15f425745b1fed874d0f5e5ffd2e497e34ff0"}
Jul 13 17:29:33.328336 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:33.327909    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:33.344416 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:33.344355    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss" podStartSLOduration=1.46277527 podStartE2EDuration="6.344336411s" totalImagesPullingTime="4.881561141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:33.3442581 +0000 UTC m=+711.422450153" watchObservedRunningTime="2026-07-13 17:29:33.344336411 +0000 UTC m=+711.422528468"
Jul 13 17:29:39.363731 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:39.363701    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kdnss"
Jul 13 17:29:42.749437 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:42.749405    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x554v"]
Jul 13 17:29:42.749899 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:42.749605    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-x554v" podUID="a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" containerName="authorino" containerID="cri-o://4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685" gracePeriod=30
Jul 13 17:29:43.005157 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.005094    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:43.190097 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.190063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qfmz\" (UniqueName: \"kubernetes.io/projected/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5-kube-api-access-7qfmz\") pod \"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5\" (UID: \"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5\") "
Jul 13 17:29:43.192163 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.192134    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5-kube-api-access-7qfmz" (OuterVolumeSpecName: "kube-api-access-7qfmz") pod "a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" (UID: "a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5"). InnerVolumeSpecName "kube-api-access-7qfmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:29:43.291553 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.291484    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qfmz\" (UniqueName: \"kubernetes.io/projected/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5-kube-api-access-7qfmz\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:29:43.377228 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.377198    2577 generic.go:356] "Generic (PLEG): container finished" podID="a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" containerID="4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685" exitCode=0
Jul 13 17:29:43.377382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.377236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x554v" event={"ID":"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5","Type":"ContainerDied","Data":"4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685"}
Jul 13 17:29:43.377382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.377241    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x554v"
Jul 13 17:29:43.377382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.377264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x554v" event={"ID":"a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5","Type":"ContainerDied","Data":"e95fb895c294a6e4bba5cd5389fe98ba80e134b88b2b8598d2359f233f72412c"}
Jul 13 17:29:43.377382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.377282    2577 scope.go:117] "RemoveContainer" containerID="4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685"
Jul 13 17:29:43.385515 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.385499    2577 scope.go:117] "RemoveContainer" containerID="4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685"
Jul 13 17:29:43.385741 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:29:43.385724    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685\": container with ID starting with 4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685 not found: ID does not exist" containerID="4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685"
Jul 13 17:29:43.385784 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.385748    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685"} err="failed to get container status \"4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685\": rpc error: code = NotFound desc = could not find container \"4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685\": container with ID starting with 4b26faa7dfbe35858297edea4cc9779a07ad9bad7f94f0a423c279803f755685 not found: ID does not exist"
Jul 13 17:29:43.399411 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.399388    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x554v"]
Jul 13 17:29:43.403927 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:43.403906    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x554v"]
Jul 13 17:29:44.421216 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:44.421179    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" path="/var/lib/kubelet/pods/a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5/volumes"
Jul 13 17:29:49.542073 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.542030    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-595f7d8747-8xn5p"]
Jul 13 17:29:49.542587 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.542512    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" containerName="authorino"
Jul 13 17:29:49.542587 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.542530    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" containerName="authorino"
Jul 13 17:29:49.542711 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.542609    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5bb9b5a-6dcc-4d73-a5a7-c1525bdf99e5" containerName="authorino"
Jul 13 17:29:49.561784 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.561752    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-595f7d8747-8xn5p"]
Jul 13 17:29:49.561954 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.561897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.564868 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.564840    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 17:29:49.566219 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.566191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vv9zn\""
Jul 13 17:29:49.566389 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.566201    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 17:29:49.643508 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.643467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f72a093d-8dfa-426e-954c-5362b2426522-webhook-cert\") pod \"maas-controller-595f7d8747-8xn5p\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") " pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.643508 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.643508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65s4j\" (UniqueName: \"kubernetes.io/projected/f72a093d-8dfa-426e-954c-5362b2426522-kube-api-access-65s4j\") pod \"maas-controller-595f7d8747-8xn5p\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") " pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.744665 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.744631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f72a093d-8dfa-426e-954c-5362b2426522-webhook-cert\") pod \"maas-controller-595f7d8747-8xn5p\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") " pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.744665 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.744666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65s4j\" (UniqueName: \"kubernetes.io/projected/f72a093d-8dfa-426e-954c-5362b2426522-kube-api-access-65s4j\") pod \"maas-controller-595f7d8747-8xn5p\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") " pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.747130 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.747102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f72a093d-8dfa-426e-954c-5362b2426522-webhook-cert\") pod \"maas-controller-595f7d8747-8xn5p\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") " pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.755079 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.755048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65s4j\" (UniqueName: \"kubernetes.io/projected/f72a093d-8dfa-426e-954c-5362b2426522-kube-api-access-65s4j\") pod \"maas-controller-595f7d8747-8xn5p\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") " pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:49.875954 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:49.875845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:50.013150 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:50.013123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-595f7d8747-8xn5p"]
Jul 13 17:29:50.015158 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:29:50.015135    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72a093d_8dfa_426e_954c_5362b2426522.slice/crio-319e30517fab50d9fde087903900a494bf765cd887ac1821d18dd5823368a458 WatchSource:0}: Error finding container 319e30517fab50d9fde087903900a494bf765cd887ac1821d18dd5823368a458: Status 404 returned error can't find the container with id 319e30517fab50d9fde087903900a494bf765cd887ac1821d18dd5823368a458
Jul 13 17:29:50.413213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:50.413173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595f7d8747-8xn5p" event={"ID":"f72a093d-8dfa-426e-954c-5362b2426522","Type":"ContainerStarted","Data":"319e30517fab50d9fde087903900a494bf765cd887ac1821d18dd5823368a458"}
Jul 13 17:29:53.431358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:53.431316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595f7d8747-8xn5p" event={"ID":"f72a093d-8dfa-426e-954c-5362b2426522","Type":"ContainerStarted","Data":"0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8"}
Jul 13 17:29:53.431760 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:53.431388    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:29:53.449168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:29:53.449104    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-595f7d8747-8xn5p" podStartSLOduration=1.747575622 podStartE2EDuration="4.44908334s" totalImagesPullingTime="2.701507718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:53.4482187 +0000 UTC m=+731.526410751" watchObservedRunningTime="2026-07-13 17:29:53.44908334 +0000 UTC m=+731.527275390"
Jul 13 17:30:04.438761 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:04.438731    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:30:25.711185 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.711139    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-82vqm"]
Jul 13 17:30:25.716349 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.716317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:25.719845 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.719819    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 17:30:25.720492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.720454    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 17:30:25.720492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.720480    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rl9r4\""
Jul 13 17:30:25.720666 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.720502    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 17:30:25.736870 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.736841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-82vqm"]
Jul 13 17:30:25.746324 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.746274    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"]
Jul 13 17:30:25.748985 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.748961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.773934 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.773890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"]
Jul 13 17:30:25.876524 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.876483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76c2fe7-d56c-4c93-8d2c-db27f499c9c1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-82vqm\" (UID: \"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:25.876708 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.876532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/882b93cb-35e9-4299-bfe3-c8c7e52a26e1-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-kv6fl\" (UID: \"882b93cb-35e9-4299-bfe3-c8c7e52a26e1\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.876708 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.876642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cdh2\" (UniqueName: \"kubernetes.io/projected/882b93cb-35e9-4299-bfe3-c8c7e52a26e1-kube-api-access-6cdh2\") pod \"payload-pre-processing-74584bb9f8-kv6fl\" (UID: \"882b93cb-35e9-4299-bfe3-c8c7e52a26e1\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.876808 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.876724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq22m\" (UniqueName: \"kubernetes.io/projected/d76c2fe7-d56c-4c93-8d2c-db27f499c9c1-kube-api-access-zq22m\") pod \"payload-processing-f9b8d9b9b-82vqm\" (UID: \"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:25.977672 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.977565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76c2fe7-d56c-4c93-8d2c-db27f499c9c1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-82vqm\" (UID: \"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:25.977672 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.977617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/882b93cb-35e9-4299-bfe3-c8c7e52a26e1-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-kv6fl\" (UID: \"882b93cb-35e9-4299-bfe3-c8c7e52a26e1\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.977672 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.977673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdh2\" (UniqueName: \"kubernetes.io/projected/882b93cb-35e9-4299-bfe3-c8c7e52a26e1-kube-api-access-6cdh2\") pod \"payload-pre-processing-74584bb9f8-kv6fl\" (UID: \"882b93cb-35e9-4299-bfe3-c8c7e52a26e1\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.977969 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.977721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq22m\" (UniqueName: \"kubernetes.io/projected/d76c2fe7-d56c-4c93-8d2c-db27f499c9c1-kube-api-access-zq22m\") pod \"payload-processing-f9b8d9b9b-82vqm\" (UID: \"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:25.978366 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.978344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d76c2fe7-d56c-4c93-8d2c-db27f499c9c1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-82vqm\" (UID: \"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:25.978568 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.978549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/882b93cb-35e9-4299-bfe3-c8c7e52a26e1-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-kv6fl\" (UID: \"882b93cb-35e9-4299-bfe3-c8c7e52a26e1\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.990510 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.990483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cdh2\" (UniqueName: \"kubernetes.io/projected/882b93cb-35e9-4299-bfe3-c8c7e52a26e1-kube-api-access-6cdh2\") pod \"payload-pre-processing-74584bb9f8-kv6fl\" (UID: \"882b93cb-35e9-4299-bfe3-c8c7e52a26e1\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:25.990510 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:25.990493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq22m\" (UniqueName: \"kubernetes.io/projected/d76c2fe7-d56c-4c93-8d2c-db27f499c9c1-kube-api-access-zq22m\") pod \"payload-processing-f9b8d9b9b-82vqm\" (UID: \"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:26.027459 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:26.027422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:26.059840 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:26.059808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:26.188231 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:26.188197    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-82vqm"]
Jul 13 17:30:26.190497 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:30:26.190461    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76c2fe7_d56c_4c93_8d2c_db27f499c9c1.slice/crio-d1f8e14ee5e53ac15194f99054d81469db499b7cc8a78230dc1dff7c222919e9 WatchSource:0}: Error finding container d1f8e14ee5e53ac15194f99054d81469db499b7cc8a78230dc1dff7c222919e9: Status 404 returned error can't find the container with id d1f8e14ee5e53ac15194f99054d81469db499b7cc8a78230dc1dff7c222919e9
Jul 13 17:30:26.216542 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:26.216513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"]
Jul 13 17:30:26.218500 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:30:26.218472    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882b93cb_35e9_4299_bfe3_c8c7e52a26e1.slice/crio-4564c2a296e6e9c20c9beff6d2dd2528e8495ec1efef955686e25bf10718737b WatchSource:0}: Error finding container 4564c2a296e6e9c20c9beff6d2dd2528e8495ec1efef955686e25bf10718737b: Status 404 returned error can't find the container with id 4564c2a296e6e9c20c9beff6d2dd2528e8495ec1efef955686e25bf10718737b
Jul 13 17:30:26.606211 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:26.606168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl" event={"ID":"882b93cb-35e9-4299-bfe3-c8c7e52a26e1","Type":"ContainerStarted","Data":"4564c2a296e6e9c20c9beff6d2dd2528e8495ec1efef955686e25bf10718737b"}
Jul 13 17:30:26.607543 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:26.607511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm" event={"ID":"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1","Type":"ContainerStarted","Data":"d1f8e14ee5e53ac15194f99054d81469db499b7cc8a78230dc1dff7c222919e9"}
Jul 13 17:30:28.620931 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:28.620888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm" event={"ID":"d76c2fe7-d56c-4c93-8d2c-db27f499c9c1","Type":"ContainerStarted","Data":"fcda9672e3664aee3202290fe34f1987f04a35034fc28462561ca0ec86c64904"}
Jul 13 17:30:28.621457 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:28.620959    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:28.622427 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:28.622399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl" event={"ID":"882b93cb-35e9-4299-bfe3-c8c7e52a26e1","Type":"ContainerStarted","Data":"5fc130d6273481bdf31497fa87bc099e18201c8a2a8c5a4ebd1bb4b4f9c7ea94"}
Jul 13 17:30:28.622541 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:28.622527    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:28.639633 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:28.639563    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm" podStartSLOduration=1.846452794 podStartE2EDuration="3.639539177s" totalImagesPullingTime="1.793086383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:30:28.63758105 +0000 UTC m=+766.715773113" watchObservedRunningTime="2026-07-13 17:30:28.639539177 +0000 UTC m=+766.717731228"
Jul 13 17:30:28.654382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:28.654286    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl" podStartSLOduration=1.8908187220000001 podStartE2EDuration="3.654266855s" totalImagesPullingTime="1.763448133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:30:28.653324323 +0000 UTC m=+766.731516376" watchObservedRunningTime="2026-07-13 17:30:28.654266855 +0000 UTC m=+766.732458941"
Jul 13 17:30:39.628836 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:39.628799    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-82vqm"
Jul 13 17:30:39.629217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:39.628904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-kv6fl"
Jul 13 17:30:44.396015 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.395977    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"]
Jul 13 17:30:44.401227 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.401205    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.405518 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.405491    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 17:30:44.405518 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.405510    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 17:30:44.405704 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.405491    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 17:30:44.405704 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.405495    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-srn9x\""
Jul 13 17:30:44.412838 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.412812    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"]
Jul 13 17:30:44.448778 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.448741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4ee986-6a4b-4d60-b89a-befb6791aca3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.448957 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.448861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.448957 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.448894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.448957 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.448911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.448957 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.448933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.449209 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.449011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxkk\" (UniqueName: \"kubernetes.io/projected/1a4ee986-6a4b-4d60-b89a-befb6791aca3-kube-api-access-fmxkk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550328 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550517 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550517 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550621 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550679 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxkk\" (UniqueName: \"kubernetes.io/projected/1a4ee986-6a4b-4d60-b89a-befb6791aca3-kube-api-access-fmxkk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550733 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4ee986-6a4b-4d60-b89a-befb6791aca3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550810 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550864 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.550933 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.550900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.552623 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.552591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4ee986-6a4b-4d60-b89a-befb6791aca3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.553022 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.553003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4ee986-6a4b-4d60-b89a-befb6791aca3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.562849 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.562825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxkk\" (UniqueName: \"kubernetes.io/projected/1a4ee986-6a4b-4d60-b89a-befb6791aca3-kube-api-access-fmxkk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4\" (UID: \"1a4ee986-6a4b-4d60-b89a-befb6791aca3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.712233 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.712147    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:44.848641 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:44.848599    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"]
Jul 13 17:30:44.851620 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:30:44.851594    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4ee986_6a4b_4d60_b89a_befb6791aca3.slice/crio-6973ab5a958b723a57bca4c8dfc0bb2e78b099d22d229a2e3cf2deb10d00edec WatchSource:0}: Error finding container 6973ab5a958b723a57bca4c8dfc0bb2e78b099d22d229a2e3cf2deb10d00edec: Status 404 returned error can't find the container with id 6973ab5a958b723a57bca4c8dfc0bb2e78b099d22d229a2e3cf2deb10d00edec
Jul 13 17:30:45.712567 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:45.712527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4" event={"ID":"1a4ee986-6a4b-4d60-b89a-befb6791aca3","Type":"ContainerStarted","Data":"6973ab5a958b723a57bca4c8dfc0bb2e78b099d22d229a2e3cf2deb10d00edec"}
Jul 13 17:30:46.718970 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:46.718934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4" event={"ID":"1a4ee986-6a4b-4d60-b89a-befb6791aca3","Type":"ContainerStarted","Data":"b62e6cd6d796b30ced2ca500c9912ff7e9ac7e108c9da8a8b4fbeb9ea4481fa5"}
Jul 13 17:30:46.738767 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:46.738692    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4" podStartSLOduration=1.641889017 podStartE2EDuration="2.738675384s" totalImagesPullingTime="1.096786367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:30:46.736322818 +0000 UTC m=+784.814514881" watchObservedRunningTime="2026-07-13 17:30:46.738675384 +0000 UTC m=+784.816867436"
Jul 13 17:30:54.713167 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:54.713121    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:54.713621 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:54.713201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:54.725690 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:54.725661    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:30:54.772286 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:30:54.772256    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4"
Jul 13 17:31:03.186956 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.186924    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"]
Jul 13 17:31:03.193174 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.193148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.195946 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.195928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 13 17:31:03.204542 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.204517    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"]
Jul 13 17:31:03.346077 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.346039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.346235 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.346083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.346235 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.346122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.346235 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.346167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.346235 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.346188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4s6v\" (UniqueName: \"kubernetes.io/projected/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-kube-api-access-c4s6v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.346235 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.346219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447204 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447204 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4s6v\" (UniqueName: \"kubernetes.io/projected/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-kube-api-access-c4s6v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447654 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447627    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447777 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.447777 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.447754    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.449643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.449618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.449728 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.449706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.455773 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.455746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4s6v\" (UniqueName: \"kubernetes.io/projected/906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8-kube-api-access-c4s6v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bmq2x\" (UID: \"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.504565 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.504527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:03.653993 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.650649    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"]
Jul 13 17:31:03.655609 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:31:03.655573    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906e545e_5b1c_4a44_aaad_3ff8b8b3a5f8.slice/crio-e2d95fdef5cc0ae8e737b3572f5b4c605da95f5c0f34941d8cadc40255cc3c11 WatchSource:0}: Error finding container e2d95fdef5cc0ae8e737b3572f5b4c605da95f5c0f34941d8cadc40255cc3c11: Status 404 returned error can't find the container with id e2d95fdef5cc0ae8e737b3572f5b4c605da95f5c0f34941d8cadc40255cc3c11
Jul 13 17:31:03.808530 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:03.808493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x" event={"ID":"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8","Type":"ContainerStarted","Data":"e2d95fdef5cc0ae8e737b3572f5b4c605da95f5c0f34941d8cadc40255cc3c11"}
Jul 13 17:31:04.815530 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:04.815495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x" event={"ID":"906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8","Type":"ContainerStarted","Data":"6c390dab4bee06d7a2f3a844f12a92cab8a7b53c7dc725aa100c3d71ee2d8c30"}
Jul 13 17:31:04.835738 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:04.835689    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x" podStartSLOduration=1.6339211919999999 podStartE2EDuration="1.835671581s" totalImagesPullingTime="201.750389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:31:04.833894791 +0000 UTC m=+802.912086842" watchObservedRunningTime="2026-07-13 17:31:04.835671581 +0000 UTC m=+802.913863628"
Jul 13 17:31:13.505680 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:13.505640    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:13.506103 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:13.505712    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:13.518484 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:13.518454    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:31:13.872180 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:31:13.872087    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bmq2x"
Jul 13 17:32:42.346534 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:32:42.346508    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:32:42.349333 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:32:42.349292    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:32:42.351079 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:32:42.351055    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:32:42.353650 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:32:42.353623    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:33:39.753694 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:39.753655    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-595f7d8747-8xn5p"]
Jul 13 17:33:39.756136 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:39.753897    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-595f7d8747-8xn5p" podUID="f72a093d-8dfa-426e-954c-5362b2426522" containerName="manager" containerID="cri-o://0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8" gracePeriod=30
Jul 13 17:33:40.013971 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.013895    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:33:40.128075 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.128034    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f72a093d-8dfa-426e-954c-5362b2426522-webhook-cert\") pod \"f72a093d-8dfa-426e-954c-5362b2426522\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") "
Jul 13 17:33:40.128269 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.128161    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65s4j\" (UniqueName: \"kubernetes.io/projected/f72a093d-8dfa-426e-954c-5362b2426522-kube-api-access-65s4j\") pod \"f72a093d-8dfa-426e-954c-5362b2426522\" (UID: \"f72a093d-8dfa-426e-954c-5362b2426522\") "
Jul 13 17:33:40.130451 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.130416    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72a093d-8dfa-426e-954c-5362b2426522-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f72a093d-8dfa-426e-954c-5362b2426522" (UID: "f72a093d-8dfa-426e-954c-5362b2426522"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:33:40.130451 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.130435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72a093d-8dfa-426e-954c-5362b2426522-kube-api-access-65s4j" (OuterVolumeSpecName: "kube-api-access-65s4j") pod "f72a093d-8dfa-426e-954c-5362b2426522" (UID: "f72a093d-8dfa-426e-954c-5362b2426522"). InnerVolumeSpecName "kube-api-access-65s4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:33:40.229356 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.229268    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65s4j\" (UniqueName: \"kubernetes.io/projected/f72a093d-8dfa-426e-954c-5362b2426522-kube-api-access-65s4j\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:33:40.229356 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.229350    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f72a093d-8dfa-426e-954c-5362b2426522-webhook-cert\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:33:40.644520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.644479    2577 generic.go:356] "Generic (PLEG): container finished" podID="f72a093d-8dfa-426e-954c-5362b2426522" containerID="0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8" exitCode=0
Jul 13 17:33:40.644520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.644516    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595f7d8747-8xn5p"
Jul 13 17:33:40.644774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.644554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595f7d8747-8xn5p" event={"ID":"f72a093d-8dfa-426e-954c-5362b2426522","Type":"ContainerDied","Data":"0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8"}
Jul 13 17:33:40.644774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.644617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595f7d8747-8xn5p" event={"ID":"f72a093d-8dfa-426e-954c-5362b2426522","Type":"ContainerDied","Data":"319e30517fab50d9fde087903900a494bf765cd887ac1821d18dd5823368a458"}
Jul 13 17:33:40.644774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.644651    2577 scope.go:117] "RemoveContainer" containerID="0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8"
Jul 13 17:33:40.654430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.654408    2577 scope.go:117] "RemoveContainer" containerID="0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8"
Jul 13 17:33:40.654748 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:33:40.654727    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8\": container with ID starting with 0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8 not found: ID does not exist" containerID="0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8"
Jul 13 17:33:40.654785 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.654763    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8"} err="failed to get container status \"0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8\": rpc error: code = NotFound desc = could not find container \"0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8\": container with ID starting with 0d6314950289a7d645b68406ff65a96ac6e3a0a23172844ff9fa4a6bf32054b8 not found: ID does not exist"
Jul 13 17:33:40.667380 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.667345    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-595f7d8747-8xn5p"]
Jul 13 17:33:40.670932 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:40.670901    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-595f7d8747-8xn5p"]
Jul 13 17:33:41.559537 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.559504    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-595f7d8747-9hxng"]
Jul 13 17:33:41.559941 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.559930    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72a093d-8dfa-426e-954c-5362b2426522" containerName="manager"
Jul 13 17:33:41.559941 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.559940    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72a093d-8dfa-426e-954c-5362b2426522" containerName="manager"
Jul 13 17:33:41.560034 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.560021    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72a093d-8dfa-426e-954c-5362b2426522" containerName="manager"
Jul 13 17:33:41.564397 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.564374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.568215 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.568192    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vv9zn\""
Jul 13 17:33:41.568753 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.568721    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 17:33:41.568935 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.568921    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 17:33:41.575928 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.575901    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-595f7d8747-9hxng"]
Jul 13 17:33:41.644380 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.644342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddl8\" (UniqueName: \"kubernetes.io/projected/620f5d34-580c-4898-8d7d-e5e035d16680-kube-api-access-gddl8\") pod \"maas-controller-595f7d8747-9hxng\" (UID: \"620f5d34-580c-4898-8d7d-e5e035d16680\") " pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.644557 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.644400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/620f5d34-580c-4898-8d7d-e5e035d16680-webhook-cert\") pod \"maas-controller-595f7d8747-9hxng\" (UID: \"620f5d34-580c-4898-8d7d-e5e035d16680\") " pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.744981 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.744936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gddl8\" (UniqueName: \"kubernetes.io/projected/620f5d34-580c-4898-8d7d-e5e035d16680-kube-api-access-gddl8\") pod \"maas-controller-595f7d8747-9hxng\" (UID: \"620f5d34-580c-4898-8d7d-e5e035d16680\") " pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.745189 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.745005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/620f5d34-580c-4898-8d7d-e5e035d16680-webhook-cert\") pod \"maas-controller-595f7d8747-9hxng\" (UID: \"620f5d34-580c-4898-8d7d-e5e035d16680\") " pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.747571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.747536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/620f5d34-580c-4898-8d7d-e5e035d16680-webhook-cert\") pod \"maas-controller-595f7d8747-9hxng\" (UID: \"620f5d34-580c-4898-8d7d-e5e035d16680\") " pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.758844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.758806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddl8\" (UniqueName: \"kubernetes.io/projected/620f5d34-580c-4898-8d7d-e5e035d16680-kube-api-access-gddl8\") pod \"maas-controller-595f7d8747-9hxng\" (UID: \"620f5d34-580c-4898-8d7d-e5e035d16680\") " pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:41.876380 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:41.876257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:42.029664 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.029638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-595f7d8747-9hxng"]
Jul 13 17:33:42.032076 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:33:42.032046    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620f5d34_580c_4898_8d7d_e5e035d16680.slice/crio-e92c6fd7860bfb67cbbb74cbe25d13f32a83d830a692b9458c9ad30151eebfb7 WatchSource:0}: Error finding container e92c6fd7860bfb67cbbb74cbe25d13f32a83d830a692b9458c9ad30151eebfb7: Status 404 returned error can't find the container with id e92c6fd7860bfb67cbbb74cbe25d13f32a83d830a692b9458c9ad30151eebfb7
Jul 13 17:33:42.426668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.426637    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f72a093d-8dfa-426e-954c-5362b2426522" path="/var/lib/kubelet/pods/f72a093d-8dfa-426e-954c-5362b2426522/volumes"
Jul 13 17:33:42.530759 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.530732    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 17:33:42.658213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.658122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595f7d8747-9hxng" event={"ID":"620f5d34-580c-4898-8d7d-e5e035d16680","Type":"ContainerStarted","Data":"0482fb331f769236bcb0d3f096f109159abfdf94c5c48032431abe0aa297016d"}
Jul 13 17:33:42.658213 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.658181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-595f7d8747-9hxng" event={"ID":"620f5d34-580c-4898-8d7d-e5e035d16680","Type":"ContainerStarted","Data":"e92c6fd7860bfb67cbbb74cbe25d13f32a83d830a692b9458c9ad30151eebfb7"}
Jul 13 17:33:42.658718 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.658245    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:33:42.685004 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:42.684929    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-595f7d8747-9hxng" podStartSLOduration=1.1910272960000001 podStartE2EDuration="1.684910758s" totalImagesPullingTime="493.883462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:42.682716695 +0000 UTC m=+960.760908751" watchObservedRunningTime="2026-07-13 17:33:42.684910758 +0000 UTC m=+960.763102808"
Jul 13 17:33:53.665445 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:33:53.665413    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-595f7d8747-9hxng"
Jul 13 17:37:42.378449 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:37:42.378416    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:37:42.382671 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:37:42.382638    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:37:42.382911 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:37:42.382896    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:37:42.387667 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:37:42.387647    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:42:42.421774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:42:42.421735    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:42:42.426835 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:42:42.426804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:42:42.427550 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:42:42.427531    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:42:42.432157 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:42:42.432135    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:45:00.157485 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.157404    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"]
Jul 13 17:45:00.160868 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.160850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"
Jul 13 17:45:00.163686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.163660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:45:00.170774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.170750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"
Jul 13 17:45:00.190317 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.190269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"]
Jul 13 17:45:00.312233 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.312114    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"]
Jul 13 17:45:00.314742 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:45:00.314715    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc390a50c_509d_4d47_a121_8c90967ff41f.slice/crio-9ae1d953c73949a5213fd2fdac8ffaf97c0b2d033bf2c00124ab1f3234bfebc2 WatchSource:0}: Error finding container 9ae1d953c73949a5213fd2fdac8ffaf97c0b2d033bf2c00124ab1f3234bfebc2: Status 404 returned error can't find the container with id 9ae1d953c73949a5213fd2fdac8ffaf97c0b2d033bf2c00124ab1f3234bfebc2
Jul 13 17:45:00.316862 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:00.316845    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:45:01.164962 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:01.164928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42" event={"ID":"c390a50c-509d-4d47-a121-8c90967ff41f","Type":"ContainerStarted","Data":"9ae1d953c73949a5213fd2fdac8ffaf97c0b2d033bf2c00124ab1f3234bfebc2"}
Jul 13 17:45:03.176845 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:03.176806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42" event={"ID":"c390a50c-509d-4d47-a121-8c90967ff41f","Type":"ContainerStarted","Data":"5685ddec455457ef536eecd6838fe134fa282f3d1fbc75eef6ff724dfafcc09a"}
Jul 13 17:45:03.196953 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:03.196888    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42" podStartSLOduration=1.131136908 podStartE2EDuration="3.196867402s" totalImagesPullingTime="2.065730494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:45:03.196227169 +0000 UTC m=+1641.274419230" watchObservedRunningTime="2026-07-13 17:45:03.196867402 +0000 UTC m=+1641.275059451"
Jul 13 17:45:04.186760 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:04.186714    2577 generic.go:356] "Generic (PLEG): container finished" podID="c390a50c-509d-4d47-a121-8c90967ff41f" containerID="5685ddec455457ef536eecd6838fe134fa282f3d1fbc75eef6ff724dfafcc09a" exitCode=0
Jul 13 17:45:04.187254 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:04.186889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42" event={"ID":"c390a50c-509d-4d47-a121-8c90967ff41f","Type":"ContainerDied","Data":"5685ddec455457ef536eecd6838fe134fa282f3d1fbc75eef6ff724dfafcc09a"}
Jul 13 17:45:05.342087 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:05.342047    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"
Jul 13 17:45:06.198586 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:06.198558    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42"
Jul 13 17:45:06.198793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:06.198598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732745-bzd42" event={"ID":"c390a50c-509d-4d47-a121-8c90967ff41f","Type":"ContainerDied","Data":"9ae1d953c73949a5213fd2fdac8ffaf97c0b2d033bf2c00124ab1f3234bfebc2"}
Jul 13 17:45:06.198793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:06.198659    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ae1d953c73949a5213fd2fdac8ffaf97c0b2d033bf2c00124ab1f3234bfebc2"
Jul 13 17:45:58.663778 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.663741    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"]
Jul 13 17:45:58.664369 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.664353    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c390a50c-509d-4d47-a121-8c90967ff41f" containerName="cleanup"
Jul 13 17:45:58.664369 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.664370    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c390a50c-509d-4d47-a121-8c90967ff41f" containerName="cleanup"
Jul 13 17:45:58.664465 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.664445    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c390a50c-509d-4d47-a121-8c90967ff41f" containerName="cleanup"
Jul 13 17:45:58.667618 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.667594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.685283 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.685253    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:45:58.703016 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.702984    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ec3f2398-serving-cert\""
Jul 13 17:45:58.705225 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.705199    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"]
Jul 13 17:45:58.765094 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.765053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.765294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.765161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7933bc8f-7793-441a-95b3-fd8b86c6e829-openshift-service-ca\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.765294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.765206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zthh\" (UniqueName: \"kubernetes.io/projected/7933bc8f-7793-441a-95b3-fd8b86c6e829-kube-api-access-2zthh\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.866574 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.866538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.866791 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.866599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7933bc8f-7793-441a-95b3-fd8b86c6e829-openshift-service-ca\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.866791 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.866619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zthh\" (UniqueName: \"kubernetes.io/projected/7933bc8f-7793-441a-95b3-fd8b86c6e829-kube-api-access-2zthh\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.866791 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:45:58.866726    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-serving-cert: secret "maas-api-e2e-ait-ec3f2398-serving-cert" not found
Jul 13 17:45:58.866958 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:45:58.866833    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls podName:7933bc8f-7793-441a-95b3-fd8b86c6e829 nodeName:}" failed. No retries permitted until 2026-07-13 17:45:59.366810098 +0000 UTC m=+1697.445002148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls") pod "maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" (UID: "7933bc8f-7793-441a-95b3-fd8b86c6e829") : secret "maas-api-e2e-ait-ec3f2398-serving-cert" not found
Jul 13 17:45:58.867291 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.867272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7933bc8f-7793-441a-95b3-fd8b86c6e829-openshift-service-ca\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:58.905764 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:58.905730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zthh\" (UniqueName: \"kubernetes.io/projected/7933bc8f-7793-441a-95b3-fd8b86c6e829-kube-api-access-2zthh\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:59.373182 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:59.373142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:59.375646 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:59.375624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls\") pod \"maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:59.579501 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:59.579463    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:45:59.731199 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:45:59.731169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"]
Jul 13 17:45:59.733567 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:45:59.733524    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7933bc8f_7793_441a_95b3_fd8b86c6e829.slice/crio-0ef7c4e34827b2e68a93fda8349c05aaec17e75bb7ecd095ccffa25a2383f7cb WatchSource:0}: Error finding container 0ef7c4e34827b2e68a93fda8349c05aaec17e75bb7ecd095ccffa25a2383f7cb: Status 404 returned error can't find the container with id 0ef7c4e34827b2e68a93fda8349c05aaec17e75bb7ecd095ccffa25a2383f7cb
Jul 13 17:46:00.481189 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:00.481146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" event={"ID":"7933bc8f-7793-441a-95b3-fd8b86c6e829","Type":"ContainerStarted","Data":"0ef7c4e34827b2e68a93fda8349c05aaec17e75bb7ecd095ccffa25a2383f7cb"}
Jul 13 17:46:02.494785 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:02.494744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" event={"ID":"7933bc8f-7793-441a-95b3-fd8b86c6e829","Type":"ContainerStarted","Data":"3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d"}
Jul 13 17:46:02.495185 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:02.494879    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:46:02.526942 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:02.526891    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" podStartSLOduration=2.629137267 podStartE2EDuration="4.526874877s" totalImagesPullingTime="1.89773761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:46:02.524695904 +0000 UTC m=+1700.602887972" watchObservedRunningTime="2026-07-13 17:46:02.526874877 +0000 UTC m=+1700.605066927"
Jul 13 17:46:03.514701 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.514666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"]
Jul 13 17:46:03.518447 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.518425    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:03.522787 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.522764    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:46:03.536348 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.536286    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"]
Jul 13 17:46:03.717217 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.717173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce04fe-c3a4-465e-8201-4d3a85e1bfed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4\" (UID: \"16ce04fe-c3a4-465e-8201-4d3a85e1bfed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:03.818475 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.818375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce04fe-c3a4-465e-8201-4d3a85e1bfed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4\" (UID: \"16ce04fe-c3a4-465e-8201-4d3a85e1bfed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:03.819097 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.819067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce04fe-c3a4-465e-8201-4d3a85e1bfed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4\" (UID: \"16ce04fe-c3a4-465e-8201-4d3a85e1bfed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:03.829312 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.829263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:03.981439 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:03.981406    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"]
Jul 13 17:46:03.984649 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:46:03.984622    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ce04fe_c3a4_465e_8201_4d3a85e1bfed.slice/crio-9bf5da16c0383753de68bd447d738bbb70c4b019a2375424b8d1b3b2a2fe93e2 WatchSource:0}: Error finding container 9bf5da16c0383753de68bd447d738bbb70c4b019a2375424b8d1b3b2a2fe93e2: Status 404 returned error can't find the container with id 9bf5da16c0383753de68bd447d738bbb70c4b019a2375424b8d1b3b2a2fe93e2
Jul 13 17:46:04.508672 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:04.508637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" event={"ID":"16ce04fe-c3a4-465e-8201-4d3a85e1bfed","Type":"ContainerStarted","Data":"48224f65c7684f9b3195426793e6ba1da413af920563215364d97eec81d62a67"}
Jul 13 17:46:04.508857 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:04.508691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" event={"ID":"16ce04fe-c3a4-465e-8201-4d3a85e1bfed","Type":"ContainerStarted","Data":"9bf5da16c0383753de68bd447d738bbb70c4b019a2375424b8d1b3b2a2fe93e2"}
Jul 13 17:46:04.546043 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:04.545987    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" podStartSLOduration=1.545970735 podStartE2EDuration="1.545970735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:46:04.538430261 +0000 UTC m=+1702.616622326" watchObservedRunningTime="2026-07-13 17:46:04.545970735 +0000 UTC m=+1702.624162784"
Jul 13 17:46:05.515824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:05.515790    2577 generic.go:356] "Generic (PLEG): container finished" podID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerID="48224f65c7684f9b3195426793e6ba1da413af920563215364d97eec81d62a67" exitCode=7
Jul 13 17:46:05.516020 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:05.515886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" event={"ID":"16ce04fe-c3a4-465e-8201-4d3a85e1bfed","Type":"ContainerDied","Data":"48224f65c7684f9b3195426793e6ba1da413af920563215364d97eec81d62a67"}
Jul 13 17:46:05.516088 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:05.516075    2577 scope.go:117] "RemoveContainer" containerID="48224f65c7684f9b3195426793e6ba1da413af920563215364d97eec81d62a67"
Jul 13 17:46:06.523738 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:06.523703    2577 generic.go:356] "Generic (PLEG): container finished" podID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerID="6682db853524ee6988f06d246a1fb994020eaf9b3ffb2a03de79320fbd0684c6" exitCode=7
Jul 13 17:46:06.524183 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:06.523764    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" event={"ID":"16ce04fe-c3a4-465e-8201-4d3a85e1bfed","Type":"ContainerDied","Data":"6682db853524ee6988f06d246a1fb994020eaf9b3ffb2a03de79320fbd0684c6"}
Jul 13 17:46:06.524183 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:06.523839    2577 scope.go:117] "RemoveContainer" containerID="48224f65c7684f9b3195426793e6ba1da413af920563215364d97eec81d62a67"
Jul 13 17:46:06.524183 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:06.524110    2577 scope.go:117] "RemoveContainer" containerID="6682db853524ee6988f06d246a1fb994020eaf9b3ffb2a03de79320fbd0684c6"
Jul 13 17:46:06.524390 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:46:06.524372    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4_odh-ai-gateway-infra(16ce04fe-c3a4-465e-8201-4d3a85e1bfed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed"
Jul 13 17:46:07.531021 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:07.530991    2577 scope.go:117] "RemoveContainer" containerID="6682db853524ee6988f06d246a1fb994020eaf9b3ffb2a03de79320fbd0684c6"
Jul 13 17:46:07.531451 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:46:07.531201    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4_odh-ai-gateway-infra(16ce04fe-c3a4-465e-8201-4d3a85e1bfed)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed"
Jul 13 17:46:08.507400 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:08.507368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:46:22.418739 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:22.418712    2577 scope.go:117] "RemoveContainer" containerID="6682db853524ee6988f06d246a1fb994020eaf9b3ffb2a03de79320fbd0684c6"
Jul 13 17:46:23.619491 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:23.619455    2577 generic.go:356] "Generic (PLEG): container finished" podID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerID="153ae01d696817356974cb5d7e900726f7c6387a343d21354e6c945e15933c8e" exitCode=0
Jul 13 17:46:23.619909 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:23.619524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" event={"ID":"16ce04fe-c3a4-465e-8201-4d3a85e1bfed","Type":"ContainerDied","Data":"153ae01d696817356974cb5d7e900726f7c6387a343d21354e6c945e15933c8e"}
Jul 13 17:46:23.619909 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:23.619585    2577 scope.go:117] "RemoveContainer" containerID="6682db853524ee6988f06d246a1fb994020eaf9b3ffb2a03de79320fbd0684c6"
Jul 13 17:46:24.668790 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:24.668754    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"]
Jul 13 17:46:24.771916 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:24.771887    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:24.930141 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:24.930042    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce04fe-c3a4-465e-8201-4d3a85e1bfed-maas-api-service-ca\") pod \"16ce04fe-c3a4-465e-8201-4d3a85e1bfed\" (UID: \"16ce04fe-c3a4-465e-8201-4d3a85e1bfed\") "
Jul 13 17:46:24.930513 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:24.930488    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ce04fe-c3a4-465e-8201-4d3a85e1bfed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "16ce04fe-c3a4-465e-8201-4d3a85e1bfed" (UID: "16ce04fe-c3a4-465e-8201-4d3a85e1bfed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:46:25.031544 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:25.031505    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ce04fe-c3a4-465e-8201-4d3a85e1bfed-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:46:25.633294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:25.633250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4" event={"ID":"16ce04fe-c3a4-465e-8201-4d3a85e1bfed","Type":"ContainerDied","Data":"9bf5da16c0383753de68bd447d738bbb70c4b019a2375424b8d1b3b2a2fe93e2"}
Jul 13 17:46:25.633508 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:25.633333    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bf5da16c0383753de68bd447d738bbb70c4b019a2375424b8d1b3b2a2fe93e2"
Jul 13 17:46:25.633508 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:25.633261    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"
Jul 13 17:46:25.674136 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:25.674095    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"]
Jul 13 17:46:25.676107 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:25.676075    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-dlwb4"]
Jul 13 17:46:26.422650 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:46:26.422617    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" path="/var/lib/kubelet/pods/16ce04fe-c3a4-465e-8201-4d3a85e1bfed/volumes"
Jul 13 17:47:03.566691 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.566642    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"]
Jul 13 17:47:03.567175 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.567088    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:03.567175 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.567099    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:03.567175 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.567116    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:03.567175 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.567122    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:03.567611 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.567201    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:03.567611 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.567211    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:03.570498 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.570478    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:03.573324 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.573272    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:47:03.579832 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.579794    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"]
Jul 13 17:47:03.715279 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.715237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b742d703-2723-4e86-be98-51718e0af516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh\" (UID: \"b742d703-2723-4e86-be98-51718e0af516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:03.816543 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.816503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b742d703-2723-4e86-be98-51718e0af516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh\" (UID: \"b742d703-2723-4e86-be98-51718e0af516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:03.817234 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.817175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b742d703-2723-4e86-be98-51718e0af516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh\" (UID: \"b742d703-2723-4e86-be98-51718e0af516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:03.883780 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:03.883740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:04.033706 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:04.033673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"]
Jul 13 17:47:04.035700 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:47:04.035671    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb742d703_2723_4e86_be98_51718e0af516.slice/crio-2ade67da80013348df717406ddb999a04afa6ac03ecfc6368ceed4e2acef36a7 WatchSource:0}: Error finding container 2ade67da80013348df717406ddb999a04afa6ac03ecfc6368ceed4e2acef36a7: Status 404 returned error can't find the container with id 2ade67da80013348df717406ddb999a04afa6ac03ecfc6368ceed4e2acef36a7
Jul 13 17:47:04.838723 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:04.838685    2577 generic.go:356] "Generic (PLEG): container finished" podID="b742d703-2723-4e86-be98-51718e0af516" containerID="5fc4153c1e999f9a80cd8f66b7c27e4add40a161c69356268a12ea9511c3c056" exitCode=0
Jul 13 17:47:04.839137 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:04.838733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh" event={"ID":"b742d703-2723-4e86-be98-51718e0af516","Type":"ContainerDied","Data":"5fc4153c1e999f9a80cd8f66b7c27e4add40a161c69356268a12ea9511c3c056"}
Jul 13 17:47:04.839137 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:04.838785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh" event={"ID":"b742d703-2723-4e86-be98-51718e0af516","Type":"ContainerStarted","Data":"2ade67da80013348df717406ddb999a04afa6ac03ecfc6368ceed4e2acef36a7"}
Jul 13 17:47:05.990544 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:05.990518    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:06.140077 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:06.139973    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b742d703-2723-4e86-be98-51718e0af516-maas-api-service-ca\") pod \"b742d703-2723-4e86-be98-51718e0af516\" (UID: \"b742d703-2723-4e86-be98-51718e0af516\") "
Jul 13 17:47:06.140386 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:06.140363    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b742d703-2723-4e86-be98-51718e0af516-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b742d703-2723-4e86-be98-51718e0af516" (UID: "b742d703-2723-4e86-be98-51718e0af516"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:47:06.241767 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:06.241728    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b742d703-2723-4e86-be98-51718e0af516-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:47:06.850707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:06.850678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh"
Jul 13 17:47:06.850891 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:06.850730    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh" event={"ID":"b742d703-2723-4e86-be98-51718e0af516","Type":"ContainerDied","Data":"2ade67da80013348df717406ddb999a04afa6ac03ecfc6368ceed4e2acef36a7"}
Jul 13 17:47:06.850891 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:06.850778    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ade67da80013348df717406ddb999a04afa6ac03ecfc6368ceed4e2acef36a7"
Jul 13 17:47:14.137600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.137563    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"]
Jul 13 17:47:14.138054 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.137820    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" podUID="7933bc8f-7793-441a-95b3-fd8b86c6e829" containerName="maas-api" containerID="cri-o://3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d" gracePeriod=30
Jul 13 17:47:14.400455 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.400376    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:47:14.525765 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.525730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7933bc8f-7793-441a-95b3-fd8b86c6e829-openshift-service-ca\") pod \"7933bc8f-7793-441a-95b3-fd8b86c6e829\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") "
Jul 13 17:47:14.525970 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.525790    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls\") pod \"7933bc8f-7793-441a-95b3-fd8b86c6e829\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") "
Jul 13 17:47:14.525970 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.525828    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zthh\" (UniqueName: \"kubernetes.io/projected/7933bc8f-7793-441a-95b3-fd8b86c6e829-kube-api-access-2zthh\") pod \"7933bc8f-7793-441a-95b3-fd8b86c6e829\" (UID: \"7933bc8f-7793-441a-95b3-fd8b86c6e829\") "
Jul 13 17:47:14.526194 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.526168    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7933bc8f-7793-441a-95b3-fd8b86c6e829-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7933bc8f-7793-441a-95b3-fd8b86c6e829" (UID: "7933bc8f-7793-441a-95b3-fd8b86c6e829"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:47:14.528191 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.528157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7933bc8f-7793-441a-95b3-fd8b86c6e829" (UID: "7933bc8f-7793-441a-95b3-fd8b86c6e829"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:47:14.528297 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.528229    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7933bc8f-7793-441a-95b3-fd8b86c6e829-kube-api-access-2zthh" (OuterVolumeSpecName: "kube-api-access-2zthh") pod "7933bc8f-7793-441a-95b3-fd8b86c6e829" (UID: "7933bc8f-7793-441a-95b3-fd8b86c6e829"). InnerVolumeSpecName "kube-api-access-2zthh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:47:14.627529 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.627487    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zthh\" (UniqueName: \"kubernetes.io/projected/7933bc8f-7793-441a-95b3-fd8b86c6e829-kube-api-access-2zthh\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:47:14.627529 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.627521    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7933bc8f-7793-441a-95b3-fd8b86c6e829-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:47:14.627529 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.627533    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7933bc8f-7793-441a-95b3-fd8b86c6e829-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:47:14.896150 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.896112    2577 generic.go:356] "Generic (PLEG): container finished" podID="7933bc8f-7793-441a-95b3-fd8b86c6e829" containerID="3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d" exitCode=0
Jul 13 17:47:14.896395 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.896165    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"
Jul 13 17:47:14.896395 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.896193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" event={"ID":"7933bc8f-7793-441a-95b3-fd8b86c6e829","Type":"ContainerDied","Data":"3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d"}
Jul 13 17:47:14.896395 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.896249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c" event={"ID":"7933bc8f-7793-441a-95b3-fd8b86c6e829","Type":"ContainerDied","Data":"0ef7c4e34827b2e68a93fda8349c05aaec17e75bb7ecd095ccffa25a2383f7cb"}
Jul 13 17:47:14.896395 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.896272    2577 scope.go:117] "RemoveContainer" containerID="3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d"
Jul 13 17:47:14.905757 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.905738    2577 scope.go:117] "RemoveContainer" containerID="3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d"
Jul 13 17:47:14.906058 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:47:14.906038    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d\": container with ID starting with 3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d not found: ID does not exist" containerID="3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d"
Jul 13 17:47:14.906120 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.906066    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d"} err="failed to get container status \"3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d\": rpc error: code = NotFound desc = could not find container \"3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d\": container with ID starting with 3f2b052171d35b045fefef879af165856224b90a4ce0c9c49950d127defa8a2d not found: ID does not exist"
Jul 13 17:47:14.922532 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.922493    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"]
Jul 13 17:47:14.928230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:14.928201    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec3f2398-bf4898c76-rzc8c"]
Jul 13 17:47:16.422287 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:16.422240    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7933bc8f-7793-441a-95b3-fd8b86c6e829" path="/var/lib/kubelet/pods/7933bc8f-7793-441a-95b3-fd8b86c6e829/volumes"
Jul 13 17:47:30.837698 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.837659    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"]
Jul 13 17:47:30.838230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838137    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7933bc8f-7793-441a-95b3-fd8b86c6e829" containerName="maas-api"
Jul 13 17:47:30.838230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838153    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7933bc8f-7793-441a-95b3-fd8b86c6e829" containerName="maas-api"
Jul 13 17:47:30.838230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838183    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:30.838230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838189    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:30.838230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838207    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b742d703-2723-4e86-be98-51718e0af516" containerName="revoke-keys"
Jul 13 17:47:30.838230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838212    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b742d703-2723-4e86-be98-51718e0af516" containerName="revoke-keys"
Jul 13 17:47:30.838587 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838292    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7933bc8f-7793-441a-95b3-fd8b86c6e829" containerName="maas-api"
Jul 13 17:47:30.838587 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838323    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ce04fe-c3a4-465e-8201-4d3a85e1bfed" containerName="revoke-keys"
Jul 13 17:47:30.838587 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.838331    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b742d703-2723-4e86-be98-51718e0af516" containerName="revoke-keys"
Jul 13 17:47:30.843158 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.843062    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.845848 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.845818    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-35a3687f-serving-cert\""
Jul 13 17:47:30.846016 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.845819    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:47:30.858464 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.858426    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"]
Jul 13 17:47:30.880430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.880380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-openshift-service-ca\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.880649 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.880555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgsv\" (UniqueName: \"kubernetes.io/projected/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-kube-api-access-pcgsv\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.880649 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.880582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.981095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.981059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgsv\" (UniqueName: \"kubernetes.io/projected/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-kube-api-access-pcgsv\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.981095 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.981097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.981419 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.981156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-openshift-service-ca\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.981419 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:47:30.981349    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-serving-cert: secret "maas-api-e2e-migrate-35a3687f-serving-cert" not found
Jul 13 17:47:30.981537 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:47:30.981426    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls podName:1ad2b26a-87f3-4855-aa8f-d15b32ffd98b nodeName:}" failed. No retries permitted until 2026-07-13 17:47:31.481405283 +0000 UTC m=+1789.559597313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls") pod "maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" (UID: "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b") : secret "maas-api-e2e-migrate-35a3687f-serving-cert" not found
Jul 13 17:47:30.982041 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.982022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-openshift-service-ca\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:30.993554 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:30.993523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgsv\" (UniqueName: \"kubernetes.io/projected/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-kube-api-access-pcgsv\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:31.488210 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:31.488171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:31.490807 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:31.490782    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls\") pod \"maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:31.754405 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:31.754360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:31.912561 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:31.912220    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"]
Jul 13 17:47:31.916766 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:47:31.916727    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad2b26a_87f3_4855_aa8f_d15b32ffd98b.slice/crio-0ad051323691fd79349737a8e1a5e66ede1b815522350c571145ca3c98ff5fe3 WatchSource:0}: Error finding container 0ad051323691fd79349737a8e1a5e66ede1b815522350c571145ca3c98ff5fe3: Status 404 returned error can't find the container with id 0ad051323691fd79349737a8e1a5e66ede1b815522350c571145ca3c98ff5fe3
Jul 13 17:47:31.991068 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:31.991032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" event={"ID":"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b","Type":"ContainerStarted","Data":"0ad051323691fd79349737a8e1a5e66ede1b815522350c571145ca3c98ff5fe3"}
Jul 13 17:47:32.998137 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:32.998097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" event={"ID":"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b","Type":"ContainerStarted","Data":"25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da"}
Jul 13 17:47:32.998652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:32.998158    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:33.029473 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:33.029409    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" podStartSLOduration=2.587026139 podStartE2EDuration="3.029384562s" totalImagesPullingTime="442.358423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:47:33.028081964 +0000 UTC m=+1791.106274013" watchObservedRunningTime="2026-07-13 17:47:33.029384562 +0000 UTC m=+1791.107576614"
Jul 13 17:47:35.198659 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.198618    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"]
Jul 13 17:47:35.203265 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.203239    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:35.205947 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.205917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:47:35.211811 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.211779    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"]
Jul 13 17:47:35.330100 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.330057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6\" (UID: \"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:35.431016 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.430978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6\" (UID: \"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:35.431673 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.431653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6\" (UID: \"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:35.515819 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.515778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:35.665686 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:35.665651    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"]
Jul 13 17:47:35.669561 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:47:35.669531    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e760e0_e23d_4e53_9e1f_de14bbf38f4e.slice/crio-59f1ca65f73aa6fc7f387886e05305902096cd3d9d2311fa6edfee193add4572 WatchSource:0}: Error finding container 59f1ca65f73aa6fc7f387886e05305902096cd3d9d2311fa6edfee193add4572: Status 404 returned error can't find the container with id 59f1ca65f73aa6fc7f387886e05305902096cd3d9d2311fa6edfee193add4572
Jul 13 17:47:36.016405 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:36.016359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerStarted","Data":"7ce0a60a05998a61aa11af9c0c089aa1cbc02b084e061167f6f4feb8261f613b"}
Jul 13 17:47:36.016583 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:36.016418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerStarted","Data":"59f1ca65f73aa6fc7f387886e05305902096cd3d9d2311fa6edfee193add4572"}
Jul 13 17:47:36.034260 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:36.034205    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" podStartSLOduration=1.034185576 podStartE2EDuration="1.034185576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:47:36.03191395 +0000 UTC m=+1794.110105993" watchObservedRunningTime="2026-07-13 17:47:36.034185576 +0000 UTC m=+1794.112377615"
Jul 13 17:47:37.023120 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:37.023084    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerID="7ce0a60a05998a61aa11af9c0c089aa1cbc02b084e061167f6f4feb8261f613b" exitCode=7
Jul 13 17:47:37.023617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:37.023153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerDied","Data":"7ce0a60a05998a61aa11af9c0c089aa1cbc02b084e061167f6f4feb8261f613b"}
Jul 13 17:47:37.023617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:37.023439    2577 scope.go:117] "RemoveContainer" containerID="7ce0a60a05998a61aa11af9c0c089aa1cbc02b084e061167f6f4feb8261f613b"
Jul 13 17:47:38.032423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:38.032379    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerID="ff2ea663396cc67fb0e8fdf494e19088235db24ff0db1941291b6c6f28a63c8a" exitCode=7
Jul 13 17:47:38.032905 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:38.032451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerDied","Data":"ff2ea663396cc67fb0e8fdf494e19088235db24ff0db1941291b6c6f28a63c8a"}
Jul 13 17:47:38.032905 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:38.032544    2577 scope.go:117] "RemoveContainer" containerID="7ce0a60a05998a61aa11af9c0c089aa1cbc02b084e061167f6f4feb8261f613b"
Jul 13 17:47:38.032905 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:38.032810    2577 scope.go:117] "RemoveContainer" containerID="ff2ea663396cc67fb0e8fdf494e19088235db24ff0db1941291b6c6f28a63c8a"
Jul 13 17:47:38.033108 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:47:38.033085    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6_odh-ai-gateway-infra(b0e760e0-e23d-4e53-9e1f-de14bbf38f4e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e"
Jul 13 17:47:39.008773 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:39.008745    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:47:39.040266 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:39.040233    2577 scope.go:117] "RemoveContainer" containerID="ff2ea663396cc67fb0e8fdf494e19088235db24ff0db1941291b6c6f28a63c8a"
Jul 13 17:47:39.040662 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:47:39.040514    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6_odh-ai-gateway-infra(b0e760e0-e23d-4e53-9e1f-de14bbf38f4e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e"
Jul 13 17:47:42.467852 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:42.467822    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:47:42.473806 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:42.473781    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:47:42.475183 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:42.475152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:47:42.479795 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:42.479768    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:47:54.416094 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:54.416061    2577 scope.go:117] "RemoveContainer" containerID="ff2ea663396cc67fb0e8fdf494e19088235db24ff0db1941291b6c6f28a63c8a"
Jul 13 17:47:55.128077 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:55.128038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerStarted","Data":"e8d4604252e3f148a62c9f231a365d6807135cd72c6ff879082fc7ae62a9835b"}
Jul 13 17:47:56.135611 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:56.135574    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerID="e8d4604252e3f148a62c9f231a365d6807135cd72c6ff879082fc7ae62a9835b" exitCode=0
Jul 13 17:47:56.136047 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:56.135621    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerDied","Data":"e8d4604252e3f148a62c9f231a365d6807135cd72c6ff879082fc7ae62a9835b"}
Jul 13 17:47:56.136047 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:56.135678    2577 scope.go:117] "RemoveContainer" containerID="ff2ea663396cc67fb0e8fdf494e19088235db24ff0db1941291b6c6f28a63c8a"
Jul 13 17:47:56.163638 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:56.163603    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"]
Jul 13 17:47:57.289294 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:57.289258    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:57.350012 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:57.349976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e-maas-api-service-ca\") pod \"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e\" (UID: \"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e\") "
Jul 13 17:47:57.350345 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:57.350323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" (UID: "b0e760e0-e23d-4e53-9e1f-de14bbf38f4e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:47:57.451006 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:57.450913    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:47:58.148106 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:58.148080    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"
Jul 13 17:47:58.148106 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:58.148087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6" event={"ID":"b0e760e0-e23d-4e53-9e1f-de14bbf38f4e","Type":"ContainerDied","Data":"59f1ca65f73aa6fc7f387886e05305902096cd3d9d2311fa6edfee193add4572"}
Jul 13 17:47:58.148356 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:58.148132    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59f1ca65f73aa6fc7f387886e05305902096cd3d9d2311fa6edfee193add4572"
Jul 13 17:47:58.178533 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:58.178492    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"]
Jul 13 17:47:58.184110 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:58.184079    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35a3687f-zqtj6"]
Jul 13 17:47:58.422072 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:47:58.421989    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" path="/var/lib/kubelet/pods/b0e760e0-e23d-4e53-9e1f-de14bbf38f4e/volumes"
Jul 13 17:48:41.112365 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.112329    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"]
Jul 13 17:48:41.112911 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.112580    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" podUID="1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" containerName="maas-api" containerID="cri-o://25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da" gracePeriod=30
Jul 13 17:48:41.375863 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.375790    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:48:41.393770 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.393732    2577 generic.go:356] "Generic (PLEG): container finished" podID="1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" containerID="25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da" exitCode=0
Jul 13 17:48:41.393964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.393778    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"
Jul 13 17:48:41.393964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.393818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" event={"ID":"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b","Type":"ContainerDied","Data":"25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da"}
Jul 13 17:48:41.393964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.393874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7" event={"ID":"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b","Type":"ContainerDied","Data":"0ad051323691fd79349737a8e1a5e66ede1b815522350c571145ca3c98ff5fe3"}
Jul 13 17:48:41.393964 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.393898    2577 scope.go:117] "RemoveContainer" containerID="25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da"
Jul 13 17:48:41.406214 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.404829    2577 scope.go:117] "RemoveContainer" containerID="25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da"
Jul 13 17:48:41.406214 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:48:41.405585    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da\": container with ID starting with 25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da not found: ID does not exist" containerID="25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da"
Jul 13 17:48:41.406214 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.405627    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da"} err="failed to get container status \"25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da\": rpc error: code = NotFound desc = could not find container \"25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da\": container with ID starting with 25a860486902b5aa518b704c9afae02095d41ed0531d18648ed9b740a08da4da not found: ID does not exist"
Jul 13 17:48:41.493785 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.493746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls\") pod \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") "
Jul 13 17:48:41.493967 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.493850    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-openshift-service-ca\") pod \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") "
Jul 13 17:48:41.493967 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.493870    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcgsv\" (UniqueName: \"kubernetes.io/projected/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-kube-api-access-pcgsv\") pod \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\" (UID: \"1ad2b26a-87f3-4855-aa8f-d15b32ffd98b\") "
Jul 13 17:48:41.494272 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.494245    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" (UID: "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:48:41.496085 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.496056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" (UID: "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:48:41.496144 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.496066    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-kube-api-access-pcgsv" (OuterVolumeSpecName: "kube-api-access-pcgsv") pod "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" (UID: "1ad2b26a-87f3-4855-aa8f-d15b32ffd98b"). InnerVolumeSpecName "kube-api-access-pcgsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:48:41.595611 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.595569    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:48:41.595611 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.595600    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:48:41.595611 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.595611    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcgsv\" (UniqueName: \"kubernetes.io/projected/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b-kube-api-access-pcgsv\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:48:41.717719 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.717680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"]
Jul 13 17:48:41.722091 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:41.722060    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35a3687f-75bdb57749-6gtt7"]
Jul 13 17:48:42.423513 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:42.423476    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" path="/var/lib/kubelet/pods/1ad2b26a-87f3-4855-aa8f-d15b32ffd98b/volumes"
Jul 13 17:48:49.650770 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.650719    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"]
Jul 13 17:48:49.651412 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651393    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651412 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651413    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651433    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" containerName="maas-api"
Jul 13 17:48:49.651571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651442    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" containerName="maas-api"
Jul 13 17:48:49.651571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651469    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651477    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651489    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651571 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651497    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651892 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651588    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad2b26a-87f3-4855-aa8f-d15b32ffd98b" containerName="maas-api"
Jul 13 17:48:49.651892 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651601    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.651892 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.651616    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:49.655159 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.655129    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.657788 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.657760    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:48:49.658316 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.658281    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d0c7b7fa-serving-cert\""
Jul 13 17:48:49.668933 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.668897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"]
Jul 13 17:48:49.775412 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.775375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5np6\" (UniqueName: \"kubernetes.io/projected/f1b73c10-e68b-4be8-b459-1058a2680252-kube-api-access-w5np6\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.775656 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.775456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.775656 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.775544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b73c10-e68b-4be8-b459-1058a2680252-openshift-service-ca\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.876119 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.876075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.876359 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.876128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b73c10-e68b-4be8-b459-1058a2680252-openshift-service-ca\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.876359 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.876207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5np6\" (UniqueName: \"kubernetes.io/projected/f1b73c10-e68b-4be8-b459-1058a2680252-kube-api-access-w5np6\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.876359 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:48:49.876252    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-serving-cert: secret "maas-api-e2e-ait-d0c7b7fa-serving-cert" not found
Jul 13 17:48:49.876567 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:48:49.876368    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls podName:f1b73c10-e68b-4be8-b459-1058a2680252 nodeName:}" failed. No retries permitted until 2026-07-13 17:48:50.376343558 +0000 UTC m=+1868.454535593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls") pod "maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" (UID: "f1b73c10-e68b-4be8-b459-1058a2680252") : secret "maas-api-e2e-ait-d0c7b7fa-serving-cert" not found
Jul 13 17:48:49.877379 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.877353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b73c10-e68b-4be8-b459-1058a2680252-openshift-service-ca\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:49.885517 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:49.885490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5np6\" (UniqueName: \"kubernetes.io/projected/f1b73c10-e68b-4be8-b459-1058a2680252-kube-api-access-w5np6\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:50.380886 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:50.380847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:50.383358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:50.383327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls\") pod \"maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:50.566960 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:50.566918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:50.719333 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:50.719276    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"]
Jul 13 17:48:50.721901 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:48:50.721866    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b73c10_e68b_4be8_b459_1058a2680252.slice/crio-d2694c724d8fc938987daac9165f5751593b27bed4c2de7749fe37b9d86e5b35 WatchSource:0}: Error finding container d2694c724d8fc938987daac9165f5751593b27bed4c2de7749fe37b9d86e5b35: Status 404 returned error can't find the container with id d2694c724d8fc938987daac9165f5751593b27bed4c2de7749fe37b9d86e5b35
Jul 13 17:48:51.452893 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:51.452851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" event={"ID":"f1b73c10-e68b-4be8-b459-1058a2680252","Type":"ContainerStarted","Data":"1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556"}
Jul 13 17:48:51.453081 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:51.452932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:51.453081 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:51.452959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" event={"ID":"f1b73c10-e68b-4be8-b459-1058a2680252","Type":"ContainerStarted","Data":"d2694c724d8fc938987daac9165f5751593b27bed4c2de7749fe37b9d86e5b35"}
Jul 13 17:48:51.473357 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:51.473282    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" podStartSLOduration=1.883738998 podStartE2EDuration="2.473262104s" totalImagesPullingTime="589.523106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:51.47022599 +0000 UTC m=+1869.548418040" watchObservedRunningTime="2026-07-13 17:48:51.473262104 +0000 UTC m=+1869.551454188"
Jul 13 17:48:54.605504 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.605466    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"]
Jul 13 17:48:54.606249 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.606228    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e760e0-e23d-4e53-9e1f-de14bbf38f4e" containerName="revoke-keys"
Jul 13 17:48:54.609758 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.609731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:48:54.613182 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.612775    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:48:54.616069 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.616040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"]
Jul 13 17:48:54.727657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.727620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b8835a-38e4-40f1-94a7-2531f718f244-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5\" (UID: \"29b8835a-38e4-40f1-94a7-2531f718f244\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:48:54.829122 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.829081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b8835a-38e4-40f1-94a7-2531f718f244-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5\" (UID: \"29b8835a-38e4-40f1-94a7-2531f718f244\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:48:54.829748 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.829729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b8835a-38e4-40f1-94a7-2531f718f244-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5\" (UID: \"29b8835a-38e4-40f1-94a7-2531f718f244\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:48:54.923444 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:54.923330    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:48:55.076879 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:55.076837    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"]
Jul 13 17:48:55.078247 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:48:55.078210    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b8835a_38e4_40f1_94a7_2531f718f244.slice/crio-a578106d90c239e58722816d701221a6935a9995c6162a9b6a437591b1a997b8 WatchSource:0}: Error finding container a578106d90c239e58722816d701221a6935a9995c6162a9b6a437591b1a997b8: Status 404 returned error can't find the container with id a578106d90c239e58722816d701221a6935a9995c6162a9b6a437591b1a997b8
Jul 13 17:48:55.476859 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:55.476816    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" event={"ID":"29b8835a-38e4-40f1-94a7-2531f718f244","Type":"ContainerStarted","Data":"7f882b25e9b20acfe95d528b3c48d41fd0ef2176529ce35ed14ab71fbb9201c4"}
Jul 13 17:48:55.477067 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:55.476883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" event={"ID":"29b8835a-38e4-40f1-94a7-2531f718f244","Type":"ContainerStarted","Data":"a578106d90c239e58722816d701221a6935a9995c6162a9b6a437591b1a997b8"}
Jul 13 17:48:55.496273 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:55.496198    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" podStartSLOduration=1.496176137 podStartE2EDuration="1.496176137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:48:55.495959649 +0000 UTC m=+1873.574151701" watchObservedRunningTime="2026-07-13 17:48:55.496176137 +0000 UTC m=+1873.574368187"
Jul 13 17:48:56.484404 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:56.484369    2577 generic.go:356] "Generic (PLEG): container finished" podID="29b8835a-38e4-40f1-94a7-2531f718f244" containerID="7f882b25e9b20acfe95d528b3c48d41fd0ef2176529ce35ed14ab71fbb9201c4" exitCode=7
Jul 13 17:48:56.484824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:56.484456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" event={"ID":"29b8835a-38e4-40f1-94a7-2531f718f244","Type":"ContainerDied","Data":"7f882b25e9b20acfe95d528b3c48d41fd0ef2176529ce35ed14ab71fbb9201c4"}
Jul 13 17:48:56.484824 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:56.484636    2577 scope.go:117] "RemoveContainer" containerID="7f882b25e9b20acfe95d528b3c48d41fd0ef2176529ce35ed14ab71fbb9201c4"
Jul 13 17:48:57.464468 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:57.464393    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:48:57.492608 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:57.492570    2577 generic.go:356] "Generic (PLEG): container finished" podID="29b8835a-38e4-40f1-94a7-2531f718f244" containerID="544b97b328c1203e7c6c7012e37211043e853e065840d6cdc912751db8c26dce" exitCode=7
Jul 13 17:48:57.492608 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:57.492593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" event={"ID":"29b8835a-38e4-40f1-94a7-2531f718f244","Type":"ContainerDied","Data":"544b97b328c1203e7c6c7012e37211043e853e065840d6cdc912751db8c26dce"}
Jul 13 17:48:57.493162 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:57.492671    2577 scope.go:117] "RemoveContainer" containerID="7f882b25e9b20acfe95d528b3c48d41fd0ef2176529ce35ed14ab71fbb9201c4"
Jul 13 17:48:57.493162 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:57.492951    2577 scope.go:117] "RemoveContainer" containerID="544b97b328c1203e7c6c7012e37211043e853e065840d6cdc912751db8c26dce"
Jul 13 17:48:57.493290 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:48:57.493263    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5_odh-ai-gateway-infra(29b8835a-38e4-40f1-94a7-2531f718f244)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" podUID="29b8835a-38e4-40f1-94a7-2531f718f244"
Jul 13 17:48:58.503520 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:48:58.503495    2577 scope.go:117] "RemoveContainer" containerID="544b97b328c1203e7c6c7012e37211043e853e065840d6cdc912751db8c26dce"
Jul 13 17:48:58.503899 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:48:58.503711    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5_odh-ai-gateway-infra(29b8835a-38e4-40f1-94a7-2531f718f244)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" podUID="29b8835a-38e4-40f1-94a7-2531f718f244"
Jul 13 17:49:12.420470 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:12.420440    2577 scope.go:117] "RemoveContainer" containerID="544b97b328c1203e7c6c7012e37211043e853e065840d6cdc912751db8c26dce"
Jul 13 17:49:13.591681 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:13.591645    2577 generic.go:356] "Generic (PLEG): container finished" podID="29b8835a-38e4-40f1-94a7-2531f718f244" containerID="d2fc39d98f03b99ebd6df4e2c4c10dcc4a24b15cd244ea428f8de1c67320f46f" exitCode=0
Jul 13 17:49:13.592113 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:13.591718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" event={"ID":"29b8835a-38e4-40f1-94a7-2531f718f244","Type":"ContainerDied","Data":"d2fc39d98f03b99ebd6df4e2c4c10dcc4a24b15cd244ea428f8de1c67320f46f"}
Jul 13 17:49:13.592113 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:13.591778    2577 scope.go:117] "RemoveContainer" containerID="544b97b328c1203e7c6c7012e37211043e853e065840d6cdc912751db8c26dce"
Jul 13 17:49:14.626723 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:14.626686    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"]
Jul 13 17:49:14.744111 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:14.744081    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:49:14.826727 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:14.826692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b8835a-38e4-40f1-94a7-2531f718f244-maas-api-service-ca\") pod \"29b8835a-38e4-40f1-94a7-2531f718f244\" (UID: \"29b8835a-38e4-40f1-94a7-2531f718f244\") "
Jul 13 17:49:14.827057 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:14.827033    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b8835a-38e4-40f1-94a7-2531f718f244-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29b8835a-38e4-40f1-94a7-2531f718f244" (UID: "29b8835a-38e4-40f1-94a7-2531f718f244"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:49:14.928569 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:14.928472    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b8835a-38e4-40f1-94a7-2531f718f244-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:49:15.605808 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:15.605777    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"
Jul 13 17:49:15.605998 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:15.605786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5" event={"ID":"29b8835a-38e4-40f1-94a7-2531f718f244","Type":"ContainerDied","Data":"a578106d90c239e58722816d701221a6935a9995c6162a9b6a437591b1a997b8"}
Jul 13 17:49:15.605998 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:15.605903    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a578106d90c239e58722816d701221a6935a9995c6162a9b6a437591b1a997b8"
Jul 13 17:49:15.638279 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:15.638238    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"]
Jul 13 17:49:15.645053 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:15.645022    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-dm5j5"]
Jul 13 17:49:16.422691 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:16.422657    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" path="/var/lib/kubelet/pods/29b8835a-38e4-40f1-94a7-2531f718f244/volumes"
Jul 13 17:49:54.653038 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.652996    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"]
Jul 13 17:49:54.653600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.653451    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:49:54.653600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.653465    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:49:54.653600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.653489    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:49:54.653600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.653496    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:49:54.653600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.653558    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:49:54.653600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.653567    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:49:54.656674 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.656653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:54.659093 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.659068    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:49:54.663622 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.663593    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"]
Jul 13 17:49:54.730472 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.730432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e75be0-840f-4454-8f8e-263db6790484-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql\" (UID: \"36e75be0-840f-4454-8f8e-263db6790484\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:54.831268 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.831229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e75be0-840f-4454-8f8e-263db6790484-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql\" (UID: \"36e75be0-840f-4454-8f8e-263db6790484\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:54.831855 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.831837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e75be0-840f-4454-8f8e-263db6790484-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql\" (UID: \"36e75be0-840f-4454-8f8e-263db6790484\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:54.969977 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:54.969884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:55.112016 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:55.111987    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"]
Jul 13 17:49:55.114137 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:49:55.114110    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e75be0_840f_4454_8f8e_263db6790484.slice/crio-ab38ede8436d78a508592136999340f65c86414bbb3ff7ca118c96c6c7a34706 WatchSource:0}: Error finding container ab38ede8436d78a508592136999340f65c86414bbb3ff7ca118c96c6c7a34706: Status 404 returned error can't find the container with id ab38ede8436d78a508592136999340f65c86414bbb3ff7ca118c96c6c7a34706
Jul 13 17:49:55.824142 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:55.824107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql" event={"ID":"36e75be0-840f-4454-8f8e-263db6790484","Type":"ContainerStarted","Data":"711ef7b71c40b4cd12f5436311e749ed0dc32587a1e1e18a8ca7a01e69c38d82"}
Jul 13 17:49:55.824580 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:55.824162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql" event={"ID":"36e75be0-840f-4454-8f8e-263db6790484","Type":"ContainerStarted","Data":"ab38ede8436d78a508592136999340f65c86414bbb3ff7ca118c96c6c7a34706"}
Jul 13 17:49:55.842564 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:55.842500    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql" podStartSLOduration=1.842474972 podStartE2EDuration="1.842474972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:49:55.840275507 +0000 UTC m=+1933.918467583" watchObservedRunningTime="2026-07-13 17:49:55.842474972 +0000 UTC m=+1933.920667022"
Jul 13 17:49:56.831295 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:56.831260    2577 generic.go:356] "Generic (PLEG): container finished" podID="36e75be0-840f-4454-8f8e-263db6790484" containerID="711ef7b71c40b4cd12f5436311e749ed0dc32587a1e1e18a8ca7a01e69c38d82" exitCode=0
Jul 13 17:49:56.831731 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:56.831357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql" event={"ID":"36e75be0-840f-4454-8f8e-263db6790484","Type":"ContainerDied","Data":"711ef7b71c40b4cd12f5436311e749ed0dc32587a1e1e18a8ca7a01e69c38d82"}
Jul 13 17:49:57.979979 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:57.979945    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:58.064444 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:58.064409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e75be0-840f-4454-8f8e-263db6790484-maas-api-service-ca\") pod \"36e75be0-840f-4454-8f8e-263db6790484\" (UID: \"36e75be0-840f-4454-8f8e-263db6790484\") "
Jul 13 17:49:58.064793 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:58.064770    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e75be0-840f-4454-8f8e-263db6790484-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36e75be0-840f-4454-8f8e-263db6790484" (UID: "36e75be0-840f-4454-8f8e-263db6790484"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:49:58.165270 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:58.165156    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36e75be0-840f-4454-8f8e-263db6790484-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:49:58.844657 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:58.844624    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql"
Jul 13 17:49:58.844841 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:58.844626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql" event={"ID":"36e75be0-840f-4454-8f8e-263db6790484","Type":"ContainerDied","Data":"ab38ede8436d78a508592136999340f65c86414bbb3ff7ca118c96c6c7a34706"}
Jul 13 17:49:58.844841 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:49:58.844749    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab38ede8436d78a508592136999340f65c86414bbb3ff7ca118c96c6c7a34706"
Jul 13 17:50:05.119403 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.119356    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"]
Jul 13 17:50:05.121807 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.119560    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" podUID="f1b73c10-e68b-4be8-b459-1058a2680252" containerName="maas-api" containerID="cri-o://1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556" gracePeriod=30
Jul 13 17:50:05.372999 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.372919    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:50:05.542711 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.542668    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls\") pod \"f1b73c10-e68b-4be8-b459-1058a2680252\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") "
Jul 13 17:50:05.542711 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.542721    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b73c10-e68b-4be8-b459-1058a2680252-openshift-service-ca\") pod \"f1b73c10-e68b-4be8-b459-1058a2680252\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") "
Jul 13 17:50:05.542987 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.542821    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5np6\" (UniqueName: \"kubernetes.io/projected/f1b73c10-e68b-4be8-b459-1058a2680252-kube-api-access-w5np6\") pod \"f1b73c10-e68b-4be8-b459-1058a2680252\" (UID: \"f1b73c10-e68b-4be8-b459-1058a2680252\") "
Jul 13 17:50:05.543400 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.543128    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1b73c10-e68b-4be8-b459-1058a2680252-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1b73c10-e68b-4be8-b459-1058a2680252" (UID: "f1b73c10-e68b-4be8-b459-1058a2680252"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:50:05.544848 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.544824    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1b73c10-e68b-4be8-b459-1058a2680252" (UID: "f1b73c10-e68b-4be8-b459-1058a2680252"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:50:05.544943 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.544908    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b73c10-e68b-4be8-b459-1058a2680252-kube-api-access-w5np6" (OuterVolumeSpecName: "kube-api-access-w5np6") pod "f1b73c10-e68b-4be8-b459-1058a2680252" (UID: "f1b73c10-e68b-4be8-b459-1058a2680252"). InnerVolumeSpecName "kube-api-access-w5np6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:50:05.644743 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.644640    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1b73c10-e68b-4be8-b459-1058a2680252-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:50:05.644743 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.644684    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b73c10-e68b-4be8-b459-1058a2680252-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:50:05.644743 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.644696    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5np6\" (UniqueName: \"kubernetes.io/projected/f1b73c10-e68b-4be8-b459-1058a2680252-kube-api-access-w5np6\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:50:05.886226 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.886189    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1b73c10-e68b-4be8-b459-1058a2680252" containerID="1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556" exitCode=0
Jul 13 17:50:05.886436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.886240    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"
Jul 13 17:50:05.886436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.886278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" event={"ID":"f1b73c10-e68b-4be8-b459-1058a2680252","Type":"ContainerDied","Data":"1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556"}
Jul 13 17:50:05.886436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.886359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k" event={"ID":"f1b73c10-e68b-4be8-b459-1058a2680252","Type":"ContainerDied","Data":"d2694c724d8fc938987daac9165f5751593b27bed4c2de7749fe37b9d86e5b35"}
Jul 13 17:50:05.886436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.886392    2577 scope.go:117] "RemoveContainer" containerID="1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556"
Jul 13 17:50:05.895901 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.895882    2577 scope.go:117] "RemoveContainer" containerID="1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556"
Jul 13 17:50:05.896163 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:50:05.896146    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556\": container with ID starting with 1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556 not found: ID does not exist" containerID="1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556"
Jul 13 17:50:05.896203 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.896173    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556"} err="failed to get container status \"1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556\": rpc error: code = NotFound desc = could not find container \"1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556\": container with ID starting with 1677116476ecf89247769e364cd67ab56e5e51a89be5a72f81408322afadd556 not found: ID does not exist"
Jul 13 17:50:05.908689 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.908664    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"]
Jul 13 17:50:05.911914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:05.911890    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0c7b7fa-54bc549555-75f7k"]
Jul 13 17:50:06.422412 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:06.422376    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b73c10-e68b-4be8-b459-1058a2680252" path="/var/lib/kubelet/pods/f1b73c10-e68b-4be8-b459-1058a2680252/volumes"
Jul 13 17:50:23.604956 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.604913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"]
Jul 13 17:50:23.605449 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605434    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e75be0-840f-4454-8f8e-263db6790484" containerName="revoke-keys"
Jul 13 17:50:23.605502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605450    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e75be0-840f-4454-8f8e-263db6790484" containerName="revoke-keys"
Jul 13 17:50:23.605502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605467    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1b73c10-e68b-4be8-b459-1058a2680252" containerName="maas-api"
Jul 13 17:50:23.605502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605477    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b73c10-e68b-4be8-b459-1058a2680252" containerName="maas-api"
Jul 13 17:50:23.605502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605494    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:50:23.605502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605500    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:50:23.605676 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605572    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b8835a-38e4-40f1-94a7-2531f718f244" containerName="revoke-keys"
Jul 13 17:50:23.605676 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605583    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1b73c10-e68b-4be8-b459-1058a2680252" containerName="maas-api"
Jul 13 17:50:23.605676 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.605599    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36e75be0-840f-4454-8f8e-263db6790484" containerName="revoke-keys"
Jul 13 17:50:23.609044 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.609019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.611922 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.611894    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:50:23.612337 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.612320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-7c24d8cc-serving-cert\""
Jul 13 17:50:23.628130 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.628094    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"]
Jul 13 17:50:23.719967 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.719929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85624dc7-e235-43f3-ad15-e5846bc9ab0a-maas-api-tls\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.720157 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.719987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w2gh\" (UniqueName: \"kubernetes.io/projected/85624dc7-e235-43f3-ad15-e5846bc9ab0a-kube-api-access-8w2gh\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.720157 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.720057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85624dc7-e235-43f3-ad15-e5846bc9ab0a-openshift-service-ca\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.821068 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.821027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w2gh\" (UniqueName: \"kubernetes.io/projected/85624dc7-e235-43f3-ad15-e5846bc9ab0a-kube-api-access-8w2gh\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.821068 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.821068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85624dc7-e235-43f3-ad15-e5846bc9ab0a-openshift-service-ca\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.821339 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.821213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85624dc7-e235-43f3-ad15-e5846bc9ab0a-maas-api-tls\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.821814 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.821791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85624dc7-e235-43f3-ad15-e5846bc9ab0a-openshift-service-ca\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.823600 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.823575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85624dc7-e235-43f3-ad15-e5846bc9ab0a-maas-api-tls\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.830382 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.830354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w2gh\" (UniqueName: \"kubernetes.io/projected/85624dc7-e235-43f3-ad15-e5846bc9ab0a-kube-api-access-8w2gh\") pod \"maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:23.920894 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:23.920806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:24.075996 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:24.075967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"]
Jul 13 17:50:24.078119 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:50:24.078087    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85624dc7_e235_43f3_ad15_e5846bc9ab0a.slice/crio-50af586db1f7f0730f5c244ce9413e114f301e12384892c81f33e494240f0c26 WatchSource:0}: Error finding container 50af586db1f7f0730f5c244ce9413e114f301e12384892c81f33e494240f0c26: Status 404 returned error can't find the container with id 50af586db1f7f0730f5c244ce9413e114f301e12384892c81f33e494240f0c26
Jul 13 17:50:24.079856 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:24.079838    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:50:25.003263 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:25.003225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz" event={"ID":"85624dc7-e235-43f3-ad15-e5846bc9ab0a","Type":"ContainerStarted","Data":"95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60"}
Jul 13 17:50:25.003697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:25.003290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz" event={"ID":"85624dc7-e235-43f3-ad15-e5846bc9ab0a","Type":"ContainerStarted","Data":"50af586db1f7f0730f5c244ce9413e114f301e12384892c81f33e494240f0c26"}
Jul 13 17:50:25.003697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:25.003356    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:25.023555 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:25.023503    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz" podStartSLOduration=1.537463853 podStartE2EDuration="2.02348468s" totalImagesPullingTime="486.020827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:50:25.021057398 +0000 UTC m=+1963.099249473" watchObservedRunningTime="2026-07-13 17:50:25.02348468 +0000 UTC m=+1963.101676730"
Jul 13 17:50:28.424070 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.424026    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"]
Jul 13 17:50:28.427839 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.427813    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:28.430563 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.430538    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:50:28.434974 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.434950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"]
Jul 13 17:50:28.467478 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.467439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bd3c3-19f4-4d4b-b425-6036923442e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9\" (UID: \"330bd3c3-19f4-4d4b-b425-6036923442e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:28.568358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.568283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bd3c3-19f4-4d4b-b425-6036923442e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9\" (UID: \"330bd3c3-19f4-4d4b-b425-6036923442e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:28.568922 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.568900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bd3c3-19f4-4d4b-b425-6036923442e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9\" (UID: \"330bd3c3-19f4-4d4b-b425-6036923442e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:28.742797 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.742701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:28.905252 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:28.905226    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"]
Jul 13 17:50:28.907428 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:50:28.907377    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330bd3c3_19f4_4d4b_b425_6036923442e8.slice/crio-4fbd528beaba8d422fc0b960b8ed0d7f7fa07bb900a37c343703a396e3a3a20f WatchSource:0}: Error finding container 4fbd528beaba8d422fc0b960b8ed0d7f7fa07bb900a37c343703a396e3a3a20f: Status 404 returned error can't find the container with id 4fbd528beaba8d422fc0b960b8ed0d7f7fa07bb900a37c343703a396e3a3a20f
Jul 13 17:50:29.025959 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:29.025917    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" event={"ID":"330bd3c3-19f4-4d4b-b425-6036923442e8","Type":"ContainerStarted","Data":"4fbd528beaba8d422fc0b960b8ed0d7f7fa07bb900a37c343703a396e3a3a20f"}
Jul 13 17:50:30.033945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:30.033906    2577 generic.go:356] "Generic (PLEG): container finished" podID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerID="f7f0253c4060211be93b22700f5a147a1c95065ed50a75cb1bedbff7558b98df" exitCode=7
Jul 13 17:50:30.034381 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:30.033955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" event={"ID":"330bd3c3-19f4-4d4b-b425-6036923442e8","Type":"ContainerDied","Data":"f7f0253c4060211be93b22700f5a147a1c95065ed50a75cb1bedbff7558b98df"}
Jul 13 17:50:30.034381 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:30.034205    2577 scope.go:117] "RemoveContainer" containerID="f7f0253c4060211be93b22700f5a147a1c95065ed50a75cb1bedbff7558b98df"
Jul 13 17:50:31.014728 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:31.014698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:50:31.043492 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:31.043456    2577 generic.go:356] "Generic (PLEG): container finished" podID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerID="5bf46f792d6411e4853f013d159cd3eda1163a5ce8471e5e8a27218957398235" exitCode=7
Jul 13 17:50:31.043914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:31.043530    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" event={"ID":"330bd3c3-19f4-4d4b-b425-6036923442e8","Type":"ContainerDied","Data":"5bf46f792d6411e4853f013d159cd3eda1163a5ce8471e5e8a27218957398235"}
Jul 13 17:50:31.043914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:31.043590    2577 scope.go:117] "RemoveContainer" containerID="f7f0253c4060211be93b22700f5a147a1c95065ed50a75cb1bedbff7558b98df"
Jul 13 17:50:31.043914 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:31.043787    2577 scope.go:117] "RemoveContainer" containerID="5bf46f792d6411e4853f013d159cd3eda1163a5ce8471e5e8a27218957398235"
Jul 13 17:50:31.044097 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:50:31.044078    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9_odh-ai-gateway-infra(330bd3c3-19f4-4d4b-b425-6036923442e8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8"
Jul 13 17:50:32.050612 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:32.050583    2577 scope.go:117] "RemoveContainer" containerID="5bf46f792d6411e4853f013d159cd3eda1163a5ce8471e5e8a27218957398235"
Jul 13 17:50:32.050996 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:50:32.050816    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9_odh-ai-gateway-infra(330bd3c3-19f4-4d4b-b425-6036923442e8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8"
Jul 13 17:50:46.416034 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:46.416006    2577 scope.go:117] "RemoveContainer" containerID="5bf46f792d6411e4853f013d159cd3eda1163a5ce8471e5e8a27218957398235"
Jul 13 17:50:47.137655 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:47.137624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" event={"ID":"330bd3c3-19f4-4d4b-b425-6036923442e8","Type":"ContainerStarted","Data":"5cac0cf955ce0773927b1f24966e5d8adf1c2b2e539b4f20c672a5e8c7480fb8"}
Jul 13 17:50:47.163273 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:47.163212    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" podStartSLOduration=19.163193618 podStartE2EDuration="19.163193618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:50:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:50:47.160857421 +0000 UTC m=+1985.239049490" watchObservedRunningTime="2026-07-13 17:50:47.163193618 +0000 UTC m=+1985.241385669"
Jul 13 17:50:48.144732 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:48.144697    2577 generic.go:356] "Generic (PLEG): container finished" podID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerID="5cac0cf955ce0773927b1f24966e5d8adf1c2b2e539b4f20c672a5e8c7480fb8" exitCode=0
Jul 13 17:50:48.145168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:48.144765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" event={"ID":"330bd3c3-19f4-4d4b-b425-6036923442e8","Type":"ContainerDied","Data":"5cac0cf955ce0773927b1f24966e5d8adf1c2b2e539b4f20c672a5e8c7480fb8"}
Jul 13 17:50:48.145168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:48.144830    2577 scope.go:117] "RemoveContainer" containerID="5bf46f792d6411e4853f013d159cd3eda1163a5ce8471e5e8a27218957398235"
Jul 13 17:50:48.171579 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:48.171538    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"]
Jul 13 17:50:49.299582 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:49.299547    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:49.377115 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:49.377075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bd3c3-19f4-4d4b-b425-6036923442e8-maas-api-service-ca\") pod \"330bd3c3-19f4-4d4b-b425-6036923442e8\" (UID: \"330bd3c3-19f4-4d4b-b425-6036923442e8\") "
Jul 13 17:50:49.377502 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:49.377473    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/330bd3c3-19f4-4d4b-b425-6036923442e8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "330bd3c3-19f4-4d4b-b425-6036923442e8" (UID: "330bd3c3-19f4-4d4b-b425-6036923442e8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:50:49.478050 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:49.477945    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/330bd3c3-19f4-4d4b-b425-6036923442e8-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:50:50.158489 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:50.158456    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"
Jul 13 17:50:50.158688 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:50.158505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9" event={"ID":"330bd3c3-19f4-4d4b-b425-6036923442e8","Type":"ContainerDied","Data":"4fbd528beaba8d422fc0b960b8ed0d7f7fa07bb900a37c343703a396e3a3a20f"}
Jul 13 17:50:50.158688 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:50.158556    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fbd528beaba8d422fc0b960b8ed0d7f7fa07bb900a37c343703a396e3a3a20f"
Jul 13 17:50:50.191173 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:50.191137    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"]
Jul 13 17:50:50.197617 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:50.197588    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c24d8cc-8kdz9"]
Jul 13 17:50:50.422880 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:50:50.422802    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" path="/var/lib/kubelet/pods/330bd3c3-19f4-4d4b-b425-6036923442e8/volumes"
Jul 13 17:51:38.944630 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:38.944592    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"]
Jul 13 17:51:38.945218 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:38.944846    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz" podUID="85624dc7-e235-43f3-ad15-e5846bc9ab0a" containerName="maas-api" containerID="cri-o://95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60" gracePeriod=30
Jul 13 17:51:39.203946 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.203884    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:51:39.254121 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.254082    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85624dc7-e235-43f3-ad15-e5846bc9ab0a-maas-api-tls\") pod \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") "
Jul 13 17:51:39.254121 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.254125    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w2gh\" (UniqueName: \"kubernetes.io/projected/85624dc7-e235-43f3-ad15-e5846bc9ab0a-kube-api-access-8w2gh\") pod \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") "
Jul 13 17:51:39.254402 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.254244    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85624dc7-e235-43f3-ad15-e5846bc9ab0a-openshift-service-ca\") pod \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\" (UID: \"85624dc7-e235-43f3-ad15-e5846bc9ab0a\") "
Jul 13 17:51:39.254589 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.254563    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85624dc7-e235-43f3-ad15-e5846bc9ab0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "85624dc7-e235-43f3-ad15-e5846bc9ab0a" (UID: "85624dc7-e235-43f3-ad15-e5846bc9ab0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:51:39.256337 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.256293    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85624dc7-e235-43f3-ad15-e5846bc9ab0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "85624dc7-e235-43f3-ad15-e5846bc9ab0a" (UID: "85624dc7-e235-43f3-ad15-e5846bc9ab0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:51:39.256493 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.256399    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85624dc7-e235-43f3-ad15-e5846bc9ab0a-kube-api-access-8w2gh" (OuterVolumeSpecName: "kube-api-access-8w2gh") pod "85624dc7-e235-43f3-ad15-e5846bc9ab0a" (UID: "85624dc7-e235-43f3-ad15-e5846bc9ab0a"). InnerVolumeSpecName "kube-api-access-8w2gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:51:39.355594 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.355562    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85624dc7-e235-43f3-ad15-e5846bc9ab0a-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:51:39.355594 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.355592    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85624dc7-e235-43f3-ad15-e5846bc9ab0a-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:51:39.355594 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.355601    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w2gh\" (UniqueName: \"kubernetes.io/projected/85624dc7-e235-43f3-ad15-e5846bc9ab0a-kube-api-access-8w2gh\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:51:39.424983 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.424946    2577 generic.go:356] "Generic (PLEG): container finished" podID="85624dc7-e235-43f3-ad15-e5846bc9ab0a" containerID="95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60" exitCode=0
Jul 13 17:51:39.425168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.424993    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"
Jul 13 17:51:39.425168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.425039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz" event={"ID":"85624dc7-e235-43f3-ad15-e5846bc9ab0a","Type":"ContainerDied","Data":"95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60"}
Jul 13 17:51:39.425168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.425095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz" event={"ID":"85624dc7-e235-43f3-ad15-e5846bc9ab0a","Type":"ContainerDied","Data":"50af586db1f7f0730f5c244ce9413e114f301e12384892c81f33e494240f0c26"}
Jul 13 17:51:39.425168 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.425126    2577 scope.go:117] "RemoveContainer" containerID="95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60"
Jul 13 17:51:39.438091 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.438067    2577 scope.go:117] "RemoveContainer" containerID="95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60"
Jul 13 17:51:39.438628 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:51:39.438605    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60\": container with ID starting with 95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60 not found: ID does not exist" containerID="95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60"
Jul 13 17:51:39.438711 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.438640    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60"} err="failed to get container status \"95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60\": rpc error: code = NotFound desc = could not find container \"95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60\": container with ID starting with 95d37c8526dfecdb645549d3ce94adeba7e9ab46786369b67dbd93f0b79aef60 not found: ID does not exist"
Jul 13 17:51:39.451214 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.451183    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"]
Jul 13 17:51:39.454985 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:39.454927    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7c24d8cc-984b57b74-nd8cz"]
Jul 13 17:51:40.422470 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:51:40.422435    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85624dc7-e235-43f3-ad15-e5846bc9ab0a" path="/var/lib/kubelet/pods/85624dc7-e235-43f3-ad15-e5846bc9ab0a/volumes"
Jul 13 17:52:42.503448 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:52:42.503421    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:52:42.507719 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:52:42.507696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:52:42.510663 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:52:42.510638    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:52:42.514733 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:52:42.514717    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:52:42.554153 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:52:42.554118    2577 scope.go:117] "RemoveContainer" containerID="153ae01d696817356974cb5d7e900726f7c6387a343d21354e6c945e15933c8e"
Jul 13 17:53:35.837046 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.836966    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"]
Jul 13 17:53:35.837643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837625    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837696 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837645    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837696 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837670    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837696 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837676    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837696 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837683    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837696 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837688    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837700    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85624dc7-e235-43f3-ad15-e5846bc9ab0a" containerName="maas-api"
Jul 13 17:53:35.837921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837705    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="85624dc7-e235-43f3-ad15-e5846bc9ab0a" containerName="maas-api"
Jul 13 17:53:35.837921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837773    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="85624dc7-e235-43f3-ad15-e5846bc9ab0a" containerName="maas-api"
Jul 13 17:53:35.837921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837782    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.837921 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.837789    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:53:35.841096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.841074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.844074 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.844055    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a287d56e-serving-cert\""
Jul 13 17:53:35.844183 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.844074    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:53:35.850483 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.850461    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"]
Jul 13 17:53:35.874570 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.874539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0364a2-b778-4dfd-b91f-be45adbe7c56-openshift-service-ca\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.874707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.874629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hr5v\" (UniqueName: \"kubernetes.io/projected/cf0364a2-b778-4dfd-b91f-be45adbe7c56-kube-api-access-4hr5v\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.874707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.874677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0364a2-b778-4dfd-b91f-be45adbe7c56-maas-api-tls\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.975470 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.975433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0364a2-b778-4dfd-b91f-be45adbe7c56-openshift-service-ca\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.975652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.975477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hr5v\" (UniqueName: \"kubernetes.io/projected/cf0364a2-b778-4dfd-b91f-be45adbe7c56-kube-api-access-4hr5v\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.975652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.975510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0364a2-b778-4dfd-b91f-be45adbe7c56-maas-api-tls\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.976086 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.976064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0364a2-b778-4dfd-b91f-be45adbe7c56-openshift-service-ca\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.978010 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.977983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0364a2-b778-4dfd-b91f-be45adbe7c56-maas-api-tls\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:35.988678 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:35.988652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hr5v\" (UniqueName: \"kubernetes.io/projected/cf0364a2-b778-4dfd-b91f-be45adbe7c56-kube-api-access-4hr5v\") pod \"maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:36.154015 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:36.153918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:36.292117 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:36.292092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"]
Jul 13 17:53:36.294165 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:53:36.294134    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0364a2_b778_4dfd_b91f_be45adbe7c56.slice/crio-bdedc4cd615fe2cd8f1c005decad42c30cd4306ae61afa93da909f96333e2ceb WatchSource:0}: Error finding container bdedc4cd615fe2cd8f1c005decad42c30cd4306ae61afa93da909f96333e2ceb: Status 404 returned error can't find the container with id bdedc4cd615fe2cd8f1c005decad42c30cd4306ae61afa93da909f96333e2ceb
Jul 13 17:53:37.039743 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:37.039694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp" event={"ID":"cf0364a2-b778-4dfd-b91f-be45adbe7c56","Type":"ContainerStarted","Data":"d98b33df9fd99ec67c6398563bf7e21ad81966c569aa8215f9b788166bfa420a"}
Jul 13 17:53:37.040241 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:37.039807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp" event={"ID":"cf0364a2-b778-4dfd-b91f-be45adbe7c56","Type":"ContainerStarted","Data":"bdedc4cd615fe2cd8f1c005decad42c30cd4306ae61afa93da909f96333e2ceb"}
Jul 13 17:53:37.040241 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:37.039837    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:37.059474 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:37.059398    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp" podStartSLOduration=1.626197476 podStartE2EDuration="2.059381853s" totalImagesPullingTime="433.184377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:53:37.058930228 +0000 UTC m=+2155.137122278" watchObservedRunningTime="2026-07-13 17:53:37.059381853 +0000 UTC m=+2155.137573902"
Jul 13 17:53:43.051924 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:43.051887    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:59.009074 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.009038    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"]
Jul 13 17:53:59.009652 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.009317    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp" podUID="cf0364a2-b778-4dfd-b91f-be45adbe7c56" containerName="maas-api" containerID="cri-o://d98b33df9fd99ec67c6398563bf7e21ad81966c569aa8215f9b788166bfa420a" gracePeriod=30
Jul 13 17:53:59.166131 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.166097    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf0364a2-b778-4dfd-b91f-be45adbe7c56" containerID="d98b33df9fd99ec67c6398563bf7e21ad81966c569aa8215f9b788166bfa420a" exitCode=0
Jul 13 17:53:59.166341 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.166173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp" event={"ID":"cf0364a2-b778-4dfd-b91f-be45adbe7c56","Type":"ContainerDied","Data":"d98b33df9fd99ec67c6398563bf7e21ad81966c569aa8215f9b788166bfa420a"}
Jul 13 17:53:59.270171 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.270098    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:53:59.417695 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.417649    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0364a2-b778-4dfd-b91f-be45adbe7c56-maas-api-tls\") pod \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") "
Jul 13 17:53:59.417889 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.417722    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0364a2-b778-4dfd-b91f-be45adbe7c56-openshift-service-ca\") pod \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") "
Jul 13 17:53:59.417889 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.417838    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hr5v\" (UniqueName: \"kubernetes.io/projected/cf0364a2-b778-4dfd-b91f-be45adbe7c56-kube-api-access-4hr5v\") pod \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\" (UID: \"cf0364a2-b778-4dfd-b91f-be45adbe7c56\") "
Jul 13 17:53:59.418054 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.418036    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf0364a2-b778-4dfd-b91f-be45adbe7c56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf0364a2-b778-4dfd-b91f-be45adbe7c56" (UID: "cf0364a2-b778-4dfd-b91f-be45adbe7c56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:53:59.418184 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.418166    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf0364a2-b778-4dfd-b91f-be45adbe7c56-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:53:59.419827 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.419801    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf0364a2-b778-4dfd-b91f-be45adbe7c56-kube-api-access-4hr5v" (OuterVolumeSpecName: "kube-api-access-4hr5v") pod "cf0364a2-b778-4dfd-b91f-be45adbe7c56" (UID: "cf0364a2-b778-4dfd-b91f-be45adbe7c56"). InnerVolumeSpecName "kube-api-access-4hr5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:53:59.419945 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.419880    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf0364a2-b778-4dfd-b91f-be45adbe7c56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf0364a2-b778-4dfd-b91f-be45adbe7c56" (UID: "cf0364a2-b778-4dfd-b91f-be45adbe7c56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:53:59.519691 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.519655    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf0364a2-b778-4dfd-b91f-be45adbe7c56-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:53:59.519691 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:53:59.519685    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hr5v\" (UniqueName: \"kubernetes.io/projected/cf0364a2-b778-4dfd-b91f-be45adbe7c56-kube-api-access-4hr5v\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:54:00.179774 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:00.179732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp" event={"ID":"cf0364a2-b778-4dfd-b91f-be45adbe7c56","Type":"ContainerDied","Data":"bdedc4cd615fe2cd8f1c005decad42c30cd4306ae61afa93da909f96333e2ceb"}
Jul 13 17:54:00.180230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:00.179784    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"
Jul 13 17:54:00.180230 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:00.179825    2577 scope.go:117] "RemoveContainer" containerID="d98b33df9fd99ec67c6398563bf7e21ad81966c569aa8215f9b788166bfa420a"
Jul 13 17:54:00.212471 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:00.212293    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"]
Jul 13 17:54:00.214479 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:00.214455    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a287d56e-58cffc67d6-zgbfp"]
Jul 13 17:54:00.422498 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:00.422454    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf0364a2-b778-4dfd-b91f-be45adbe7c56" path="/var/lib/kubelet/pods/cf0364a2-b778-4dfd-b91f-be45adbe7c56/volumes"
Jul 13 17:54:37.237487 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.237445    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"]
Jul 13 17:54:37.238096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.237945    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf0364a2-b778-4dfd-b91f-be45adbe7c56" containerName="maas-api"
Jul 13 17:54:37.238096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.237962    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf0364a2-b778-4dfd-b91f-be45adbe7c56" containerName="maas-api"
Jul 13 17:54:37.238096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.238080    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="330bd3c3-19f4-4d4b-b425-6036923442e8" containerName="revoke-keys"
Jul 13 17:54:37.238096 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.238091    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf0364a2-b778-4dfd-b91f-be45adbe7c56" containerName="maas-api"
Jul 13 17:54:37.241313 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.241283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.244435 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.244412    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-db8658d2-serving-cert\""
Jul 13 17:54:37.244573 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.244519    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:54:37.255831 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.255799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"]
Jul 13 17:54:37.297296 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.297251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.297525 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.297334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqpnb\" (UniqueName: \"kubernetes.io/projected/10d98635-fd21-46b3-b4d8-3492a2eedc9c-kube-api-access-xqpnb\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.297525 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.297397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d98635-fd21-46b3-b4d8-3492a2eedc9c-openshift-service-ca\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.398854 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.398811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.399087 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.398872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqpnb\" (UniqueName: \"kubernetes.io/projected/10d98635-fd21-46b3-b4d8-3492a2eedc9c-kube-api-access-xqpnb\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.399087 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.398927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d98635-fd21-46b3-b4d8-3492a2eedc9c-openshift-service-ca\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.399087 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:54:37.398982    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-serving-cert: secret "maas-api-e2e-mt-db8658d2-serving-cert" not found
Jul 13 17:54:37.399087 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:54:37.399047    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls podName:10d98635-fd21-46b3-b4d8-3492a2eedc9c nodeName:}" failed. No retries permitted until 2026-07-13 17:54:37.899027411 +0000 UTC m=+2215.977219440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls") pod "maas-api-e2e-mt-db8658d2-69565677-lth4w" (UID: "10d98635-fd21-46b3-b4d8-3492a2eedc9c") : secret "maas-api-e2e-mt-db8658d2-serving-cert" not found
Jul 13 17:54:37.399607 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.399589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d98635-fd21-46b3-b4d8-3492a2eedc9c-openshift-service-ca\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.412910 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.412872    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqpnb\" (UniqueName: \"kubernetes.io/projected/10d98635-fd21-46b3-b4d8-3492a2eedc9c-kube-api-access-xqpnb\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.904887 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.904831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:37.907469 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:37.907440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls\") pod \"maas-api-e2e-mt-db8658d2-69565677-lth4w\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:38.152248 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:38.152211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:38.308840 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:38.308805    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"]
Jul 13 17:54:38.310079 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:54:38.310058    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d98635_fd21_46b3_b4d8_3492a2eedc9c.slice/crio-1cb94dd61698f5e6be673c9a0b8e1931b3395fc7d417da9f7627b70afcf0476e WatchSource:0}: Error finding container 1cb94dd61698f5e6be673c9a0b8e1931b3395fc7d417da9f7627b70afcf0476e: Status 404 returned error can't find the container with id 1cb94dd61698f5e6be673c9a0b8e1931b3395fc7d417da9f7627b70afcf0476e
Jul 13 17:54:38.390730 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:38.390692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w" event={"ID":"10d98635-fd21-46b3-b4d8-3492a2eedc9c","Type":"ContainerStarted","Data":"1cb94dd61698f5e6be673c9a0b8e1931b3395fc7d417da9f7627b70afcf0476e"}
Jul 13 17:54:39.398058 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:39.398014    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w" event={"ID":"10d98635-fd21-46b3-b4d8-3492a2eedc9c","Type":"ContainerStarted","Data":"9ab17a77136b99ff96ba47d2e15042fc8ee3817b64840c203401bd70baf6839b"}
Jul 13 17:54:39.398531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:39.398081    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:54:39.448830 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:39.448763    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w" podStartSLOduration=2.068184015 podStartE2EDuration="2.448747305s" totalImagesPullingTime="380.56329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:54:39.447580568 +0000 UTC m=+2217.525772617" watchObservedRunningTime="2026-07-13 17:54:39.448747305 +0000 UTC m=+2217.526939354"
Jul 13 17:54:42.583655 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:42.583624    2577 scope.go:117] "RemoveContainer" containerID="e8d4604252e3f148a62c9f231a365d6807135cd72c6ff879082fc7ae62a9835b"
Jul 13 17:54:45.417045 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:54:45.417013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:55:35.512356 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.512321    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"]
Jul 13 17:55:35.515106 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.512553    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w" podUID="10d98635-fd21-46b3-b4d8-3492a2eedc9c" containerName="maas-api" containerID="cri-o://9ab17a77136b99ff96ba47d2e15042fc8ee3817b64840c203401bd70baf6839b" gracePeriod=30
Jul 13 17:55:35.713159 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.713094    2577 generic.go:356] "Generic (PLEG): container finished" podID="10d98635-fd21-46b3-b4d8-3492a2eedc9c" containerID="9ab17a77136b99ff96ba47d2e15042fc8ee3817b64840c203401bd70baf6839b" exitCode=0
Jul 13 17:55:35.713377 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.713149    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w" event={"ID":"10d98635-fd21-46b3-b4d8-3492a2eedc9c","Type":"ContainerDied","Data":"9ab17a77136b99ff96ba47d2e15042fc8ee3817b64840c203401bd70baf6839b"}
Jul 13 17:55:35.772878 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.772805    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:55:35.889329 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.889270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls\") pod \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") "
Jul 13 17:55:35.889519 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.889392    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqpnb\" (UniqueName: \"kubernetes.io/projected/10d98635-fd21-46b3-b4d8-3492a2eedc9c-kube-api-access-xqpnb\") pod \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") "
Jul 13 17:55:35.889519 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.889434    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d98635-fd21-46b3-b4d8-3492a2eedc9c-openshift-service-ca\") pod \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\" (UID: \"10d98635-fd21-46b3-b4d8-3492a2eedc9c\") "
Jul 13 17:55:35.889900 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.889870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d98635-fd21-46b3-b4d8-3492a2eedc9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10d98635-fd21-46b3-b4d8-3492a2eedc9c" (UID: "10d98635-fd21-46b3-b4d8-3492a2eedc9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:55:35.891433 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.891411    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10d98635-fd21-46b3-b4d8-3492a2eedc9c" (UID: "10d98635-fd21-46b3-b4d8-3492a2eedc9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:55:35.891531 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.891511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d98635-fd21-46b3-b4d8-3492a2eedc9c-kube-api-access-xqpnb" (OuterVolumeSpecName: "kube-api-access-xqpnb") pod "10d98635-fd21-46b3-b4d8-3492a2eedc9c" (UID: "10d98635-fd21-46b3-b4d8-3492a2eedc9c"). InnerVolumeSpecName "kube-api-access-xqpnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:55:35.990336 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.990269    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d98635-fd21-46b3-b4d8-3492a2eedc9c-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:55:35.990336 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.990332    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqpnb\" (UniqueName: \"kubernetes.io/projected/10d98635-fd21-46b3-b4d8-3492a2eedc9c-kube-api-access-xqpnb\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:55:35.990336 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:35.990343    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d98635-fd21-46b3-b4d8-3492a2eedc9c-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:55:36.719828 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:36.719740    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w" event={"ID":"10d98635-fd21-46b3-b4d8-3492a2eedc9c","Type":"ContainerDied","Data":"1cb94dd61698f5e6be673c9a0b8e1931b3395fc7d417da9f7627b70afcf0476e"}
Jul 13 17:55:36.719828 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:36.719761    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"
Jul 13 17:55:36.719828 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:36.719800    2577 scope.go:117] "RemoveContainer" containerID="9ab17a77136b99ff96ba47d2e15042fc8ee3817b64840c203401bd70baf6839b"
Jul 13 17:55:36.741035 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:36.740993    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"]
Jul 13 17:55:36.743689 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:36.743661    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db8658d2-69565677-lth4w"]
Jul 13 17:55:38.422601 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:38.422563    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d98635-fd21-46b3-b4d8-3492a2eedc9c" path="/var/lib/kubelet/pods/10d98635-fd21-46b3-b4d8-3492a2eedc9c/volumes"
Jul 13 17:55:42.610178 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:55:42.610144    2577 scope.go:117] "RemoveContainer" containerID="d2fc39d98f03b99ebd6df4e2c4c10dcc4a24b15cd244ea428f8de1c67320f46f"
Jul 13 17:57:32.395505 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.395463    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"]
Jul 13 17:57:32.396073 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.396042    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d98635-fd21-46b3-b4d8-3492a2eedc9c" containerName="maas-api"
Jul 13 17:57:32.396073 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.396064    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d98635-fd21-46b3-b4d8-3492a2eedc9c" containerName="maas-api"
Jul 13 17:57:32.396204 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.396169    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d98635-fd21-46b3-b4d8-3492a2eedc9c" containerName="maas-api"
Jul 13 17:57:32.399298 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.399275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.402170 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.402143    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2ffc29-serving-cert\""
Jul 13 17:57:32.402339 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.402169    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:57:32.413804 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.413776    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"]
Jul 13 17:57:32.452057 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.452002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6gjx\" (UniqueName: \"kubernetes.io/projected/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-kube-api-access-n6gjx\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.452233 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.452070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.452233 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.452194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.553668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.553624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.553876 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.553761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.553876 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.553818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6gjx\" (UniqueName: \"kubernetes.io/projected/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-kube-api-access-n6gjx\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.554349 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.554289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.556216 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.556179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.566968 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.566940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6gjx\" (UniqueName: \"kubernetes.io/projected/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-kube-api-access-n6gjx\") pod \"maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.711570 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.711468    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:32.872161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.872125    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"]
Jul 13 17:57:32.876004 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:57:32.875971    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9fdf7a_21a5_4fcd_a40f_d228a87d75e9.slice/crio-d8f5e2586ae8704812dd65febe47bcc03a771b80378457feae17337f1819bde7 WatchSource:0}: Error finding container d8f5e2586ae8704812dd65febe47bcc03a771b80378457feae17337f1819bde7: Status 404 returned error can't find the container with id d8f5e2586ae8704812dd65febe47bcc03a771b80378457feae17337f1819bde7
Jul 13 17:57:32.877466 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:32.877447    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:57:33.351423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:33.351384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99" event={"ID":"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9","Type":"ContainerStarted","Data":"d8f5e2586ae8704812dd65febe47bcc03a771b80378457feae17337f1819bde7"}
Jul 13 17:57:34.358875 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:34.358832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99" event={"ID":"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9","Type":"ContainerStarted","Data":"bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0"}
Jul 13 17:57:34.359323 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:34.359033    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:34.377296 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:34.377235    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99" podStartSLOduration=1.771493947 podStartE2EDuration="2.377218629s" totalImagesPullingTime="605.724682ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:57:34.376711759 +0000 UTC m=+2392.454903820" watchObservedRunningTime="2026-07-13 17:57:34.377218629 +0000 UTC m=+2392.455410678"
Jul 13 17:57:40.295430 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.295390    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"]
Jul 13 17:57:40.299709 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.299680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.302290 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.302264    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-cb4ffa-serving-cert\""
Jul 13 17:57:40.317177 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.317143    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"]
Jul 13 17:57:40.332549 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.332504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sb4p\" (UniqueName: \"kubernetes.io/projected/cc2feaf5-c081-40c9-9182-29028452de8f-kube-api-access-5sb4p\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.332757 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.332572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.332757 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.332680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2feaf5-c081-40c9-9182-29028452de8f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.371088 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.371058    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:57:40.434130 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.434092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sb4p\" (UniqueName: \"kubernetes.io/projected/cc2feaf5-c081-40c9-9182-29028452de8f-kube-api-access-5sb4p\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.434359 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.434177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.434359 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.434259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2feaf5-c081-40c9-9182-29028452de8f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.434492 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:57:40.434447    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-serving-cert: secret "maas-api-e2e-inf-b-cb4ffa-serving-cert" not found
Jul 13 17:57:40.434567 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:57:40.434554    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls podName:cc2feaf5-c081-40c9-9182-29028452de8f nodeName:}" failed. No retries permitted until 2026-07-13 17:57:40.93452973 +0000 UTC m=+2399.012721763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls") pod "maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" (UID: "cc2feaf5-c081-40c9-9182-29028452de8f") : secret "maas-api-e2e-inf-b-cb4ffa-serving-cert" not found
Jul 13 17:57:40.435076 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.435055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2feaf5-c081-40c9-9182-29028452de8f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.456028 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.455997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sb4p\" (UniqueName: \"kubernetes.io/projected/cc2feaf5-c081-40c9-9182-29028452de8f-kube-api-access-5sb4p\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.938872 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.938833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:40.941444 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:40.941414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls\") pod \"maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:41.214102 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:41.214008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:41.395585 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:41.395524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"]
Jul 13 17:57:41.400698 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:57:41.400663    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2feaf5_c081_40c9_9182_29028452de8f.slice/crio-f0623e3b8dec5330a83e38e76b700dba1a46704b81140a0eb1b5e859d201b012 WatchSource:0}: Error finding container f0623e3b8dec5330a83e38e76b700dba1a46704b81140a0eb1b5e859d201b012: Status 404 returned error can't find the container with id f0623e3b8dec5330a83e38e76b700dba1a46704b81140a0eb1b5e859d201b012
Jul 13 17:57:42.404262 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.404220    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" event={"ID":"cc2feaf5-c081-40c9-9182-29028452de8f","Type":"ContainerStarted","Data":"4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6"}
Jul 13 17:57:42.404697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.404280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" event={"ID":"cc2feaf5-c081-40c9-9182-29028452de8f","Type":"ContainerStarted","Data":"f0623e3b8dec5330a83e38e76b700dba1a46704b81140a0eb1b5e859d201b012"}
Jul 13 17:57:42.404697 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.404345    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:57:42.437913 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.437847    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" podStartSLOduration=1.868517357 podStartE2EDuration="2.437822696s" totalImagesPullingTime="569.305339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:57:42.435135546 +0000 UTC m=+2400.513327612" watchObservedRunningTime="2026-07-13 17:57:42.437822696 +0000 UTC m=+2400.516014747"
Jul 13 17:57:42.540202 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.540176    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:57:42.545428 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.545395    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:57:42.548577 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.548548    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 17:57:42.553145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.553107    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 17:57:42.646296 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:42.646263    2577 scope.go:117] "RemoveContainer" containerID="5cac0cf955ce0773927b1f24966e5d8adf1c2b2e539b4f20c672a5e8c7480fb8"
Jul 13 17:57:48.422643 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:57:48.422611    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:58:49.631228 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.631194    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"]
Jul 13 17:58:49.634775 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.634751    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:49.637387 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.637358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:58:49.644354 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.644325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"]
Jul 13 17:58:49.724009 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.723968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff25662e-a432-4879-8c09-28e54d3372a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5\" (UID: \"ff25662e-a432-4879-8c09-28e54d3372a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:49.825444 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.825402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff25662e-a432-4879-8c09-28e54d3372a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5\" (UID: \"ff25662e-a432-4879-8c09-28e54d3372a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:49.826050 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.826025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff25662e-a432-4879-8c09-28e54d3372a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5\" (UID: \"ff25662e-a432-4879-8c09-28e54d3372a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:49.948076 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:49.947969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:50.094689 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:50.094663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"]
Jul 13 17:58:50.097073 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:58:50.097034    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff25662e_a432_4879_8c09_28e54d3372a3.slice/crio-23767acaac8f7fe9e319d9822885a7a26c717c1b20b2822231a9e671f24f6270 WatchSource:0}: Error finding container 23767acaac8f7fe9e319d9822885a7a26c717c1b20b2822231a9e671f24f6270: Status 404 returned error can't find the container with id 23767acaac8f7fe9e319d9822885a7a26c717c1b20b2822231a9e671f24f6270
Jul 13 17:58:50.785522 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:50.785476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5" event={"ID":"ff25662e-a432-4879-8c09-28e54d3372a3","Type":"ContainerStarted","Data":"b6956f9b099921bbb2a91764896790469f931b557a1bb0a54c759761b1316fd3"}
Jul 13 17:58:50.786054 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:50.785576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5" event={"ID":"ff25662e-a432-4879-8c09-28e54d3372a3","Type":"ContainerStarted","Data":"23767acaac8f7fe9e319d9822885a7a26c717c1b20b2822231a9e671f24f6270"}
Jul 13 17:58:50.807599 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:50.807541    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5" podStartSLOduration=1.807522982 podStartE2EDuration="1.807522982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:58:50.804955121 +0000 UTC m=+2468.883147170" watchObservedRunningTime="2026-07-13 17:58:50.807522982 +0000 UTC m=+2468.885715031"
Jul 13 17:58:51.792246 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:51.792210    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff25662e-a432-4879-8c09-28e54d3372a3" containerID="b6956f9b099921bbb2a91764896790469f931b557a1bb0a54c759761b1316fd3" exitCode=0
Jul 13 17:58:51.792668 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:51.792291    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5" event={"ID":"ff25662e-a432-4879-8c09-28e54d3372a3","Type":"ContainerDied","Data":"b6956f9b099921bbb2a91764896790469f931b557a1bb0a54c759761b1316fd3"}
Jul 13 17:58:52.950673 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:52.950641    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:53.059418 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:53.059296    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff25662e-a432-4879-8c09-28e54d3372a3-maas-api-service-ca\") pod \"ff25662e-a432-4879-8c09-28e54d3372a3\" (UID: \"ff25662e-a432-4879-8c09-28e54d3372a3\") "
Jul 13 17:58:53.059679 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:53.059652    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff25662e-a432-4879-8c09-28e54d3372a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ff25662e-a432-4879-8c09-28e54d3372a3" (UID: "ff25662e-a432-4879-8c09-28e54d3372a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:58:53.160693 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:53.160647    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff25662e-a432-4879-8c09-28e54d3372a3-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:58:53.805133 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:53.805098    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5"
Jul 13 17:58:53.805380 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:53.805144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5" event={"ID":"ff25662e-a432-4879-8c09-28e54d3372a3","Type":"ContainerDied","Data":"23767acaac8f7fe9e319d9822885a7a26c717c1b20b2822231a9e671f24f6270"}
Jul 13 17:58:53.805380 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:58:53.805191    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23767acaac8f7fe9e319d9822885a7a26c717c1b20b2822231a9e671f24f6270"
Jul 13 17:59:00.097875 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.097841    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"]
Jul 13 17:59:00.098280 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.098075    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99" podUID="ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" containerName="maas-api" containerID="cri-o://bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0" gracePeriod=30
Jul 13 17:59:00.358284 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.358210    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:59:00.434952 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.434916    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-maas-api-tls\") pod \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") "
Jul 13 17:59:00.435161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.435021    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6gjx\" (UniqueName: \"kubernetes.io/projected/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-kube-api-access-n6gjx\") pod \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") "
Jul 13 17:59:00.435161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.435089    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-openshift-service-ca\") pod \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\" (UID: \"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9\") "
Jul 13 17:59:00.435505 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.435477    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" (UID: "ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:59:00.437141 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.437099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" (UID: "ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:59:00.437272 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.437247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-kube-api-access-n6gjx" (OuterVolumeSpecName: "kube-api-access-n6gjx") pod "ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" (UID: "ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9"). InnerVolumeSpecName "kube-api-access-n6gjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:59:00.536853 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.536816    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6gjx\" (UniqueName: \"kubernetes.io/projected/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-kube-api-access-n6gjx\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:00.536853 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.536855    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:00.537128 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.536870    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:00.843970 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.843939    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" containerID="bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0" exitCode=0
Jul 13 17:59:00.844161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.843987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99" event={"ID":"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9","Type":"ContainerDied","Data":"bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0"}
Jul 13 17:59:00.844161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.843991    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"
Jul 13 17:59:00.844161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.844026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99" event={"ID":"ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9","Type":"ContainerDied","Data":"d8f5e2586ae8704812dd65febe47bcc03a771b80378457feae17337f1819bde7"}
Jul 13 17:59:00.844161 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.844047    2577 scope.go:117] "RemoveContainer" containerID="bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0"
Jul 13 17:59:00.854062 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.854035    2577 scope.go:117] "RemoveContainer" containerID="bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0"
Jul 13 17:59:00.854348 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:59:00.854325    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0\": container with ID starting with bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0 not found: ID does not exist" containerID="bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0"
Jul 13 17:59:00.854405 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.854362    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0"} err="failed to get container status \"bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0\": rpc error: code = NotFound desc = could not find container \"bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0\": container with ID starting with bba831f4c25befb0fb428743d69c42badae0c44ae72196466cb585c36dcea5c0 not found: ID does not exist"
Jul 13 17:59:00.867055 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.867022    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"]
Jul 13 17:59:00.871689 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:00.871660    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2ffc29-9d7f9755b-gcn99"]
Jul 13 17:59:02.423016 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:02.422983    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" path="/var/lib/kubelet/pods/ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9/volumes"
Jul 13 17:59:15.790222 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790188    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"]
Jul 13 17:59:15.790664 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790629    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff25662e-a432-4879-8c09-28e54d3372a3" containerName="revoke-keys"
Jul 13 17:59:15.790664 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790641    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff25662e-a432-4879-8c09-28e54d3372a3" containerName="revoke-keys"
Jul 13 17:59:15.790664 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790654    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" containerName="maas-api"
Jul 13 17:59:15.790664 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790660    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" containerName="maas-api"
Jul 13 17:59:15.790827 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790732    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff25662e-a432-4879-8c09-28e54d3372a3" containerName="revoke-keys"
Jul 13 17:59:15.790827 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.790744    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef9fdf7a-21a5-4fcd-a40f-d228a87d75e9" containerName="maas-api"
Jul 13 17:59:15.795134 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.795113    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:15.797811 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.797791    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 17:59:15.801954 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.801930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"]
Jul 13 17:59:15.893844 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.893805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99489f8-9aba-4783-8005-053d5840e942-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62\" (UID: \"c99489f8-9aba-4783-8005-053d5840e942\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:15.994428 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.994387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99489f8-9aba-4783-8005-053d5840e942-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62\" (UID: \"c99489f8-9aba-4783-8005-053d5840e942\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:15.995010 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:15.994991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99489f8-9aba-4783-8005-053d5840e942-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62\" (UID: \"c99489f8-9aba-4783-8005-053d5840e942\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:16.107369 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:16.107262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:16.247136 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:16.247098    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"]
Jul 13 17:59:16.249771 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:59:16.249744    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99489f8_9aba_4783_8005_053d5840e942.slice/crio-9b2f1442a673229244d3d921b53c287396ac7743054b7f77c0728e6a8a2af8b7 WatchSource:0}: Error finding container 9b2f1442a673229244d3d921b53c287396ac7743054b7f77c0728e6a8a2af8b7: Status 404 returned error can't find the container with id 9b2f1442a673229244d3d921b53c287396ac7743054b7f77c0728e6a8a2af8b7
Jul 13 17:59:16.931925 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:16.931883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62" event={"ID":"c99489f8-9aba-4783-8005-053d5840e942","Type":"ContainerStarted","Data":"494c5d3631b9f3d6b01bf390e02c00f129fef8c157c3a386acc4d89fdc371122"}
Jul 13 17:59:16.932346 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:16.931955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62" event={"ID":"c99489f8-9aba-4783-8005-053d5840e942","Type":"ContainerStarted","Data":"9b2f1442a673229244d3d921b53c287396ac7743054b7f77c0728e6a8a2af8b7"}
Jul 13 17:59:16.952436 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:16.952393    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62" podStartSLOduration=1.952376377 podStartE2EDuration="1.952376377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:59:16.950118382 +0000 UTC m=+2495.028310454" watchObservedRunningTime="2026-07-13 17:59:16.952376377 +0000 UTC m=+2495.030568445"
Jul 13 17:59:17.939651 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:17.939614    2577 generic.go:356] "Generic (PLEG): container finished" podID="c99489f8-9aba-4783-8005-053d5840e942" containerID="494c5d3631b9f3d6b01bf390e02c00f129fef8c157c3a386acc4d89fdc371122" exitCode=0
Jul 13 17:59:17.940064 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:17.939706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62" event={"ID":"c99489f8-9aba-4783-8005-053d5840e942","Type":"ContainerDied","Data":"494c5d3631b9f3d6b01bf390e02c00f129fef8c157c3a386acc4d89fdc371122"}
Jul 13 17:59:19.083012 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.082986    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:19.132027 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.131988    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99489f8-9aba-4783-8005-053d5840e942-maas-api-service-ca\") pod \"c99489f8-9aba-4783-8005-053d5840e942\" (UID: \"c99489f8-9aba-4783-8005-053d5840e942\") "
Jul 13 17:59:19.132386 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.132362    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99489f8-9aba-4783-8005-053d5840e942-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c99489f8-9aba-4783-8005-053d5840e942" (UID: "c99489f8-9aba-4783-8005-053d5840e942"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:59:19.232752 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.232661    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c99489f8-9aba-4783-8005-053d5840e942-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:19.952129 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.952102    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62"
Jul 13 17:59:19.952320 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.952106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62" event={"ID":"c99489f8-9aba-4783-8005-053d5840e942","Type":"ContainerDied","Data":"9b2f1442a673229244d3d921b53c287396ac7743054b7f77c0728e6a8a2af8b7"}
Jul 13 17:59:19.952320 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:19.952222    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b2f1442a673229244d3d921b53c287396ac7743054b7f77c0728e6a8a2af8b7"
Jul 13 17:59:26.181855 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.181816    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"]
Jul 13 17:59:26.182454 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.182086    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" podUID="cc2feaf5-c081-40c9-9182-29028452de8f" containerName="maas-api" containerID="cri-o://4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6" gracePeriod=30
Jul 13 17:59:26.439735 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.439661    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:59:26.502496 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.502453    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2feaf5-c081-40c9-9182-29028452de8f-openshift-service-ca\") pod \"cc2feaf5-c081-40c9-9182-29028452de8f\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") "
Jul 13 17:59:26.502707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.502539    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls\") pod \"cc2feaf5-c081-40c9-9182-29028452de8f\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") "
Jul 13 17:59:26.502707 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.502650    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sb4p\" (UniqueName: \"kubernetes.io/projected/cc2feaf5-c081-40c9-9182-29028452de8f-kube-api-access-5sb4p\") pod \"cc2feaf5-c081-40c9-9182-29028452de8f\" (UID: \"cc2feaf5-c081-40c9-9182-29028452de8f\") "
Jul 13 17:59:26.502842 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.502819    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc2feaf5-c081-40c9-9182-29028452de8f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc2feaf5-c081-40c9-9182-29028452de8f" (UID: "cc2feaf5-c081-40c9-9182-29028452de8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:59:26.502961 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.502946    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc2feaf5-c081-40c9-9182-29028452de8f-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:26.504637 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.504609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2feaf5-c081-40c9-9182-29028452de8f-kube-api-access-5sb4p" (OuterVolumeSpecName: "kube-api-access-5sb4p") pod "cc2feaf5-c081-40c9-9182-29028452de8f" (UID: "cc2feaf5-c081-40c9-9182-29028452de8f"). InnerVolumeSpecName "kube-api-access-5sb4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:59:26.504717 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.504647    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc2feaf5-c081-40c9-9182-29028452de8f" (UID: "cc2feaf5-c081-40c9-9182-29028452de8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:59:26.603806 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.603773    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sb4p\" (UniqueName: \"kubernetes.io/projected/cc2feaf5-c081-40c9-9182-29028452de8f-kube-api-access-5sb4p\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:26.603806 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.603804    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc2feaf5-c081-40c9-9182-29028452de8f-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 17:59:26.990593 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.990558    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc2feaf5-c081-40c9-9182-29028452de8f" containerID="4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6" exitCode=0
Jul 13 17:59:26.990779 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.990601    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"
Jul 13 17:59:26.990779 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.990643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" event={"ID":"cc2feaf5-c081-40c9-9182-29028452de8f","Type":"ContainerDied","Data":"4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6"}
Jul 13 17:59:26.990779 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.990698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x" event={"ID":"cc2feaf5-c081-40c9-9182-29028452de8f","Type":"ContainerDied","Data":"f0623e3b8dec5330a83e38e76b700dba1a46704b81140a0eb1b5e859d201b012"}
Jul 13 17:59:26.990779 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:26.990721    2577 scope.go:117] "RemoveContainer" containerID="4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6"
Jul 13 17:59:27.000589 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:27.000569    2577 scope.go:117] "RemoveContainer" containerID="4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6"
Jul 13 17:59:27.000900 ip-10-0-134-215 kubenswrapper[2577]: E0713 17:59:27.000881    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6\": container with ID starting with 4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6 not found: ID does not exist" containerID="4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6"
Jul 13 17:59:27.000946 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:27.000911    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6"} err="failed to get container status \"4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6\": rpc error: code = NotFound desc = could not find container \"4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6\": container with ID starting with 4c9f3a87b120cffb40adda0e2dfc64db03bb7d4793bae58d19182523ceadc5a6 not found: ID does not exist"
Jul 13 17:59:27.013513 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:27.013479    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"]
Jul 13 17:59:27.018075 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:27.018047    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-cb4ffa-7888c67cf9-wq29x"]
Jul 13 17:59:28.428731 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:28.428694    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2feaf5-c081-40c9-9182-29028452de8f" path="/var/lib/kubelet/pods/cc2feaf5-c081-40c9-9182-29028452de8f/volumes"
Jul 13 17:59:45.987358 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.987296    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"]
Jul 13 17:59:45.987952 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.987930    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2feaf5-c081-40c9-9182-29028452de8f" containerName="maas-api"
Jul 13 17:59:45.988036 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.987955    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2feaf5-c081-40c9-9182-29028452de8f" containerName="maas-api"
Jul 13 17:59:45.988036 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.987979    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99489f8-9aba-4783-8005-053d5840e942" containerName="revoke-keys"
Jul 13 17:59:45.988036 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.987988    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99489f8-9aba-4783-8005-053d5840e942" containerName="revoke-keys"
Jul 13 17:59:45.988186 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.988081    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99489f8-9aba-4783-8005-053d5840e942" containerName="revoke-keys"
Jul 13 17:59:45.988186 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.988102    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2feaf5-c081-40c9-9182-29028452de8f" containerName="maas-api"
Jul 13 17:59:45.993001 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.992975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:45.995344 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.995291    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f033d9-serving-cert\""
Jul 13 17:59:45.995487 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:45.995436    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 17:59:46.000048 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.000008    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"]
Jul 13 17:59:46.112200 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.112155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-openshift-service-ca\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.112438 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.112227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd7fh\" (UniqueName: \"kubernetes.io/projected/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-kube-api-access-gd7fh\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.112438 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.112323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-maas-api-tls\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.213693 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.213656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd7fh\" (UniqueName: \"kubernetes.io/projected/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-kube-api-access-gd7fh\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.213693 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.213708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-maas-api-tls\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.213962 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.213808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-openshift-service-ca\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.214423 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.214399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-openshift-service-ca\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.216243 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.216226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-maas-api-tls\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.225385 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.225360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd7fh\" (UniqueName: \"kubernetes.io/projected/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-kube-api-access-gd7fh\") pod \"maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.308374 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.308292    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:46.463527 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:46.463500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"]
Jul 13 17:59:46.465005 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:59:46.464970    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446a3b5a_4e2d_4402_a46d_1d6834ba7dad.slice/crio-163ab65971e95e6c17d69280de52bacfdda274737c02ea9a56e78697235edc83 WatchSource:0}: Error finding container 163ab65971e95e6c17d69280de52bacfdda274737c02ea9a56e78697235edc83: Status 404 returned error can't find the container with id 163ab65971e95e6c17d69280de52bacfdda274737c02ea9a56e78697235edc83
Jul 13 17:59:47.109607 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:47.109573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2" event={"ID":"446a3b5a-4e2d-4402-a46d-1d6834ba7dad","Type":"ContainerStarted","Data":"6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378"}
Jul 13 17:59:47.109988 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:47.109624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2" event={"ID":"446a3b5a-4e2d-4402-a46d-1d6834ba7dad","Type":"ContainerStarted","Data":"163ab65971e95e6c17d69280de52bacfdda274737c02ea9a56e78697235edc83"}
Jul 13 17:59:47.109988 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:47.109655    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:47.128511 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:47.128419    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2" podStartSLOduration=1.6657200030000001 podStartE2EDuration="2.128397733s" totalImagesPullingTime="462.67773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:59:47.127203158 +0000 UTC m=+2525.205395223" watchObservedRunningTime="2026-07-13 17:59:47.128397733 +0000 UTC m=+2525.206589783"
Jul 13 17:59:53.121823 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:53.121794    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 17:59:54.086340 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.086288    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"]
Jul 13 17:59:54.090845 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.090817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.093353 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.093324    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d6c068-serving-cert\""
Jul 13 17:59:54.099145 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.099116    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"]
Jul 13 17:59:54.191698 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.191638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a61297-cdd5-4339-8662-6d261db56f04-openshift-service-ca\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.191698 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.191710    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a61297-cdd5-4339-8662-6d261db56f04-maas-api-tls\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.192139 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.191741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxc9p\" (UniqueName: \"kubernetes.io/projected/11a61297-cdd5-4339-8662-6d261db56f04-kube-api-access-kxc9p\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.293052 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.293010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a61297-cdd5-4339-8662-6d261db56f04-openshift-service-ca\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.293253 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.293083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a61297-cdd5-4339-8662-6d261db56f04-maas-api-tls\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.293253 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.293130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxc9p\" (UniqueName: \"kubernetes.io/projected/11a61297-cdd5-4339-8662-6d261db56f04-kube-api-access-kxc9p\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.293760 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.293742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a61297-cdd5-4339-8662-6d261db56f04-openshift-service-ca\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.295573 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.295557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a61297-cdd5-4339-8662-6d261db56f04-maas-api-tls\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.301312 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.301277    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxc9p\" (UniqueName: \"kubernetes.io/projected/11a61297-cdd5-4339-8662-6d261db56f04-kube-api-access-kxc9p\") pod \"maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.406446 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.406355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:54.557367 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:54.557208    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"]
Jul 13 17:59:54.560129 ip-10-0-134-215 kubenswrapper[2577]: W0713 17:59:54.560102    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a61297_cdd5_4339_8662_6d261db56f04.slice/crio-d7ba47100a68556e5ad2d02af04a7e6212ab0dc77309d4d81f724af3af0ff128 WatchSource:0}: Error finding container d7ba47100a68556e5ad2d02af04a7e6212ab0dc77309d4d81f724af3af0ff128: Status 404 returned error can't find the container with id d7ba47100a68556e5ad2d02af04a7e6212ab0dc77309d4d81f724af3af0ff128
Jul 13 17:59:55.162544 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:55.162438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw" event={"ID":"11a61297-cdd5-4339-8662-6d261db56f04","Type":"ContainerStarted","Data":"9961433f3c9eb5f5b134c3ed98ae7d1aa2920c883edacc14ed9e17bb0a961bd0"}
Jul 13 17:59:55.162544 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:55.162504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw" event={"ID":"11a61297-cdd5-4339-8662-6d261db56f04","Type":"ContainerStarted","Data":"d7ba47100a68556e5ad2d02af04a7e6212ab0dc77309d4d81f724af3af0ff128"}
Jul 13 17:59:55.162544 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:55.162536    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 17:59:55.179344 ip-10-0-134-215 kubenswrapper[2577]: I0713 17:59:55.179256    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw" podStartSLOduration=0.87737246 podStartE2EDuration="1.179238442s" totalImagesPullingTime="301.865982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:59:55.178511337 +0000 UTC m=+2533.256703405" watchObservedRunningTime="2026-07-13 17:59:55.179238442 +0000 UTC m=+2533.257430492"
Jul 13 18:00:00.146163 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.146126    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"]
Jul 13 18:00:00.149854 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.149831    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"]
Jul 13 18:00:00.149988 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.149944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"
Jul 13 18:00:00.152680 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.152658    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 18:00:00.153073 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.153057    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"]
Jul 13 18:00:00.153177 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.153165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"
Jul 13 18:00:00.156292 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.156273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"
Jul 13 18:00:00.161183 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.161163    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"
Jul 13 18:00:00.170783 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.170523    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"]
Jul 13 18:00:00.173216 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.173184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"
Jul 13 18:00:00.174194 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.173641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"]
Jul 13 18:00:00.176379 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.176358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"]
Jul 13 18:00:00.213339 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.213177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"
Jul 13 18:00:00.360340 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.359904    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"]
Jul 13 18:00:00.363955 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:00:00.363917    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c55dbc_c36d_4f41_a098_f71bb4410640.slice/crio-ee8a93c765fde733bea11a048299f339aefa0feaf89283b6fd9781e2411384a9 WatchSource:0}: Error finding container ee8a93c765fde733bea11a048299f339aefa0feaf89283b6fd9781e2411384a9: Status 404 returned error can't find the container with id ee8a93c765fde733bea11a048299f339aefa0feaf89283b6fd9781e2411384a9
Jul 13 18:00:00.383933 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.383901    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"]
Jul 13 18:00:00.384292 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:00:00.384265    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604954d7_946b_42bf_9fe9_f25b3789cc27.slice/crio-6be691f048a4a01a05443b9cd39660414af1c9974df5c81d889a8b3951da0ccf WatchSource:0}: Error finding container 6be691f048a4a01a05443b9cd39660414af1c9974df5c81d889a8b3951da0ccf: Status 404 returned error can't find the container with id 6be691f048a4a01a05443b9cd39660414af1c9974df5c81d889a8b3951da0ccf
Jul 13 18:00:00.412975 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:00.412947    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"]
Jul 13 18:00:00.414267 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:00:00.414246    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3fe05f_7eb0_424c_9336_23a149439427.slice/crio-6c135e9b46d709091c8796876cd7bea05824862436e483e4ea8fd340556188c8 WatchSource:0}: Error finding container 6c135e9b46d709091c8796876cd7bea05824862436e483e4ea8fd340556188c8: Status 404 returned error can't find the container with id 6c135e9b46d709091c8796876cd7bea05824862436e483e4ea8fd340556188c8
Jul 13 18:00:01.173412 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.173384    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 18:00:01.202978 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.202942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc" event={"ID":"604954d7-946b-42bf-9fe9-f25b3789cc27","Type":"ContainerStarted","Data":"c54a20edeb555f5f8e0b1ed12be27f590640940637bfe4f11bb20e5d9437a741"}
Jul 13 18:00:01.203152 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.203018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc" event={"ID":"604954d7-946b-42bf-9fe9-f25b3789cc27","Type":"ContainerStarted","Data":"6be691f048a4a01a05443b9cd39660414af1c9974df5c81d889a8b3951da0ccf"}
Jul 13 18:00:01.204955 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.204924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm" event={"ID":"ad3fe05f-7eb0-424c-9336-23a149439427","Type":"ContainerStarted","Data":"5c036a86e26fa0b412d8e58d65c6a477a840a753218fe07d12c4632191097108"}
Jul 13 18:00:01.205103 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.204982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm" event={"ID":"ad3fe05f-7eb0-424c-9336-23a149439427","Type":"ContainerStarted","Data":"6c135e9b46d709091c8796876cd7bea05824862436e483e4ea8fd340556188c8"}
Jul 13 18:00:01.206870 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.206847    2577 generic.go:356] "Generic (PLEG): container finished" podID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerID="e72da32bb0fd43fbfb54fde10e5cc02bfc3d0b39c293b38d6a2aca59c2acf532" exitCode=7
Jul 13 18:00:01.206990 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.206871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc" event={"ID":"91c55dbc-c36d-4f41-a098-f71bb4410640","Type":"ContainerDied","Data":"e72da32bb0fd43fbfb54fde10e5cc02bfc3d0b39c293b38d6a2aca59c2acf532"}
Jul 13 18:00:01.206990 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.206925    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc" event={"ID":"91c55dbc-c36d-4f41-a098-f71bb4410640","Type":"ContainerStarted","Data":"ee8a93c765fde733bea11a048299f339aefa0feaf89283b6fd9781e2411384a9"}
Jul 13 18:00:01.207081 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.207065    2577 scope.go:117] "RemoveContainer" containerID="e72da32bb0fd43fbfb54fde10e5cc02bfc3d0b39c293b38d6a2aca59c2acf532"
Jul 13 18:00:01.220452 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.220409    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc" podStartSLOduration=1.2203912080000001 podStartE2EDuration="1.220391208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:00:01.219493228 +0000 UTC m=+2539.297685279" watchObservedRunningTime="2026-07-13 18:00:01.220391208 +0000 UTC m=+2539.298583260"
Jul 13 18:00:01.239249 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:01.239192    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm" podStartSLOduration=1.239175252 podStartE2EDuration="1.239175252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:00:01.234636804 +0000 UTC m=+2539.312828885" watchObservedRunningTime="2026-07-13 18:00:01.239175252 +0000 UTC m=+2539.317367303"
Jul 13 18:00:02.215621 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.215590    2577 generic.go:356] "Generic (PLEG): container finished" podID="604954d7-946b-42bf-9fe9-f25b3789cc27" containerID="c54a20edeb555f5f8e0b1ed12be27f590640940637bfe4f11bb20e5d9437a741" exitCode=0
Jul 13 18:00:02.216032 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.215679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc" event={"ID":"604954d7-946b-42bf-9fe9-f25b3789cc27","Type":"ContainerDied","Data":"c54a20edeb555f5f8e0b1ed12be27f590640940637bfe4f11bb20e5d9437a741"}
Jul 13 18:00:02.217124 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.217094    2577 generic.go:356] "Generic (PLEG): container finished" podID="ad3fe05f-7eb0-424c-9336-23a149439427" containerID="5c036a86e26fa0b412d8e58d65c6a477a840a753218fe07d12c4632191097108" exitCode=0
Jul 13 18:00:02.217203 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.217166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm" event={"ID":"ad3fe05f-7eb0-424c-9336-23a149439427","Type":"ContainerDied","Data":"5c036a86e26fa0b412d8e58d65c6a477a840a753218fe07d12c4632191097108"}
Jul 13 18:00:02.218873 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.218849    2577 generic.go:356] "Generic (PLEG): container finished" podID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerID="aa50b94b1273dd1579329e8bb132a22ae8f31b87877b01e381fa66edf3c671ee" exitCode=0
Jul 13 18:00:02.218984 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.218892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc" event={"ID":"91c55dbc-c36d-4f41-a098-f71bb4410640","Type":"ContainerDied","Data":"aa50b94b1273dd1579329e8bb132a22ae8f31b87877b01e381fa66edf3c671ee"}
Jul 13 18:00:02.218984 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:02.218929    2577 scope.go:117] "RemoveContainer" containerID="e72da32bb0fd43fbfb54fde10e5cc02bfc3d0b39c293b38d6a2aca59c2acf532"
Jul 13 18:00:03.408835 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:03.408807    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"
Jul 13 18:00:03.444612 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:03.444584    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"
Jul 13 18:00:03.448998 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:03.448972    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"
Jul 13 18:00:04.233330 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.233286    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm"
Jul 13 18:00:04.233330 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.233297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732760-fc9dm" event={"ID":"ad3fe05f-7eb0-424c-9336-23a149439427","Type":"ContainerDied","Data":"6c135e9b46d709091c8796876cd7bea05824862436e483e4ea8fd340556188c8"}
Jul 13 18:00:04.233596 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.233408    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c135e9b46d709091c8796876cd7bea05824862436e483e4ea8fd340556188c8"
Jul 13 18:00:04.234743 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.234721    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"
Jul 13 18:00:04.234894 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.234754    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc" event={"ID":"91c55dbc-c36d-4f41-a098-f71bb4410640","Type":"ContainerDied","Data":"ee8a93c765fde733bea11a048299f339aefa0feaf89283b6fd9781e2411384a9"}
Jul 13 18:00:04.234894 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.234796    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee8a93c765fde733bea11a048299f339aefa0feaf89283b6fd9781e2411384a9"
Jul 13 18:00:04.236106 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.236076    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"
Jul 13 18:00:04.236242 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.236104    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc" event={"ID":"604954d7-946b-42bf-9fe9-f25b3789cc27","Type":"ContainerDied","Data":"6be691f048a4a01a05443b9cd39660414af1c9974df5c81d889a8b3951da0ccf"}
Jul 13 18:00:04.236242 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:04.236152    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6be691f048a4a01a05443b9cd39660414af1c9974df5c81d889a8b3951da0ccf"
Jul 13 18:00:06.580858 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.580816    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"]
Jul 13 18:00:06.581281 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581260    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerName="cleanup"
Jul 13 18:00:06.581281 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581272    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerName="cleanup"
Jul 13 18:00:06.581377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581291    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerName="cleanup"
Jul 13 18:00:06.581377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581297    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerName="cleanup"
Jul 13 18:00:06.581377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581321    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604954d7-946b-42bf-9fe9-f25b3789cc27" containerName="cleanup"
Jul 13 18:00:06.581377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581327    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="604954d7-946b-42bf-9fe9-f25b3789cc27" containerName="cleanup"
Jul 13 18:00:06.581377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581333    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3fe05f-7eb0-424c-9336-23a149439427" containerName="cleanup"
Jul 13 18:00:06.581377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581338    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3fe05f-7eb0-424c-9336-23a149439427" containerName="cleanup"
Jul 13 18:00:06.581584 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581401    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3fe05f-7eb0-424c-9336-23a149439427" containerName="cleanup"
Jul 13 18:00:06.581584 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581409    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerName="cleanup"
Jul 13 18:00:06.581584 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581415    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="604954d7-946b-42bf-9fe9-f25b3789cc27" containerName="cleanup"
Jul 13 18:00:06.581584 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.581426    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" containerName="cleanup"
Jul 13 18:00:06.584797 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.584778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:06.587318 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.587279    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 18:00:06.593107 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.592823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"]
Jul 13 18:00:06.716275 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.716231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/775b629f-3683-4c32-ab18-cdbbf8804ae8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv\" (UID: \"775b629f-3683-4c32-ab18-cdbbf8804ae8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:06.817503 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.817464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/775b629f-3683-4c32-ab18-cdbbf8804ae8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv\" (UID: \"775b629f-3683-4c32-ab18-cdbbf8804ae8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:06.818125 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.818103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/775b629f-3683-4c32-ab18-cdbbf8804ae8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv\" (UID: \"775b629f-3683-4c32-ab18-cdbbf8804ae8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:06.897279 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:06.897184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:07.042344 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:07.042314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"]
Jul 13 18:00:07.044332 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:00:07.044276    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775b629f_3683_4c32_ab18_cdbbf8804ae8.slice/crio-9604266f85da5d91753028085ab2da45a8a02747b38490830c14a9deadf8a8fa WatchSource:0}: Error finding container 9604266f85da5d91753028085ab2da45a8a02747b38490830c14a9deadf8a8fa: Status 404 returned error can't find the container with id 9604266f85da5d91753028085ab2da45a8a02747b38490830c14a9deadf8a8fa
Jul 13 18:00:07.254669 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:07.254638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv" event={"ID":"775b629f-3683-4c32-ab18-cdbbf8804ae8","Type":"ContainerStarted","Data":"9604266f85da5d91753028085ab2da45a8a02747b38490830c14a9deadf8a8fa"}
Jul 13 18:00:08.262553 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:08.262516    2577 generic.go:356] "Generic (PLEG): container finished" podID="775b629f-3683-4c32-ab18-cdbbf8804ae8" containerID="751ef6ec313d54f0b6c5b17a8f1a8abccfb5f7a33e0c7f2df4d60bd01a0ceb08" exitCode=0
Jul 13 18:00:08.262964 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:08.262573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv" event={"ID":"775b629f-3683-4c32-ab18-cdbbf8804ae8","Type":"ContainerDied","Data":"751ef6ec313d54f0b6c5b17a8f1a8abccfb5f7a33e0c7f2df4d60bd01a0ceb08"}
Jul 13 18:00:09.412640 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:09.412614    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:09.548534 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:09.548436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/775b629f-3683-4c32-ab18-cdbbf8804ae8-maas-api-service-ca\") pod \"775b629f-3683-4c32-ab18-cdbbf8804ae8\" (UID: \"775b629f-3683-4c32-ab18-cdbbf8804ae8\") "
Jul 13 18:00:09.548859 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:09.548832    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/775b629f-3683-4c32-ab18-cdbbf8804ae8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "775b629f-3683-4c32-ab18-cdbbf8804ae8" (UID: "775b629f-3683-4c32-ab18-cdbbf8804ae8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:00:09.649739 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:09.649699    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/775b629f-3683-4c32-ab18-cdbbf8804ae8-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:10.275557 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:10.275524    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv"
Jul 13 18:00:10.275557 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:10.275536    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv" event={"ID":"775b629f-3683-4c32-ab18-cdbbf8804ae8","Type":"ContainerDied","Data":"9604266f85da5d91753028085ab2da45a8a02747b38490830c14a9deadf8a8fa"}
Jul 13 18:00:10.275771 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:10.275613    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9604266f85da5d91753028085ab2da45a8a02747b38490830c14a9deadf8a8fa"
Jul 13 18:00:17.623161 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:17.623122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"]
Jul 13 18:00:17.623844 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:17.623404    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2" podUID="446a3b5a-4e2d-4402-a46d-1d6834ba7dad" containerName="maas-api" containerID="cri-o://6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378" gracePeriod=30
Jul 13 18:00:17.663553 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:17.663513    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"]
Jul 13 18:00:17.666645 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:17.666618    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-f033d9-29732760-fzpqc"]
Jul 13 18:00:17.874116 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:17.874041    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 18:00:18.035348 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.035313    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd7fh\" (UniqueName: \"kubernetes.io/projected/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-kube-api-access-gd7fh\") pod \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") "
Jul 13 18:00:18.035507 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.035358    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-openshift-service-ca\") pod \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") "
Jul 13 18:00:18.035507 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.035384    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-maas-api-tls\") pod \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\" (UID: \"446a3b5a-4e2d-4402-a46d-1d6834ba7dad\") "
Jul 13 18:00:18.035781 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.035757    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "446a3b5a-4e2d-4402-a46d-1d6834ba7dad" (UID: "446a3b5a-4e2d-4402-a46d-1d6834ba7dad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:00:18.037621 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.037596    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "446a3b5a-4e2d-4402-a46d-1d6834ba7dad" (UID: "446a3b5a-4e2d-4402-a46d-1d6834ba7dad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:00:18.037685 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.037609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-kube-api-access-gd7fh" (OuterVolumeSpecName: "kube-api-access-gd7fh") pod "446a3b5a-4e2d-4402-a46d-1d6834ba7dad" (UID: "446a3b5a-4e2d-4402-a46d-1d6834ba7dad"). InnerVolumeSpecName "kube-api-access-gd7fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:00:18.136603 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.136519    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd7fh\" (UniqueName: \"kubernetes.io/projected/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-kube-api-access-gd7fh\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:18.136603 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.136550    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:18.136603 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.136561    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a3b5a-4e2d-4402-a46d-1d6834ba7dad-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:18.321824 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.321787    2577 generic.go:356] "Generic (PLEG): container finished" podID="446a3b5a-4e2d-4402-a46d-1d6834ba7dad" containerID="6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378" exitCode=0
Jul 13 18:00:18.322018 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.321831    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"
Jul 13 18:00:18.322018 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.321872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2" event={"ID":"446a3b5a-4e2d-4402-a46d-1d6834ba7dad","Type":"ContainerDied","Data":"6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378"}
Jul 13 18:00:18.322018 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.321923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2" event={"ID":"446a3b5a-4e2d-4402-a46d-1d6834ba7dad","Type":"ContainerDied","Data":"163ab65971e95e6c17d69280de52bacfdda274737c02ea9a56e78697235edc83"}
Jul 13 18:00:18.322018 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.321945    2577 scope.go:117] "RemoveContainer" containerID="6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378"
Jul 13 18:00:18.334713 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.334689    2577 scope.go:117] "RemoveContainer" containerID="6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378"
Jul 13 18:00:18.335014 ip-10-0-134-215 kubenswrapper[2577]: E0713 18:00:18.334995    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378\": container with ID starting with 6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378 not found: ID does not exist" containerID="6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378"
Jul 13 18:00:18.335074 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.335026    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378"} err="failed to get container status \"6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378\": rpc error: code = NotFound desc = could not find container \"6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378\": container with ID starting with 6fe9baca100443b5addc485ae2eafe628d5a0e13da214dd5c902bdbaf0e2e378 not found: ID does not exist"
Jul 13 18:00:18.348012 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.347979    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"]
Jul 13 18:00:18.352722 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.352695    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f033d9-5b54dbddf6-n99h2"]
Jul 13 18:00:18.422851 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.422773    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446a3b5a-4e2d-4402-a46d-1d6834ba7dad" path="/var/lib/kubelet/pods/446a3b5a-4e2d-4402-a46d-1d6834ba7dad/volumes"
Jul 13 18:00:18.423081 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:18.423068    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604954d7-946b-42bf-9fe9-f25b3789cc27" path="/var/lib/kubelet/pods/604954d7-946b-42bf-9fe9-f25b3789cc27/volumes"
Jul 13 18:00:32.863000 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.862950    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"]
Jul 13 18:00:32.863529 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.863449    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446a3b5a-4e2d-4402-a46d-1d6834ba7dad" containerName="maas-api"
Jul 13 18:00:32.863529 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.863464    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="446a3b5a-4e2d-4402-a46d-1d6834ba7dad" containerName="maas-api"
Jul 13 18:00:32.863529 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.863480    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775b629f-3683-4c32-ab18-cdbbf8804ae8" containerName="revoke-keys"
Jul 13 18:00:32.863529 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.863486    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="775b629f-3683-4c32-ab18-cdbbf8804ae8" containerName="revoke-keys"
Jul 13 18:00:32.863664 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.863543    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="775b629f-3683-4c32-ab18-cdbbf8804ae8" containerName="revoke-keys"
Jul 13 18:00:32.863664 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.863553    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="446a3b5a-4e2d-4402-a46d-1d6834ba7dad" containerName="maas-api"
Jul 13 18:00:32.867044 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.867023    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:32.870512 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.870485    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 18:00:32.878745 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.878712    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"]
Jul 13 18:00:32.883437 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.883400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/948c134a-c957-41be-916a-aec471f7fe3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw\" (UID: \"948c134a-c957-41be-916a-aec471f7fe3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:32.984806 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.984755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/948c134a-c957-41be-916a-aec471f7fe3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw\" (UID: \"948c134a-c957-41be-916a-aec471f7fe3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:32.985566 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:32.985536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/948c134a-c957-41be-916a-aec471f7fe3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw\" (UID: \"948c134a-c957-41be-916a-aec471f7fe3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:33.179474 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:33.179383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:33.333853 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:33.333825    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"]
Jul 13 18:00:33.335360 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:00:33.335331    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948c134a_c957_41be_916a_aec471f7fe3a.slice/crio-5c344cccfe3a3a3299cff959416aefb817f2da7ad6910c890e6baa4a077704a5 WatchSource:0}: Error finding container 5c344cccfe3a3a3299cff959416aefb817f2da7ad6910c890e6baa4a077704a5: Status 404 returned error can't find the container with id 5c344cccfe3a3a3299cff959416aefb817f2da7ad6910c890e6baa4a077704a5
Jul 13 18:00:33.411933 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:33.411899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw" event={"ID":"948c134a-c957-41be-916a-aec471f7fe3a","Type":"ContainerStarted","Data":"5c344cccfe3a3a3299cff959416aefb817f2da7ad6910c890e6baa4a077704a5"}
Jul 13 18:00:34.419567 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:34.419485    2577 generic.go:356] "Generic (PLEG): container finished" podID="948c134a-c957-41be-916a-aec471f7fe3a" containerID="338fe12492828af754df8d855656fb073f5bdc4d8896bfb75a04292e7b7b1179" exitCode=0
Jul 13 18:00:34.422169 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:34.422140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw" event={"ID":"948c134a-c957-41be-916a-aec471f7fe3a","Type":"ContainerDied","Data":"338fe12492828af754df8d855656fb073f5bdc4d8896bfb75a04292e7b7b1179"}
Jul 13 18:00:35.568732 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:35.568708    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:35.611172 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:35.611142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/948c134a-c957-41be-916a-aec471f7fe3a-maas-api-service-ca\") pod \"948c134a-c957-41be-916a-aec471f7fe3a\" (UID: \"948c134a-c957-41be-916a-aec471f7fe3a\") "
Jul 13 18:00:35.611565 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:35.611542    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/948c134a-c957-41be-916a-aec471f7fe3a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "948c134a-c957-41be-916a-aec471f7fe3a" (UID: "948c134a-c957-41be-916a-aec471f7fe3a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:00:35.712676 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:35.712567    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/948c134a-c957-41be-916a-aec471f7fe3a-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:36.439511 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:36.439477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw" event={"ID":"948c134a-c957-41be-916a-aec471f7fe3a","Type":"ContainerDied","Data":"5c344cccfe3a3a3299cff959416aefb817f2da7ad6910c890e6baa4a077704a5"}
Jul 13 18:00:36.439511 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:36.439498    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw"
Jul 13 18:00:36.439721 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:36.439567    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c344cccfe3a3a3299cff959416aefb817f2da7ad6910c890e6baa4a077704a5"
Jul 13 18:00:43.335689 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.335650    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"]
Jul 13 18:00:43.336278 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.335910    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw" podUID="11a61297-cdd5-4339-8662-6d261db56f04" containerName="maas-api" containerID="cri-o://9961433f3c9eb5f5b134c3ed98ae7d1aa2920c883edacc14ed9e17bb0a961bd0" gracePeriod=30
Jul 13 18:00:43.370218 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.370180    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"]
Jul 13 18:00:43.372250 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.372227    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-d6c068-29732760-gltbc"]
Jul 13 18:00:43.485892 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.485855    2577 generic.go:356] "Generic (PLEG): container finished" podID="11a61297-cdd5-4339-8662-6d261db56f04" containerID="9961433f3c9eb5f5b134c3ed98ae7d1aa2920c883edacc14ed9e17bb0a961bd0" exitCode=0
Jul 13 18:00:43.486075 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.486035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw" event={"ID":"11a61297-cdd5-4339-8662-6d261db56f04","Type":"ContainerDied","Data":"9961433f3c9eb5f5b134c3ed98ae7d1aa2920c883edacc14ed9e17bb0a961bd0"}
Jul 13 18:00:43.603802 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.603779    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 18:00:43.692857 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.692826    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a61297-cdd5-4339-8662-6d261db56f04-maas-api-tls\") pod \"11a61297-cdd5-4339-8662-6d261db56f04\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") "
Jul 13 18:00:43.693020 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.692916    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a61297-cdd5-4339-8662-6d261db56f04-openshift-service-ca\") pod \"11a61297-cdd5-4339-8662-6d261db56f04\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") "
Jul 13 18:00:43.693020 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.692944    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxc9p\" (UniqueName: \"kubernetes.io/projected/11a61297-cdd5-4339-8662-6d261db56f04-kube-api-access-kxc9p\") pod \"11a61297-cdd5-4339-8662-6d261db56f04\" (UID: \"11a61297-cdd5-4339-8662-6d261db56f04\") "
Jul 13 18:00:43.693270 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.693247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a61297-cdd5-4339-8662-6d261db56f04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11a61297-cdd5-4339-8662-6d261db56f04" (UID: "11a61297-cdd5-4339-8662-6d261db56f04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:00:43.694914 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.694892    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a61297-cdd5-4339-8662-6d261db56f04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11a61297-cdd5-4339-8662-6d261db56f04" (UID: "11a61297-cdd5-4339-8662-6d261db56f04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:00:43.694982 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.694930    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a61297-cdd5-4339-8662-6d261db56f04-kube-api-access-kxc9p" (OuterVolumeSpecName: "kube-api-access-kxc9p") pod "11a61297-cdd5-4339-8662-6d261db56f04" (UID: "11a61297-cdd5-4339-8662-6d261db56f04"). InnerVolumeSpecName "kube-api-access-kxc9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:00:43.793930 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.793895    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a61297-cdd5-4339-8662-6d261db56f04-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:43.793930 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.793922    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a61297-cdd5-4339-8662-6d261db56f04-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:43.793930 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:43.793933    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxc9p\" (UniqueName: \"kubernetes.io/projected/11a61297-cdd5-4339-8662-6d261db56f04-kube-api-access-kxc9p\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:00:44.422837 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:44.422804    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c55dbc-c36d-4f41-a098-f71bb4410640" path="/var/lib/kubelet/pods/91c55dbc-c36d-4f41-a098-f71bb4410640/volumes"
Jul 13 18:00:44.493107 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:44.493081    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"
Jul 13 18:00:44.493273 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:44.493102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw" event={"ID":"11a61297-cdd5-4339-8662-6d261db56f04","Type":"ContainerDied","Data":"d7ba47100a68556e5ad2d02af04a7e6212ab0dc77309d4d81f724af3af0ff128"}
Jul 13 18:00:44.493273 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:44.493175    2577 scope.go:117] "RemoveContainer" containerID="9961433f3c9eb5f5b134c3ed98ae7d1aa2920c883edacc14ed9e17bb0a961bd0"
Jul 13 18:00:44.516598 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:44.516571    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"]
Jul 13 18:00:44.518708 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:44.518687    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d6c068-df4bb6f7f-wrnjw"]
Jul 13 18:00:46.423734 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:00:46.423696    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a61297-cdd5-4339-8662-6d261db56f04" path="/var/lib/kubelet/pods/11a61297-cdd5-4339-8662-6d261db56f04/volumes"
Jul 13 18:01:02.685665 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.685622    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"]
Jul 13 18:01:02.686334 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.686280    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948c134a-c957-41be-916a-aec471f7fe3a" containerName="revoke-keys"
Jul 13 18:01:02.686334 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.686322    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="948c134a-c957-41be-916a-aec471f7fe3a" containerName="revoke-keys"
Jul 13 18:01:02.686497 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.686361    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a61297-cdd5-4339-8662-6d261db56f04" containerName="maas-api"
Jul 13 18:01:02.686497 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.686370    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a61297-cdd5-4339-8662-6d261db56f04" containerName="maas-api"
Jul 13 18:01:02.686497 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.686483    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a61297-cdd5-4339-8662-6d261db56f04" containerName="maas-api"
Jul 13 18:01:02.686652 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.686505    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="948c134a-c957-41be-916a-aec471f7fe3a" containerName="revoke-keys"
Jul 13 18:01:02.690313 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.690273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.693757 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.693732    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qt2bw\""
Jul 13 18:01:02.693910 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.693845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f54db3-serving-cert\""
Jul 13 18:01:02.700641 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.700607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"]
Jul 13 18:01:02.789246 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.789203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfdp\" (UniqueName: \"kubernetes.io/projected/4fa82708-fc2a-49b3-87a3-df052d106663-kube-api-access-qvfdp\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.789458 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.789366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa82708-fc2a-49b3-87a3-df052d106663-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.789458 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.789397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.890316 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.890273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfdp\" (UniqueName: \"kubernetes.io/projected/4fa82708-fc2a-49b3-87a3-df052d106663-kube-api-access-qvfdp\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.890521 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.890431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa82708-fc2a-49b3-87a3-df052d106663-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.890521 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.890453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.890643 ip-10-0-134-215 kubenswrapper[2577]: E0713 18:01:02.890569    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-serving-cert: secret "maas-api-e2e-shared-a-f54db3-serving-cert" not found
Jul 13 18:01:02.890643 ip-10-0-134-215 kubenswrapper[2577]: E0713 18:01:02.890637    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls podName:4fa82708-fc2a-49b3-87a3-df052d106663 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:03.390617467 +0000 UTC m=+2601.468809496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls") pod "maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" (UID: "4fa82708-fc2a-49b3-87a3-df052d106663") : secret "maas-api-e2e-shared-a-f54db3-serving-cert" not found
Jul 13 18:01:02.891154 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.891132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa82708-fc2a-49b3-87a3-df052d106663-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:02.911892 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:02.911857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfdp\" (UniqueName: \"kubernetes.io/projected/4fa82708-fc2a-49b3-87a3-df052d106663-kube-api-access-qvfdp\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:03.396415 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:03.396364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:03.398905 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:03.398871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls\") pod \"maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:03.604266 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:03.604228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:03.781737 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:03.781709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"]
Jul 13 18:01:03.783890 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:01:03.783863    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa82708_fc2a_49b3_87a3_df052d106663.slice/crio-460a25204ee5d967defe43cc2581d8ef7de3270cbdab100c6c1488fabe33a756 WatchSource:0}: Error finding container 460a25204ee5d967defe43cc2581d8ef7de3270cbdab100c6c1488fabe33a756: Status 404 returned error can't find the container with id 460a25204ee5d967defe43cc2581d8ef7de3270cbdab100c6c1488fabe33a756
Jul 13 18:01:04.611696 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:04.611658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" event={"ID":"4fa82708-fc2a-49b3-87a3-df052d106663","Type":"ContainerStarted","Data":"e7b36ca0c61a757d59c4d68454ed3cad213c7304fd89c3d54e7b1c339ba3f878"}
Jul 13 18:01:04.611908 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:04.611722    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:04.611908 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:04.611737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" event={"ID":"4fa82708-fc2a-49b3-87a3-df052d106663","Type":"ContainerStarted","Data":"460a25204ee5d967defe43cc2581d8ef7de3270cbdab100c6c1488fabe33a756"}
Jul 13 18:01:04.629585 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:04.629534    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" podStartSLOduration=1.995937225 podStartE2EDuration="2.62951647s" totalImagesPullingTime="633.579245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:04.627692093 +0000 UTC m=+2602.705884164" watchObservedRunningTime="2026-07-13 18:01:04.62951647 +0000 UTC m=+2602.707708520"
Jul 13 18:01:10.623748 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.623711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:01:10.823739 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.823703    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"]
Jul 13 18:01:10.827600 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.827581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.831588 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.831560    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b57346-serving-cert\""
Jul 13 18:01:10.853400 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.853364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"]
Jul 13 18:01:10.859767 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.859726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tscgw\" (UniqueName: \"kubernetes.io/projected/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-kube-api-access-tscgw\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.859965 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.859795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.859965 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.859843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.961458 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.961358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.961631 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.961491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tscgw\" (UniqueName: \"kubernetes.io/projected/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-kube-api-access-tscgw\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.961631 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.961544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.962188 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.962164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.963867 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.963836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:10.976650 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:10.976622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tscgw\" (UniqueName: \"kubernetes.io/projected/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-kube-api-access-tscgw\") pod \"maas-api-e2e-shared-b-b57346-5f68758466-ktrk2\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:11.138230 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:11.138192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:11.334703 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:11.334676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"]
Jul 13 18:01:11.340348 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:01:11.340293    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f2dcee_30df_4b24_acec_cd2bbc2b5e9e.slice/crio-a0a54442398077765e6d7319dd8679edcf4d6355f189160493a18cf54442e65d WatchSource:0}: Error finding container a0a54442398077765e6d7319dd8679edcf4d6355f189160493a18cf54442e65d: Status 404 returned error can't find the container with id a0a54442398077765e6d7319dd8679edcf4d6355f189160493a18cf54442e65d
Jul 13 18:01:11.656025 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:11.655981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2" event={"ID":"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e","Type":"ContainerStarted","Data":"a0a54442398077765e6d7319dd8679edcf4d6355f189160493a18cf54442e65d"}
Jul 13 18:01:12.663558 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:12.663525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2" event={"ID":"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e","Type":"ContainerStarted","Data":"dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce"}
Jul 13 18:01:12.664006 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:12.663638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:01:12.684240 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:12.684186    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2" podStartSLOduration=2.09883479 podStartE2EDuration="2.684168352s" totalImagesPullingTime="585.333562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:12.68257482 +0000 UTC m=+2610.760766869" watchObservedRunningTime="2026-07-13 18:01:12.684168352 +0000 UTC m=+2610.762360401"
Jul 13 18:01:18.675630 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:01:18.675601    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:02:42.578553 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:02:42.578521    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 18:02:42.583199 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:02:42.583163    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 18:02:42.588027 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:02:42.587999    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 18:02:42.592773 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:02:42.592750    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 18:06:42.756853 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:06:42.756822    2577 scope.go:117] "RemoveContainer" containerID="c54a20edeb555f5f8e0b1ed12be27f590640940637bfe4f11bb20e5d9437a741"
Jul 13 18:06:42.768817 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:06:42.768796    2577 scope.go:117] "RemoveContainer" containerID="aa50b94b1273dd1579329e8bb132a22ae8f31b87877b01e381fa66edf3c671ee"
Jul 13 18:07:21.094664 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.094583    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7446-139629445247664"]
Jul 13 18:07:21.098459 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.098442    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:21.100991 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.100968    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-tbcbl\""
Jul 13 18:07:21.102189 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.102168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445247664"]
Jul 13 18:07:21.244468 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.244430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfnts\" (UniqueName: \"kubernetes.io/projected/3b620ed1-1742-455a-8e62-1f46529d9078-kube-api-access-dfnts\") pod \"test-curl-7446-139629445247664\" (UID: \"3b620ed1-1742-455a-8e62-1f46529d9078\") " pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:21.345953 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.345862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfnts\" (UniqueName: \"kubernetes.io/projected/3b620ed1-1742-455a-8e62-1f46529d9078-kube-api-access-dfnts\") pod \"test-curl-7446-139629445247664\" (UID: \"3b620ed1-1742-455a-8e62-1f46529d9078\") " pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:21.354027 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.353991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfnts\" (UniqueName: \"kubernetes.io/projected/3b620ed1-1742-455a-8e62-1f46529d9078-kube-api-access-dfnts\") pod \"test-curl-7446-139629445247664\" (UID: \"3b620ed1-1742-455a-8e62-1f46529d9078\") " pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:21.408761 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.408724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:21.547746 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.547712    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445247664"]
Jul 13 18:07:21.549418 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:07:21.549394    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b620ed1_1742_455a_8e62_1f46529d9078.slice/crio-96eca7b8f9284eb0c6d9c071b716a0855ee811504e85428f18809216abcc2e26 WatchSource:0}: Error finding container 96eca7b8f9284eb0c6d9c071b716a0855ee811504e85428f18809216abcc2e26: Status 404 returned error can't find the container with id 96eca7b8f9284eb0c6d9c071b716a0855ee811504e85428f18809216abcc2e26
Jul 13 18:07:21.550796 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.550778    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:07:21.797503 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:21.797461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445247664" event={"ID":"3b620ed1-1742-455a-8e62-1f46529d9078","Type":"ContainerStarted","Data":"96eca7b8f9284eb0c6d9c071b716a0855ee811504e85428f18809216abcc2e26"}
Jul 13 18:07:22.804371 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:22.804334    2577 generic.go:356] "Generic (PLEG): container finished" podID="3b620ed1-1742-455a-8e62-1f46529d9078" containerID="52373dfa8154101fc07f98b331d687050b494dc8509ea24d014262c42a7e8d38" exitCode=0
Jul 13 18:07:22.804762 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:22.804413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445247664" event={"ID":"3b620ed1-1742-455a-8e62-1f46529d9078","Type":"ContainerDied","Data":"52373dfa8154101fc07f98b331d687050b494dc8509ea24d014262c42a7e8d38"}
Jul 13 18:07:23.955205 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:23.955174    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:23.990948 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:23.990917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7446-139629445247664_3b620ed1-1742-455a-8e62-1f46529d9078/test-curl-7446-139629445247664/0.log"
Jul 13 18:07:24.015285 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.015259    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7446-139629445247664"]
Jul 13 18:07:24.019842 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.019816    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7446-139629445247664"]
Jul 13 18:07:24.073419 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.073297    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfnts\" (UniqueName: \"kubernetes.io/projected/3b620ed1-1742-455a-8e62-1f46529d9078-kube-api-access-dfnts\") pod \"3b620ed1-1742-455a-8e62-1f46529d9078\" (UID: \"3b620ed1-1742-455a-8e62-1f46529d9078\") "
Jul 13 18:07:24.075530 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.075493    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b620ed1-1742-455a-8e62-1f46529d9078-kube-api-access-dfnts" (OuterVolumeSpecName: "kube-api-access-dfnts") pod "3b620ed1-1742-455a-8e62-1f46529d9078" (UID: "3b620ed1-1742-455a-8e62-1f46529d9078"). InnerVolumeSpecName "kube-api-access-dfnts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:24.174510 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.174468    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfnts\" (UniqueName: \"kubernetes.io/projected/3b620ed1-1742-455a-8e62-1f46529d9078-kube-api-access-dfnts\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:24.189339 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.189290    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:24.189742 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.189729    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b620ed1-1742-455a-8e62-1f46529d9078" containerName="test-curl-7446-139629445247664"
Jul 13 18:07:24.189790 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.189743    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b620ed1-1742-455a-8e62-1f46529d9078" containerName="test-curl-7446-139629445247664"
Jul 13 18:07:24.189825 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.189805    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b620ed1-1742-455a-8e62-1f46529d9078" containerName="test-curl-7446-139629445247664"
Jul 13 18:07:24.192921 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.192899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:24.200323 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.199457    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:24.275885 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.275841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h7xl\" (UniqueName: \"kubernetes.io/projected/193f0705-0125-4cd5-93b7-271f3455bb30-kube-api-access-8h7xl\") pod \"test-curl-7446-139629445095472\" (UID: \"193f0705-0125-4cd5-93b7-271f3455bb30\") " pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:24.377186 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.377086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h7xl\" (UniqueName: \"kubernetes.io/projected/193f0705-0125-4cd5-93b7-271f3455bb30-kube-api-access-8h7xl\") pod \"test-curl-7446-139629445095472\" (UID: \"193f0705-0125-4cd5-93b7-271f3455bb30\") " pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:24.385182 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.385155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h7xl\" (UniqueName: \"kubernetes.io/projected/193f0705-0125-4cd5-93b7-271f3455bb30-kube-api-access-8h7xl\") pod \"test-curl-7446-139629445095472\" (UID: \"193f0705-0125-4cd5-93b7-271f3455bb30\") " pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:24.422836 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.422802    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b620ed1-1742-455a-8e62-1f46529d9078" path="/var/lib/kubelet/pods/3b620ed1-1742-455a-8e62-1f46529d9078/volumes"
Jul 13 18:07:24.506412 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.506366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:24.640861 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.640835    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:24.642203 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:07:24.642172    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod193f0705_0125_4cd5_93b7_271f3455bb30.slice/crio-7dd43dca223ca6c49231aa30e0b88a897850f3cc3585da585a5856b45ecbae03 WatchSource:0}: Error finding container 7dd43dca223ca6c49231aa30e0b88a897850f3cc3585da585a5856b45ecbae03: Status 404 returned error can't find the container with id 7dd43dca223ca6c49231aa30e0b88a897850f3cc3585da585a5856b45ecbae03
Jul 13 18:07:24.817503 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.817475    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445247664"
Jul 13 18:07:24.817503 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.817513    2577 scope.go:117] "RemoveContainer" containerID="52373dfa8154101fc07f98b331d687050b494dc8509ea24d014262c42a7e8d38"
Jul 13 18:07:24.818930 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:24.818848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445095472" event={"ID":"193f0705-0125-4cd5-93b7-271f3455bb30","Type":"ContainerStarted","Data":"7dd43dca223ca6c49231aa30e0b88a897850f3cc3585da585a5856b45ecbae03"}
Jul 13 18:07:25.825963 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:25.825927    2577 generic.go:356] "Generic (PLEG): container finished" podID="193f0705-0125-4cd5-93b7-271f3455bb30" containerID="e579e3fb57038216382e7895b34ea57cc7fe663ff3d89bddaf45d348f12857d5" exitCode=0
Jul 13 18:07:25.826416 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:25.826018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445095472" event={"ID":"193f0705-0125-4cd5-93b7-271f3455bb30","Type":"ContainerDied","Data":"e579e3fb57038216382e7895b34ea57cc7fe663ff3d89bddaf45d348f12857d5"}
Jul 13 18:07:26.981477 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:26.981451    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.002744 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.002715    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7446-139629445095472_193f0705-0125-4cd5-93b7-271f3455bb30/test-curl-7446-139629445095472/0.log"
Jul 13 18:07:27.028082 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.028044    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:27.032499 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.032471    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:27.101860 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.101781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h7xl\" (UniqueName: \"kubernetes.io/projected/193f0705-0125-4cd5-93b7-271f3455bb30-kube-api-access-8h7xl\") pod \"193f0705-0125-4cd5-93b7-271f3455bb30\" (UID: \"193f0705-0125-4cd5-93b7-271f3455bb30\") "
Jul 13 18:07:27.103819 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.103794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193f0705-0125-4cd5-93b7-271f3455bb30-kube-api-access-8h7xl" (OuterVolumeSpecName: "kube-api-access-8h7xl") pod "193f0705-0125-4cd5-93b7-271f3455bb30" (UID: "193f0705-0125-4cd5-93b7-271f3455bb30"). InnerVolumeSpecName "kube-api-access-8h7xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:27.149072 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.149036    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:27.149504 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.149490    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193f0705-0125-4cd5-93b7-271f3455bb30" containerName="test-curl-7446-139629445095472"
Jul 13 18:07:27.149559 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.149506    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="193f0705-0125-4cd5-93b7-271f3455bb30" containerName="test-curl-7446-139629445095472"
Jul 13 18:07:27.149595 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.149585    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="193f0705-0125-4cd5-93b7-271f3455bb30" containerName="test-curl-7446-139629445095472"
Jul 13 18:07:27.152629 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.152613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.157139 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.157103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:27.203325 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.203267    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h7xl\" (UniqueName: \"kubernetes.io/projected/193f0705-0125-4cd5-93b7-271f3455bb30-kube-api-access-8h7xl\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:27.303974 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.303934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9ck\" (UniqueName: \"kubernetes.io/projected/38cbca39-4a36-4c6c-929a-66df67f0254c-kube-api-access-jc9ck\") pod \"test-curl-7446-139629445095472\" (UID: \"38cbca39-4a36-4c6c-929a-66df67f0254c\") " pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.405615 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.405525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9ck\" (UniqueName: \"kubernetes.io/projected/38cbca39-4a36-4c6c-929a-66df67f0254c-kube-api-access-jc9ck\") pod \"test-curl-7446-139629445095472\" (UID: \"38cbca39-4a36-4c6c-929a-66df67f0254c\") " pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.413297 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.413273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9ck\" (UniqueName: \"kubernetes.io/projected/38cbca39-4a36-4c6c-929a-66df67f0254c-kube-api-access-jc9ck\") pod \"test-curl-7446-139629445095472\" (UID: \"38cbca39-4a36-4c6c-929a-66df67f0254c\") " pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.462922 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.462889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.601746 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.601720    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:27.603182 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:07:27.603158    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38cbca39_4a36_4c6c_929a_66df67f0254c.slice/crio-d1063e8efd262235e2ed8cf32ebbe4c1e3d90b33c49dbe9227f1a4ab4867310c WatchSource:0}: Error finding container d1063e8efd262235e2ed8cf32ebbe4c1e3d90b33c49dbe9227f1a4ab4867310c: Status 404 returned error can't find the container with id d1063e8efd262235e2ed8cf32ebbe4c1e3d90b33c49dbe9227f1a4ab4867310c
Jul 13 18:07:27.838850 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.838813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445095472" event={"ID":"38cbca39-4a36-4c6c-929a-66df67f0254c","Type":"ContainerStarted","Data":"d1063e8efd262235e2ed8cf32ebbe4c1e3d90b33c49dbe9227f1a4ab4867310c"}
Jul 13 18:07:27.840211 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.840182    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd43dca223ca6c49231aa30e0b88a897850f3cc3585da585a5856b45ecbae03"
Jul 13 18:07:27.840211 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.840187    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:27.851659 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:27.851628    2577 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7446-139629445095472" oldPodUID="193f0705-0125-4cd5-93b7-271f3455bb30" podUID="38cbca39-4a36-4c6c-929a-66df67f0254c"
Jul 13 18:07:28.423480 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:28.423444    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193f0705-0125-4cd5-93b7-271f3455bb30" path="/var/lib/kubelet/pods/193f0705-0125-4cd5-93b7-271f3455bb30/volumes"
Jul 13 18:07:28.847482 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:28.847448    2577 generic.go:356] "Generic (PLEG): container finished" podID="38cbca39-4a36-4c6c-929a-66df67f0254c" containerID="e52cac8b35ab78187b1c3240a4fd4177dce125a9dbf15f3f73f5261433cf735b" exitCode=0
Jul 13 18:07:28.847644 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:28.847480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445095472" event={"ID":"38cbca39-4a36-4c6c-929a-66df67f0254c","Type":"ContainerDied","Data":"e52cac8b35ab78187b1c3240a4fd4177dce125a9dbf15f3f73f5261433cf735b"}
Jul 13 18:07:30.001402 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.001376    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:30.022822 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.022796    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7446-139629445095472_38cbca39-4a36-4c6c-929a-66df67f0254c/test-curl-7446-139629445095472/0.log"
Jul 13 18:07:30.066591 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.066555    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:30.085003 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.084974    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7446-139629445095472"]
Jul 13 18:07:30.131446 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.131361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc9ck\" (UniqueName: \"kubernetes.io/projected/38cbca39-4a36-4c6c-929a-66df67f0254c-kube-api-access-jc9ck\") pod \"38cbca39-4a36-4c6c-929a-66df67f0254c\" (UID: \"38cbca39-4a36-4c6c-929a-66df67f0254c\") "
Jul 13 18:07:30.133456 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.133422    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38cbca39-4a36-4c6c-929a-66df67f0254c-kube-api-access-jc9ck" (OuterVolumeSpecName: "kube-api-access-jc9ck") pod "38cbca39-4a36-4c6c-929a-66df67f0254c" (UID: "38cbca39-4a36-4c6c-929a-66df67f0254c"). InnerVolumeSpecName "kube-api-access-jc9ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:30.210598 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.210559    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:30.211045 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.211029    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38cbca39-4a36-4c6c-929a-66df67f0254c" containerName="test-curl-7446-139629445095472"
Jul 13 18:07:30.211045 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.211043    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="38cbca39-4a36-4c6c-929a-66df67f0254c" containerName="test-curl-7446-139629445095472"
Jul 13 18:07:30.211193 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.211119    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="38cbca39-4a36-4c6c-929a-66df67f0254c" containerName="test-curl-7446-139629445095472"
Jul 13 18:07:30.214344 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.214324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:30.220912 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.220889    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:30.232287 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.232259    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc9ck\" (UniqueName: \"kubernetes.io/projected/38cbca39-4a36-4c6c-929a-66df67f0254c-kube-api-access-jc9ck\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:30.333795 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.333748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8tqd\" (UniqueName: \"kubernetes.io/projected/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7-kube-api-access-h8tqd\") pod \"test-curl-7446-139629445096480\" (UID: \"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7\") " pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:30.423832 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.423755    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38cbca39-4a36-4c6c-929a-66df67f0254c" path="/var/lib/kubelet/pods/38cbca39-4a36-4c6c-929a-66df67f0254c/volumes"
Jul 13 18:07:30.434415 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.434387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8tqd\" (UniqueName: \"kubernetes.io/projected/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7-kube-api-access-h8tqd\") pod \"test-curl-7446-139629445096480\" (UID: \"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7\") " pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:30.445136 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.445092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8tqd\" (UniqueName: \"kubernetes.io/projected/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7-kube-api-access-h8tqd\") pod \"test-curl-7446-139629445096480\" (UID: \"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7\") " pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:30.524850 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.524808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:30.674566 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.674513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:30.676704 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:07:30.676680    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6d3cc1e_dd05_480e_8ad5_412d0aa0a2c7.slice/crio-17676c8f8a935f0222edd91a1e5d2708ec38cb9091b7d77ba0735716ca429e0d WatchSource:0}: Error finding container 17676c8f8a935f0222edd91a1e5d2708ec38cb9091b7d77ba0735716ca429e0d: Status 404 returned error can't find the container with id 17676c8f8a935f0222edd91a1e5d2708ec38cb9091b7d77ba0735716ca429e0d
Jul 13 18:07:30.860023 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.859986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445096480" event={"ID":"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7","Type":"ContainerStarted","Data":"17676c8f8a935f0222edd91a1e5d2708ec38cb9091b7d77ba0735716ca429e0d"}
Jul 13 18:07:30.861263 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.861246    2577 scope.go:117] "RemoveContainer" containerID="e52cac8b35ab78187b1c3240a4fd4177dce125a9dbf15f3f73f5261433cf735b"
Jul 13 18:07:30.861353 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:30.861249    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445095472"
Jul 13 18:07:31.869870 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:31.869835    2577 generic.go:356] "Generic (PLEG): container finished" podID="d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" containerID="ec30b34b47f0053722277103e85531106ef0a69ce11e31c3626908e29af877ae" exitCode=0
Jul 13 18:07:31.870347 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:31.869919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445096480" event={"ID":"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7","Type":"ContainerDied","Data":"ec30b34b47f0053722277103e85531106ef0a69ce11e31c3626908e29af877ae"}
Jul 13 18:07:33.022576 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.022552    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.043247 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.043223    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7446-139629445096480_d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7/test-curl-7446-139629445096480/0.log"
Jul 13 18:07:33.069511 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.069487    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:33.073443 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.073420    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:33.161354 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.161244    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8tqd\" (UniqueName: \"kubernetes.io/projected/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7-kube-api-access-h8tqd\") pod \"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7\" (UID: \"d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7\") "
Jul 13 18:07:33.163297 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.163275    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7-kube-api-access-h8tqd" (OuterVolumeSpecName: "kube-api-access-h8tqd") pod "d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" (UID: "d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7"). InnerVolumeSpecName "kube-api-access-h8tqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:33.263146 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.263107    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8tqd\" (UniqueName: \"kubernetes.io/projected/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7-kube-api-access-h8tqd\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:33.887803 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.887776    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.887991 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:33.887774    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17676c8f8a935f0222edd91a1e5d2708ec38cb9091b7d77ba0735716ca429e0d"
Jul 13 18:07:33.897624 ip-10-0-134-215 kubenswrapper[2577]: E0713 18:07:33.897598    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7446-139629445096480\" is forbidden: User \"system:node:ip-10-0-134-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-215.ec2.internal' and this object" podUID="d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:34.422465 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:34.422433    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" path="/var/lib/kubelet/pods/d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7/volumes"
Jul 13 18:07:36.238899 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.238861    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"]
Jul 13 18:07:36.239348 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.239331    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" containerName="test-curl-7446-139629445096480"
Jul 13 18:07:36.239348 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.239347    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" containerName="test-curl-7446-139629445096480"
Jul 13 18:07:36.239442 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.239418    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6d3cc1e-dd05-480e-8ad5-412d0aa0a2c7" containerName="test-curl-7446-139629445096480"
Jul 13 18:07:36.242877 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.242859    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:36.246981 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.246960    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 18:07:36.253178 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.253150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"]
Jul 13 18:07:36.393436 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.393395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93f5569-dab3-4025-889e-3ab1138d8eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt\" (UID: \"c93f5569-dab3-4025-889e-3ab1138d8eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:36.494817 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.494735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93f5569-dab3-4025-889e-3ab1138d8eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt\" (UID: \"c93f5569-dab3-4025-889e-3ab1138d8eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:36.495385 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.495364    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93f5569-dab3-4025-889e-3ab1138d8eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt\" (UID: \"c93f5569-dab3-4025-889e-3ab1138d8eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:36.554497 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.554460    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:36.705806 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.705751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"]
Jul 13 18:07:36.708266 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:07:36.708238    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93f5569_dab3_4025_889e_3ab1138d8eb2.slice/crio-98abf4e323cb13ebc2f0b19e7574ff18e2dfaaf71d298c4cab402b6e892da99e WatchSource:0}: Error finding container 98abf4e323cb13ebc2f0b19e7574ff18e2dfaaf71d298c4cab402b6e892da99e: Status 404 returned error can't find the container with id 98abf4e323cb13ebc2f0b19e7574ff18e2dfaaf71d298c4cab402b6e892da99e
Jul 13 18:07:36.905568 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:36.905536    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt" event={"ID":"c93f5569-dab3-4025-889e-3ab1138d8eb2","Type":"ContainerStarted","Data":"98abf4e323cb13ebc2f0b19e7574ff18e2dfaaf71d298c4cab402b6e892da99e"}
Jul 13 18:07:37.912907 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:37.912867    2577 generic.go:356] "Generic (PLEG): container finished" podID="c93f5569-dab3-4025-889e-3ab1138d8eb2" containerID="7371564ddc749c46333542ea438003b852933d3120b4b9af4368c9bf934544f5" exitCode=0
Jul 13 18:07:37.913372 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:37.912949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt" event={"ID":"c93f5569-dab3-4025-889e-3ab1138d8eb2","Type":"ContainerDied","Data":"7371564ddc749c46333542ea438003b852933d3120b4b9af4368c9bf934544f5"}
Jul 13 18:07:39.056214 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.056185    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:39.221568 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.221481    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93f5569-dab3-4025-889e-3ab1138d8eb2-maas-api-service-ca\") pod \"c93f5569-dab3-4025-889e-3ab1138d8eb2\" (UID: \"c93f5569-dab3-4025-889e-3ab1138d8eb2\") "
Jul 13 18:07:39.221807 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.221784    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c93f5569-dab3-4025-889e-3ab1138d8eb2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c93f5569-dab3-4025-889e-3ab1138d8eb2" (UID: "c93f5569-dab3-4025-889e-3ab1138d8eb2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:07:39.221915 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.221895    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93f5569-dab3-4025-889e-3ab1138d8eb2-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:39.925885 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.925856    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt"
Jul 13 18:07:39.926068 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.925903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt" event={"ID":"c93f5569-dab3-4025-889e-3ab1138d8eb2","Type":"ContainerDied","Data":"98abf4e323cb13ebc2f0b19e7574ff18e2dfaaf71d298c4cab402b6e892da99e"}
Jul 13 18:07:39.926068 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:39.925953    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98abf4e323cb13ebc2f0b19e7574ff18e2dfaaf71d298c4cab402b6e892da99e"
Jul 13 18:07:42.617592 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:42.617560    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 18:07:42.622032 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:42.622003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 18:07:42.628010 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:42.627987    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 18:07:42.634170 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:42.634144    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ljjdg_e82a21e2-5f47-469a-9e6e-1b736f834a65/ovn-acl-logging/0.log"
Jul 13 18:07:46.730377 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:46.730323    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"]
Jul 13 18:07:46.730973 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:46.730647    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" podUID="4fa82708-fc2a-49b3-87a3-df052d106663" containerName="maas-api" containerID="cri-o://e7b36ca0c61a757d59c4d68454ed3cad213c7304fd89c3d54e7b1c339ba3f878" gracePeriod=30
Jul 13 18:07:46.967332 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:46.967283    2577 generic.go:356] "Generic (PLEG): container finished" podID="4fa82708-fc2a-49b3-87a3-df052d106663" containerID="e7b36ca0c61a757d59c4d68454ed3cad213c7304fd89c3d54e7b1c339ba3f878" exitCode=0
Jul 13 18:07:46.967497 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:46.967373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" event={"ID":"4fa82708-fc2a-49b3-87a3-df052d106663","Type":"ContainerDied","Data":"e7b36ca0c61a757d59c4d68454ed3cad213c7304fd89c3d54e7b1c339ba3f878"}
Jul 13 18:07:46.989620 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:46.989548    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:07:47.101157 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.101107    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvfdp\" (UniqueName: \"kubernetes.io/projected/4fa82708-fc2a-49b3-87a3-df052d106663-kube-api-access-qvfdp\") pod \"4fa82708-fc2a-49b3-87a3-df052d106663\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") "
Jul 13 18:07:47.101349 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.101212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa82708-fc2a-49b3-87a3-df052d106663-openshift-service-ca\") pod \"4fa82708-fc2a-49b3-87a3-df052d106663\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") "
Jul 13 18:07:47.101349 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.101247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls\") pod \"4fa82708-fc2a-49b3-87a3-df052d106663\" (UID: \"4fa82708-fc2a-49b3-87a3-df052d106663\") "
Jul 13 18:07:47.101661 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.101631    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa82708-fc2a-49b3-87a3-df052d106663-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4fa82708-fc2a-49b3-87a3-df052d106663" (UID: "4fa82708-fc2a-49b3-87a3-df052d106663"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:07:47.103330 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.103286    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4fa82708-fc2a-49b3-87a3-df052d106663" (UID: "4fa82708-fc2a-49b3-87a3-df052d106663"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:07:47.103330 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.103313    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa82708-fc2a-49b3-87a3-df052d106663-kube-api-access-qvfdp" (OuterVolumeSpecName: "kube-api-access-qvfdp") pod "4fa82708-fc2a-49b3-87a3-df052d106663" (UID: "4fa82708-fc2a-49b3-87a3-df052d106663"). InnerVolumeSpecName "kube-api-access-qvfdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:47.201962 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.201921    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvfdp\" (UniqueName: \"kubernetes.io/projected/4fa82708-fc2a-49b3-87a3-df052d106663-kube-api-access-qvfdp\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:47.201962 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.201955    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fa82708-fc2a-49b3-87a3-df052d106663-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:47.201962 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.201970    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fa82708-fc2a-49b3-87a3-df052d106663-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:07:47.975825 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.975795    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"
Jul 13 18:07:47.976222 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.975789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8" event={"ID":"4fa82708-fc2a-49b3-87a3-df052d106663","Type":"ContainerDied","Data":"460a25204ee5d967defe43cc2581d8ef7de3270cbdab100c6c1488fabe33a756"}
Jul 13 18:07:47.976222 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.975945    2577 scope.go:117] "RemoveContainer" containerID="e7b36ca0c61a757d59c4d68454ed3cad213c7304fd89c3d54e7b1c339ba3f878"
Jul 13 18:07:47.999000 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:47.998964    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"]
Jul 13 18:07:48.004935 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:48.004903    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f54db3-9dcbb8b74-x9gz8"]
Jul 13 18:07:48.423083 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:07:48.423048    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa82708-fc2a-49b3-87a3-df052d106663" path="/var/lib/kubelet/pods/4fa82708-fc2a-49b3-87a3-df052d106663/volumes"
Jul 13 18:08:02.805576 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.805534    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"]
Jul 13 18:08:02.806215 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.806194    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93f5569-dab3-4025-889e-3ab1138d8eb2" containerName="revoke-keys"
Jul 13 18:08:02.806323 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.806217    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93f5569-dab3-4025-889e-3ab1138d8eb2" containerName="revoke-keys"
Jul 13 18:08:02.806323 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.806257    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa82708-fc2a-49b3-87a3-df052d106663" containerName="maas-api"
Jul 13 18:08:02.806323 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.806267    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa82708-fc2a-49b3-87a3-df052d106663" containerName="maas-api"
Jul 13 18:08:02.806482 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.806394    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93f5569-dab3-4025-889e-3ab1138d8eb2" containerName="revoke-keys"
Jul 13 18:08:02.806482 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.806411    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fa82708-fc2a-49b3-87a3-df052d106663" containerName="maas-api"
Jul 13 18:08:02.808794 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.808771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:02.811478 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.811451    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-prkcz\""
Jul 13 18:08:02.817419 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.817246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"]
Jul 13 18:08:02.958823 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:02.958780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f53cb34-49d8-4ae2-aab1-2f3d760595c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf\" (UID: \"6f53cb34-49d8-4ae2-aab1-2f3d760595c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:03.060590 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:03.060499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f53cb34-49d8-4ae2-aab1-2f3d760595c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf\" (UID: \"6f53cb34-49d8-4ae2-aab1-2f3d760595c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:03.061126 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:03.061104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f53cb34-49d8-4ae2-aab1-2f3d760595c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf\" (UID: \"6f53cb34-49d8-4ae2-aab1-2f3d760595c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:03.121901 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:03.121862    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:03.270478 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:03.270435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"]
Jul 13 18:08:03.271051 ip-10-0-134-215 kubenswrapper[2577]: W0713 18:08:03.271026    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f53cb34_49d8_4ae2_aab1_2f3d760595c2.slice/crio-1aae919439161bf5744d948b7e65c4bd6eda08639649f993c723733057ba63be WatchSource:0}: Error finding container 1aae919439161bf5744d948b7e65c4bd6eda08639649f993c723733057ba63be: Status 404 returned error can't find the container with id 1aae919439161bf5744d948b7e65c4bd6eda08639649f993c723733057ba63be
Jul 13 18:08:04.076440 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:04.076405    2577 generic.go:356] "Generic (PLEG): container finished" podID="6f53cb34-49d8-4ae2-aab1-2f3d760595c2" containerID="4ff810b1ebe2c3234e8e69ce31a148792eea6babf5aecd60e7ff724c39ce8c6e" exitCode=0
Jul 13 18:08:04.076861 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:04.076496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf" event={"ID":"6f53cb34-49d8-4ae2-aab1-2f3d760595c2","Type":"ContainerDied","Data":"4ff810b1ebe2c3234e8e69ce31a148792eea6babf5aecd60e7ff724c39ce8c6e"}
Jul 13 18:08:04.076861 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:04.076560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf" event={"ID":"6f53cb34-49d8-4ae2-aab1-2f3d760595c2","Type":"ContainerStarted","Data":"1aae919439161bf5744d948b7e65c4bd6eda08639649f993c723733057ba63be"}
Jul 13 18:08:05.222034 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:05.222007    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:05.380749 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:05.380661    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f53cb34-49d8-4ae2-aab1-2f3d760595c2-maas-api-service-ca\") pod \"6f53cb34-49d8-4ae2-aab1-2f3d760595c2\" (UID: \"6f53cb34-49d8-4ae2-aab1-2f3d760595c2\") "
Jul 13 18:08:05.381041 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:05.381015    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f53cb34-49d8-4ae2-aab1-2f3d760595c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f53cb34-49d8-4ae2-aab1-2f3d760595c2" (UID: "6f53cb34-49d8-4ae2-aab1-2f3d760595c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:08:05.481919 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:05.481881    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f53cb34-49d8-4ae2-aab1-2f3d760595c2-maas-api-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:08:06.089893 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:06.089862    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf"
Jul 13 18:08:06.090090 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:06.089904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf" event={"ID":"6f53cb34-49d8-4ae2-aab1-2f3d760595c2","Type":"ContainerDied","Data":"1aae919439161bf5744d948b7e65c4bd6eda08639649f993c723733057ba63be"}
Jul 13 18:08:06.090090 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:06.089963    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1aae919439161bf5744d948b7e65c4bd6eda08639649f993c723733057ba63be"
Jul 13 18:08:13.209427 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.209389    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"]
Jul 13 18:08:13.210336 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.210261    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2" podUID="11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" containerName="maas-api" containerID="cri-o://dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce" gracePeriod=30
Jul 13 18:08:13.472272 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.472202    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:08:13.661896 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.661854    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-openshift-service-ca\") pod \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") "
Jul 13 18:08:13.662097 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.661909    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-maas-api-tls\") pod \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") "
Jul 13 18:08:13.662097 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.662030    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tscgw\" (UniqueName: \"kubernetes.io/projected/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-kube-api-access-tscgw\") pod \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\" (UID: \"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e\") "
Jul 13 18:08:13.662239 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.662211    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" (UID: "11f2dcee-30df-4b24-acec-cd2bbc2b5e9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:08:13.662380 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.662364    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-openshift-service-ca\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:08:13.664020 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.663990    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" (UID: "11f2dcee-30df-4b24-acec-cd2bbc2b5e9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:08:13.664169 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.664077    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-kube-api-access-tscgw" (OuterVolumeSpecName: "kube-api-access-tscgw") pod "11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" (UID: "11f2dcee-30df-4b24-acec-cd2bbc2b5e9e"). InnerVolumeSpecName "kube-api-access-tscgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:08:13.763202 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.763163    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tscgw\" (UniqueName: \"kubernetes.io/projected/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-kube-api-access-tscgw\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:08:13.763202 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:13.763193    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e-maas-api-tls\") on node \"ip-10-0-134-215.ec2.internal\" DevicePath \"\""
Jul 13 18:08:14.138159 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.138055    2577 generic.go:356] "Generic (PLEG): container finished" podID="11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" containerID="dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce" exitCode=0
Jul 13 18:08:14.138159 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.138103    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"
Jul 13 18:08:14.138159 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.138138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2" event={"ID":"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e","Type":"ContainerDied","Data":"dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce"}
Jul 13 18:08:14.138474 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.138193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2" event={"ID":"11f2dcee-30df-4b24-acec-cd2bbc2b5e9e","Type":"ContainerDied","Data":"a0a54442398077765e6d7319dd8679edcf4d6355f189160493a18cf54442e65d"}
Jul 13 18:08:14.138474 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.138217    2577 scope.go:117] "RemoveContainer" containerID="dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce"
Jul 13 18:08:14.148000 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.147976    2577 scope.go:117] "RemoveContainer" containerID="dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce"
Jul 13 18:08:14.148319 ip-10-0-134-215 kubenswrapper[2577]: E0713 18:08:14.148286    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce\": container with ID starting with dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce not found: ID does not exist" containerID="dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce"
Jul 13 18:08:14.148385 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.148323    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce"} err="failed to get container status \"dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce\": rpc error: code = NotFound desc = could not find container \"dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce\": container with ID starting with dee1bbac517b4409470bd97bf7468c81712becd02fe9956615b79435c1f020ce not found: ID does not exist"
Jul 13 18:08:14.159712 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.159684    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"]
Jul 13 18:08:14.163386 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.163352    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b57346-5f68758466-ktrk2"]
Jul 13 18:08:14.423150 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:14.423069    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" path="/var/lib/kubelet/pods/11f2dcee-30df-4b24-acec-cd2bbc2b5e9e/volumes"
Jul 13 18:08:34.807360 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:34.807263    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-595f7d8747-9hxng_620f5d34-580c-4898-8d7d-e5e035d16680/manager/0.log"
Jul 13 18:08:35.364210 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:35.364178    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r_ce707caf-9364-4fef-add1-a183886d9dfe/copy-manifests/0.log"
Jul 13 18:08:35.380890 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:35.380853    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r_ce707caf-9364-4fef-add1-a183886d9dfe/manager/0.log"
Jul 13 18:08:36.033990 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.033961    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732745-bzd42_c390a50c-509d-4d47-a121-8c90967ff41f/cleanup/0.log"
Jul 13 18:08:36.152592 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.152560    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732760-fc9dm_ad3fe05f-7eb0-424c-9336-23a149439427/cleanup/0.log"
Jul 13 18:08:36.273719 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.273692    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-d0c7b7fa-mh9ql_36e75be0-840f-4454-8f8e-263db6790484/revoke-keys/0.log"
Jul 13 18:08:36.387631 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.387555    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-ec3f2398-fcgqh_b742d703-2723-4e86-be98-51718e0af516/revoke-keys/0.log"
Jul 13 18:08:36.514450 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.514416    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-f033d9-fhjhv_775b629f-3683-4c32-ab18-cdbbf8804ae8/revoke-keys/0.log"
Jul 13 18:08:36.632127 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.632098    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-d6c068-9dnlw_948c134a-c957-41be-916a-aec471f7fe3a/revoke-keys/0.log"
Jul 13 18:08:36.870075 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.870048    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-2ffc29-q7dq5_ff25662e-a432-4879-8c09-28e54d3372a3/revoke-keys/0.log"
Jul 13 18:08:36.982841 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:36.982815    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-cb4ffa-6fs62_c99489f8-9aba-4783-8005-053d5840e942/revoke-keys/0.log"
Jul 13 18:08:37.463916 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:37.463885    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-f54db3-9w5nt_c93f5569-dab3-4025-889e-3ab1138d8eb2/revoke-keys/0.log"
Jul 13 18:08:37.577811 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:37.577785    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-b57346-zmhjf_6f53cb34-49d8-4ae2-aab1-2f3d760595c2/revoke-keys/0.log"
Jul 13 18:08:37.697255 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:37.697219    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kdnss_d48577ac-2cce-4ffe-9964-04e6312bde98/postgres/0.log"
Jul 13 18:08:39.196285 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:39.196252    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-57fr2_9ff22432-d09b-4f9f-bbbe-5addeb433275/manager/0.log"
Jul 13 18:08:39.314150 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:39.314120    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jqms9_79b0ca46-59b5-4741-a130-e5c1e6f7d4d2/manager/0.log"
Jul 13 18:08:39.429501 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:39.429466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2tvl2_e05dfdc6-bc92-40dc-9f3a-21ce429f4231/kuadrant-console-plugin/0.log"
Jul 13 18:08:39.549105 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:39.549077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8xmw7_fdb6eab0-5307-49d0-800d-f409c2d324e8/registry-server/0.log"
Jul 13 18:08:39.923719 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:39.923632    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nwn2z_875f8e28-ae6b-4db0-b3d6-7c4befdbce2c/manager/0.log"
Jul 13 18:08:40.923273 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:40.923243    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-kv6fl_882b93cb-35e9-4299-bfe3-c8c7e52a26e1/payload-pre-processing/0.log"
Jul 13 18:08:41.040336 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:41.040292    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82vqm_d76c2fe7-d56c-4c93-8d2c-db27f499c9c1/payload-processing/0.log"
Jul 13 18:08:41.549655 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:41.549626    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wsvd4_1a4ee986-6a4b-4d60-b89a-befb6791aca3/main/0.log"
Jul 13 18:08:41.801716 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:41.801642    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bmq2x_906e545e-5b1c-4a44-aaad-3ff8b8b3a5f8/main/0.log"
Jul 13 18:08:49.896265 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:49.896238    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qhhbz_023edfbb-2391-40bb-bc9a-712c33630581/global-pull-secret-syncer/0.log"
Jul 13 18:08:50.027506 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:50.027473    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-shh99_ff28572d-d027-4b00-a3fc-7b7377640652/konnectivity-agent/0.log"
Jul 13 18:08:50.082644 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:50.082617    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-215.ec2.internal_3a25243051a280bc4d5e11c474a5bfe9/haproxy/0.log"
Jul 13 18:08:55.092837 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:55.092743    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-57fr2_9ff22432-d09b-4f9f-bbbe-5addeb433275/manager/0.log"
Jul 13 18:08:55.144926 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:55.144898    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jqms9_79b0ca46-59b5-4741-a130-e5c1e6f7d4d2/manager/0.log"
Jul 13 18:08:55.170414 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:55.170387    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2tvl2_e05dfdc6-bc92-40dc-9f3a-21ce429f4231/kuadrant-console-plugin/0.log"
Jul 13 18:08:55.220799 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:55.220769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8xmw7_fdb6eab0-5307-49d0-800d-f409c2d324e8/registry-server/0.log"
Jul 13 18:08:55.428007 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:55.427917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nwn2z_875f8e28-ae6b-4db0-b3d6-7c4befdbce2c/manager/0.log"
Jul 13 18:08:57.033000 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.032976    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/alertmanager/0.log"
Jul 13 18:08:57.059795 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.059764    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/config-reloader/0.log"
Jul 13 18:08:57.082337 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.082289    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/kube-rbac-proxy-web/0.log"
Jul 13 18:08:57.107443 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.107408    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/kube-rbac-proxy/0.log"
Jul 13 18:08:57.128604 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.128580    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/kube-rbac-proxy-metric/0.log"
Jul 13 18:08:57.150843 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.150766    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/prom-label-proxy/0.log"
Jul 13 18:08:57.173351 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.173295    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_12249230-7332-4472-9f7e-a3086bb296ed/init-config-reloader/0.log"
Jul 13 18:08:57.542667 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.542643    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5s6nz_02e7a3e1-b38f-4bf3-b988-9e56515c99ef/node-exporter/0.log"
Jul 13 18:08:57.564118 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.564087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5s6nz_02e7a3e1-b38f-4bf3-b988-9e56515c99ef/kube-rbac-proxy/0.log"
Jul 13 18:08:57.584998 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.584974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5s6nz_02e7a3e1-b38f-4bf3-b988-9e56515c99ef/init-textfile/0.log"
Jul 13 18:08:57.814493 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.814466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/prometheus/0.log"
Jul 13 18:08:57.836361 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.836330    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/config-reloader/0.log"
Jul 13 18:08:57.861198 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.861169    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/thanos-sidecar/0.log"
Jul 13 18:08:57.881930 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.881901    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/kube-rbac-proxy-web/0.log"
Jul 13 18:08:57.903773 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.903750    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/kube-rbac-proxy/0.log"
Jul 13 18:08:57.923637 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.923608    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/kube-rbac-proxy-thanos/0.log"
Jul 13 18:08:57.950959 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:57.950938    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1d581bf-c0d7-436c-af78-85bd6005719c/init-config-reloader/0.log"
Jul 13 18:08:58.029781 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.029756    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-k8sxq_61c4e2d2-8030-4402-a532-934191c033bc/prometheus-operator-admission-webhook/0.log"
Jul 13 18:08:58.061214 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.061183    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c57f4b964-xgf6l_63d1cba0-90a2-4e0f-b812-49b0d995616c/telemeter-client/0.log"
Jul 13 18:08:58.082979 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.082910    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c57f4b964-xgf6l_63d1cba0-90a2-4e0f-b812-49b0d995616c/reload/0.log"
Jul 13 18:08:58.103817 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.103789    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c57f4b964-xgf6l_63d1cba0-90a2-4e0f-b812-49b0d995616c/kube-rbac-proxy/0.log"
Jul 13 18:08:58.153724 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.153696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-647d4c7849-kqpbm_606e3951-c87a-4633-87c9-cde3750d21e0/thanos-query/0.log"
Jul 13 18:08:58.174269 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.174244    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-647d4c7849-kqpbm_606e3951-c87a-4633-87c9-cde3750d21e0/kube-rbac-proxy-web/0.log"
Jul 13 18:08:58.196318 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.196287    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-647d4c7849-kqpbm_606e3951-c87a-4633-87c9-cde3750d21e0/kube-rbac-proxy/0.log"
Jul 13 18:08:58.217756 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.217724    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-647d4c7849-kqpbm_606e3951-c87a-4633-87c9-cde3750d21e0/prom-label-proxy/0.log"
Jul 13 18:08:58.240558 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.240533    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-647d4c7849-kqpbm_606e3951-c87a-4633-87c9-cde3750d21e0/kube-rbac-proxy-rules/0.log"
Jul 13 18:08:58.265552 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:58.265524    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-647d4c7849-kqpbm_606e3951-c87a-4633-87c9-cde3750d21e0/kube-rbac-proxy-metrics/0.log"
Jul 13 18:08:59.775325 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775274    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"]
Jul 13 18:08:59.775740 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775716    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f53cb34-49d8-4ae2-aab1-2f3d760595c2" containerName="revoke-keys"
Jul 13 18:08:59.775740 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775727    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f53cb34-49d8-4ae2-aab1-2f3d760595c2" containerName="revoke-keys"
Jul 13 18:08:59.775825 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775748    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" containerName="maas-api"
Jul 13 18:08:59.775825 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775754    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" containerName="maas-api"
Jul 13 18:08:59.775825 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775812    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f53cb34-49d8-4ae2-aab1-2f3d760595c2" containerName="revoke-keys"
Jul 13 18:08:59.775825 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.775821    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f2dcee-30df-4b24-acec-cd2bbc2b5e9e" containerName="maas-api"
Jul 13 18:08:59.779357 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.779339    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.781780 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.781756    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dg5t9\"/\"default-dockercfg-7czpt\""
Jul 13 18:08:59.782290 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.782273    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg5t9\"/\"openshift-service-ca.crt\""
Jul 13 18:08:59.782994 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.782849    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg5t9\"/\"kube-root-ca.crt\""
Jul 13 18:08:59.790061 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.790041    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"]
Jul 13 18:08:59.801571 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.801545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-proc\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.801723 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.801626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-podres\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.801723 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.801660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8jpk\" (UniqueName: \"kubernetes.io/projected/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-kube-api-access-d8jpk\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.801808 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.801777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-sys\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.801896 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.801806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-lib-modules\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903326 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-podres\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903326 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8jpk\" (UniqueName: \"kubernetes.io/projected/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-kube-api-access-d8jpk\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-sys\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-lib-modules\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-proc\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903434    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-sys\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903434    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-podres\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-lib-modules\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.903578 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.903542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-proc\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:08:59.911329 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:08:59.911289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8jpk\" (UniqueName: \"kubernetes.io/projected/d103b706-6cff-4ce6-81ec-8b3c9ca0ae50-kube-api-access-d8jpk\") pod \"perf-node-gather-daemonset-w65b5\" (UID: \"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:09:00.073755 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.073722    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/1.log"
Jul 13 18:09:00.078421 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.078397    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vqtlm_352a6492-b04e-4e6a-ae13-d00773349230/console-operator/2.log"
Jul 13 18:09:00.090823 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.090794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:09:00.244381 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.238341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"]
Jul 13 18:09:00.402854 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.402821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5" event={"ID":"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50","Type":"ContainerStarted","Data":"cbc70b1169b19f15b0d46dfbc51571db8865f90f01e0d4fcd4a35c532fd7861b"}
Jul 13 18:09:00.403047 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.402872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5" event={"ID":"d103b706-6cff-4ce6-81ec-8b3c9ca0ae50","Type":"ContainerStarted","Data":"19e68c1a76ce0fe41da51a13f10d23897dc243305aaa620a36b562d41fe84f3e"}
Jul 13 18:09:00.403047 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.402972    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:09:00.427527 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.427474    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5" podStartSLOduration=1.427459109 podStartE2EDuration="1.427459109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:00.425833739 +0000 UTC m=+3078.504025790" watchObservedRunningTime="2026-07-13 18:09:00.427459109 +0000 UTC m=+3078.505651159"
Jul 13 18:09:00.648256 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:00.648214    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5ffbbdcd49-jv5bd_27e006e6-14f9-4568-94df-81b82e6f966d/console/0.log"
Jul 13 18:09:02.387092 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:02.387061    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hjl7l_fcc777f4-36c8-4b05-9af6-233aa44610f7/dns/0.log"
Jul 13 18:09:02.408978 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:02.408947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hjl7l_fcc777f4-36c8-4b05-9af6-233aa44610f7/kube-rbac-proxy/0.log"
Jul 13 18:09:02.459762 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:02.459735    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t57qd_c77fb01f-a5e7-4f84-87c8-248a63b56b0a/dns-node-resolver/0.log"
Jul 13 18:09:03.006318 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:03.006280    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56d8f667d-ggddw_7818b9cf-311e-43dc-b399-5c7858eefb9d/registry/0.log"
Jul 13 18:09:03.076122 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:03.076081    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zmw8f_522289d0-6367-4f4e-8531-359bc2c02295/node-ca/0.log"
Jul 13 18:09:04.290258 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:04.290223    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-kv6fl_882b93cb-35e9-4299-bfe3-c8c7e52a26e1/payload-pre-processing/0.log"
Jul 13 18:09:04.319643 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:04.319610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82vqm_d76c2fe7-d56c-4c93-8d2c-db27f499c9c1/payload-processing/0.log"
Jul 13 18:09:05.114340 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:05.114288    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxf7m_bb0b0830-f3e8-4af8-ab48-3793dbf26e7e/serve-healthcheck-canary/0.log"
Jul 13 18:09:05.712636 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:05.712605    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b99hh_69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7/kube-rbac-proxy/0.log"
Jul 13 18:09:05.734126 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:05.734098    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b99hh_69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7/exporter/0.log"
Jul 13 18:09:05.761062 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:05.761033    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b99hh_69b07c7e-2ddd-4dbb-80e7-f57dcaa2a5b7/extractor/0.log"
Jul 13 18:09:06.422802 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:06.422771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-w65b5"
Jul 13 18:09:08.508737 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:08.508705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-595f7d8747-9hxng_620f5d34-580c-4898-8d7d-e5e035d16680/manager/0.log"
Jul 13 18:09:08.779887 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:08.779852    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r_ce707caf-9364-4fef-add1-a183886d9dfe/manager/0.log"
Jul 13 18:09:08.810053 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:08.810028    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-pw28r_ce707caf-9364-4fef-add1-a183886d9dfe/copy-manifests/0.log"
Jul 13 18:09:10.098272 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:10.098223    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-kv6fl_882b93cb-35e9-4299-bfe3-c8c7e52a26e1/payload-pre-processing/0.log"
Jul 13 18:09:10.125033 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:10.125003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82vqm_d76c2fe7-d56c-4c93-8d2c-db27f499c9c1/payload-processing/0.log"
Jul 13 18:09:10.329242 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:10.329145    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5df8bf697-s2lfk_6275c508-7800-4179-b3e9-934a1bbaca1e/manager/0.log"
Jul 13 18:09:10.358038 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:10.358003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-flcbj_187bdd16-be22-46b3-9455-2d39ddef6e0e/openshift-lws-operator/0.log"
Jul 13 18:09:11.562949 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:11.562913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-kv6fl_882b93cb-35e9-4299-bfe3-c8c7e52a26e1/payload-pre-processing/0.log"
Jul 13 18:09:11.585744 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:11.585658    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82vqm_d76c2fe7-d56c-4c93-8d2c-db27f499c9c1/payload-processing/0.log"
Jul 13 18:09:15.625600 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:15.625572    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kwpqp_bc10f3b4-76cf-4772-95bc-58415046c84b/kube-storage-version-migrator-operator/1.log"
Jul 13 18:09:15.626315 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:15.626286    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kwpqp_bc10f3b4-76cf-4772-95bc-58415046c84b/kube-storage-version-migrator-operator/0.log"
Jul 13 18:09:16.899910 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:16.899882    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/kube-multus-additional-cni-plugins/0.log"
Jul 13 18:09:16.925728 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:16.925700    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/egress-router-binary-copy/0.log"
Jul 13 18:09:16.950266 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:16.950241    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/cni-plugins/0.log"
Jul 13 18:09:16.971574 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:16.971547    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/bond-cni-plugin/0.log"
Jul 13 18:09:16.993785 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:16.993756    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/routeoverride-cni/0.log"
Jul 13 18:09:17.019625 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:17.019591    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/whereabouts-cni-bincopy/0.log"
Jul 13 18:09:17.046283 ip-10-0-134-215 kubenswrapper[2577]: I0713 18:09:17.046255    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhmzf_584c10ed-c1ba-4562-adc8-236b7f612a72/whereabouts-cni/0.log"