Jul 17 10:55:21.779536 ip-10-0-131-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 10:55:21.779551 ip-10-0-131-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 10:55:21.779561 ip-10-0-131-118 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 10:55:21.779781 ip-10-0-131-118 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 10:55:33.078266 ip-10-0-131-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 10:55:33.078282 ip-10-0-131-118 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot da88a093f0894bfaab2453efafa0017c --
Jul 17 10:57:25.135185 ip-10-0-131-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 10:57:25.490349 ip-10-0-131-118 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:57:25.490349 ip-10-0-131-118 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 10:57:25.490349 ip-10-0-131-118 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:57:25.490349 ip-10-0-131-118 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 10:57:25.490349 ip-10-0-131-118 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:57:25.491292 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.491230    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 10:57:25.496584 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496571    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:57:25.496584 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496584    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496588    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496592    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496595    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496598    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496602    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496605    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496607    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496610    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496613    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496624    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496627    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496630    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496633    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496636    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496638    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496641    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496643    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496646    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496649    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:57:25.496646 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496651    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496654    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496657    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496659    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496663    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496667    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496670    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496673    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496676    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496678    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496681    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496683    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496686    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496689    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496692    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496694    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496697    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496699    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496702    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:57:25.497134 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496704    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496707    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496710    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496712    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496714    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496717    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496719    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496722    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496724    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496727    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496729    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496731    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496734    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496736    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496739    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496742    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496745    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496747    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496758    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496761    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:57:25.497587 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496764    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496767    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496770    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496772    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496775    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496779    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496783    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496787    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496789    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496792    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496794    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496797    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496799    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496801    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496804    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496807    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496809    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496812    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496815    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:57:25.498073 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496817    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496820    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496823    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496825    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496829    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496832    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496834    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496837    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496841    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496844    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496846    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496849    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496852    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496854    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496860    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496862    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496866    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496870    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496872    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:57:25.498735 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.496875    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497557    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497563    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497566    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497570    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497573    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497576    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497578    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497581    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497584    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497586    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497589    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497592    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497594    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497597    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497600    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497602    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497607    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497610    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:57:25.499313 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497613    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497616    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497619    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497623    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497626    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497629    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497632    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497635    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497638    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497641    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497644    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497646    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497649    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497652    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497654    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497657    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497660    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497662    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497665    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497668    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:57:25.499814 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497670    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497672    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497675    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497677    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497679    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497682    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497685    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497688    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497690    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497693    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497695    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497697    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497700    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497702    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497707    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497710    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497713    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497716    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497718    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497721    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:57:25.500670 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497724    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497726    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497729    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497732    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497734    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497737    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497739    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497741    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497744    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497746    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497749    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497751    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497754    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497756    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497759    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497761    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497764    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497767    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497769    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497772    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:57:25.501524 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497774    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497777    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497779    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497782    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497784    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497788    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497790    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497793    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497796    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497798    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497801    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497803    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497805    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497808    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497810    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497813    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497815    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497818    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497820    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497823    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:57:25.502030 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.497825    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499285    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499294    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499298    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499302    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499306    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499309    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499312    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499316    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499319    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499327    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499330    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499332    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499335    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499338    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499341    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499343    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499346    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499349    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499352    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:57:25.502742 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499356    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499359    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499365    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499368    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499371    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499374    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499378    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499381    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499384    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499387    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499390    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499393    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499396    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499398    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499401    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499406    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499409    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499412    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499414    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499417    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:57:25.503272 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499420    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499422    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499425    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499428    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499431    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499434    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499437    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499444    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499448    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499451    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499454    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499457    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499459    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499462    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499465    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499467    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499472    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499475    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499478    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:57:25.503836 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499483    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499487    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499490    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499493    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499495    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499498    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499501    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499505    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499507    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499510    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499513    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499517    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499523    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499526    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499529    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499532    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499535    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499538    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499541    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499544    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:57:25.504360 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499546    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499549    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499552    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499555    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499560    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499562    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499565    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499568    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499571    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499575    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499578    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499581    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499583    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499586    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499589    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499592    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499595    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499600    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499602    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499605    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:57:25.504845 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.499608    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499913    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499946    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499959    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499966    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499972    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499977    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499984    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499990    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.499995    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500000    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500005    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500010    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500016    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500020    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500025    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500029    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500034    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500039    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500046    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500050    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500055    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500060    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500066    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 10:57:25.505333 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500072    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500076    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500082    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500088    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500093    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500098    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500102    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500107    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500112    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500118    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500124    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500129    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500133    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500138    2564 flags.go:64] FLAG: --enable-server="true"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500142    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500151    2564 flags.go:64] FLAG: --event-burst="100"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500156    2564 flags.go:64] FLAG: --event-qps="50"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500161    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500166    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500170    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500177    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500181    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500186    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500191    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500195    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 10:57:25.505929 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500200    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500204    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500209    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500214    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500218    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500223    2564 flags.go:64] FLAG: --feature-gates=""
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500229    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500234    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500239    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500244    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500250    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500255    2564 flags.go:64] FLAG: --help="false"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500259    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500264    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500269    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500274    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500280    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500288    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500293    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500297    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500301    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500306    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500311    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500316    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 10:57:25.506638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500321    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500326    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500330    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500335    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500340    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500344    2564 flags.go:64] FLAG: --lock-file=""
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500349    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500354    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500359    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500368    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500372    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500377    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500381    2564 flags.go:64] FLAG: --logging-format="text"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500386    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500391    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500395    2564 flags.go:64] FLAG: --manifest-url=""
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500400    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500406    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500412    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500418    2564 flags.go:64] FLAG: --max-pods="110"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500422    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500427    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500432    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500437    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500441    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 10:57:25.507255 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500450    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500455    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500467    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500472    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500477    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500482    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500486    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500494    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500498    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500503    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500532    2564 flags.go:64] FLAG: --port="10250"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500539    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500544    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0926e7f499c6a681c"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500550    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500555    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500560    2564 flags.go:64] FLAG: --register-node="true"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500564    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500570    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500575    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500580    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500585    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500590    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500595    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500600    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500605    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 10:57:25.507847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500610    2564 flags.go:64] FLAG: --runonce="false"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500614    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500619    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500624    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500628    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500633    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500638    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500643    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500651    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500656    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500661    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500665    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500669    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500674    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500678    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500683    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500691    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500696    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500700    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500707    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500712    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500716    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500721    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500725    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500730    2564 flags.go:64] FLAG: --v="2"
Jul 17 10:57:25.508474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500736    2564 flags.go:64] FLAG: --version="false"
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500742    2564 flags.go:64] FLAG: --vmodule=""
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500756    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.500763    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500962    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500970    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500976    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500982    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500987    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500994    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.500999    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501004    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501008    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501012    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501018    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501023    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501028    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501032    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501036    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501040    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:57:25.509118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501044    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501048    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501053    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501057    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501061    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501065    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501070    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501074    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501078    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501082    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501086    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501090    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501094    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501098    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501102    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501108    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501112    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501116    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501120    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501124    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:57:25.509621 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501128    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501131    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501135    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501140    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501144    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501148    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501152    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501157    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501161    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501165    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501169    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501173    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501177    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501181    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501185    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501189    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501193    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501198    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501203    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501209    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:57:25.510115 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501215    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501220    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501224    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501229    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501233    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501236    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501240    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501244    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501250    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501254    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501258    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501263    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501267    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501271    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501275    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501279    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501283    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501287    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501293    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:57:25.510593 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501299    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501303    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501308    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501313    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501317    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501322    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501326    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501331    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501335    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501339    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501344    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501348    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501353    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501357    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501361    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501365    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501369    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501373    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501377    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:57:25.511061 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501382    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501386    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501390    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501395    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.501399    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.501412    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.507921    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.507953    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.507972    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.507978    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508029    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508035    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508038    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508041    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:57:25.511507 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508044    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508047    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508050    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508053    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508056    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508058    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508061    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508063    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508066    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508069    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508072    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508074    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508077    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508079    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508083    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508087    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508090    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508093    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508095    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508098    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:57:25.511853 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508101    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508103    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508106    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508109    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508112    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508115    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508118    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508121    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508124    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508127    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508129    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508132    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508134    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508137    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508139    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508142    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508145    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508147    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508149    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:57:25.512352 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508152    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508155    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508157    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508160    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508162    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508165    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508168    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508170    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508173    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508176    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508178    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508181    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508183    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508188    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508191    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508195    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508198    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508200    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508204    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508206    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:57:25.512805 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508209    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508211    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508214    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508216    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508219    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508221    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508224    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508226    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508229    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508231    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508235    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508239    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508241    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508244    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508247    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508250    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508252    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508255    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508258    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:57:25.513304 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508260    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508263    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508265    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508268    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508271    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508273    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508276    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508278    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508281    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508284    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508286    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508289    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508292    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508294    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508297    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508299    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:57:25.513748 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508302    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.508307    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508408    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508412    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508415    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508419    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508424    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508427    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508430    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508433    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508436    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508439    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508442    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508445    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:57:25.514153 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508448    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508450    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508453    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508456    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508458    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508461    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508464    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508466    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508469    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508472    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508474    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508477    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508480    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508483    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508486    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508489    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508491    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508494    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508497    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508500    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508502    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:57:25.514492 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508504    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508507    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508510    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508512    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508515    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508517    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508520    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508522    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508525    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508527    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508530    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508532    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508535    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508537    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508540    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508543    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508545    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508548    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508550    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:57:25.515013 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508553    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508555    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508558    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508560    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508563    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508566    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508568    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508571    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508574    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508576    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508579    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508581    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508584    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508586    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508589    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508591    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508594    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508596    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508599    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508601    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:57:25.515454 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508604    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508606    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508609    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508611    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508614    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508617    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508619    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508622    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508624    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508627    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508629    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508632    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508635    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508637    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508639    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508643    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508646    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508649    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508653    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:57:25.515927 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508655    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508658    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508661    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508664    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508667    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508669    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508671    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:25.508674    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.508679    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.508774    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.511010    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.512385    2564 server.go:1019] "Starting client certificate rotation"
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.512481    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 10:57:25.516497 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.512518    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 10:57:25.516827 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.514819    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 10:57:25.516827 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.515922    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 10:57:25.526320 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.526303    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 17 10:57:25.530154 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.530140    2564 log.go:25] "Validated CRI v1 image API"
Jul 17 10:57:25.530953 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.530926    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 10:57:25.534418 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.534401    2564 fs.go:135] Filesystem UUIDs: map[2a65e08c-dc42-4725-838f-86ac4c420e9c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e1fa5f39-9727-46fa-9141-bdfbaa3e6ce7:/dev/nvme0n1p4]
Jul 17 10:57:25.534463 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.534418    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 10:57:25.540439 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.540346    2564 manager.go:216] Machine: {Timestamp:2026-07-17 10:57:25.539150387 +0000 UTC m=+0.296960797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117835 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec267bd45fd2a95b43b6b5bbad047783 SystemUUID:ec267bd4-5fd2-a95b-43b6-b5bbad047783 BootID:da88a093-f089-4bfa-ab24-53efafa0017c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6b:aa:85:ba:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6b:aa:85:ba:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:11:7b:95:a0:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 10:57:25.540439 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.540436    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 10:57:25.540545 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.540524    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 10:57:25.542897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.542869    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 10:57:25.543040 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.542900    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 10:57:25.543664 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.543655    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 10:57:25.543694 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.543667    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 10:57:25.543694 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.543674    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 10:57:25.544408 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.544398    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 10:57:25.544885 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.544870    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 10:57:25.546071 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.546060    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 10:57:25.549645 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549633    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 10:57:25.549764 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549755    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 10:57:25.549797 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549782    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 10:57:25.549797 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549791    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 10:57:25.549850 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549805    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 10:57:25.549850 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549813    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 17 10:57:25.549850 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.549822    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 10:57:25.550128 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.550117    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 10:57:25.550165 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.550139    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 10:57:25.552118 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.552070    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 10:57:25.553725 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.553710    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 10:57:25.553766 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.553742    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 10:57:25.554453 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554439    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 10:57:25.554506 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554459    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 10:57:25.554506 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554469    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 10:57:25.554506 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554488    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 10:57:25.554506 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554498    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 10:57:25.554506 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554503    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 10:57:25.554630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554511    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 10:57:25.554630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554516    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 10:57:25.554630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554522    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 10:57:25.554630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554527    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 10:57:25.554630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554538    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 10:57:25.554630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.554548    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 10:57:25.555805 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.555792    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 10:57:25.555805 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.555805    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 10:57:25.558832 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.558814    2564 server.go:1268] "Started kubelet"
Jul 17 10:57:25.558928 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.558861    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 10:57:25.559027 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.558979    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 10:57:25.559096 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.559082    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 10:57:25.559676 ip-10-0-131-118 systemd[1]: Started Kubernetes Kubelet.
Jul 17 10:57:25.560424 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.560372    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 10:57:25.560844 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.560816    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 10:57:25.561154 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.561128    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 10:57:25.561228 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.561170    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 10:57:25.562916 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.562895    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 10:57:25.565571 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.565554    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 10:57:25.566697 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.564014    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-118.ec2.internal.18c30e85e24a0c14  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-118.ec2.internal,UID:ip-10-0-131-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-118.ec2.internal,},FirstTimestamp:2026-07-17 10:57:25.558791188 +0000 UTC m=+0.316601598,LastTimestamp:2026-07-17 10:57:25.558791188 +0000 UTC m=+0.316601598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-118.ec2.internal,}"
Jul 17 10:57:25.570676 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.570662    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 10:57:25.570747 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.570672    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 10:57:25.570980 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.570841    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571306    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571322    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571306    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571459    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571467    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571522    2564 factory.go:55] Registering systemd factory
Jul 17 10:57:25.571561 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571536    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 17 10:57:25.571848 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571778    2564 factory.go:153] Registering CRI-O factory
Jul 17 10:57:25.571848 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571825    2564 factory.go:223] Registration of the crio container factory successfully
Jul 17 10:57:25.571953 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571924    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 10:57:25.572010 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571963    2564 factory.go:103] Registering Raw factory
Jul 17 10:57:25.572010 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.571978    2564 manager.go:1196] Started watching for new ooms in manager
Jul 17 10:57:25.572356 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.572332    2564 manager.go:349] Starting recovery of all containers
Jul 17 10:57:25.572600 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.572572    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j98f2"
Jul 17 10:57:25.573032 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.573005    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 10:57:25.573211 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.573190    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 10:57:25.579714 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.579695    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j98f2"
Jul 17 10:57:25.582755 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.582740    2564 manager.go:354] Recovery completed
Jul 17 10:57:25.586544 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.586528    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.588237 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588218    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.588308 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588249    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.588308 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588263    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.588874 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588861    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 10:57:25.588874 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588872    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 10:57:25.588996 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588885    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 10:57:25.588996 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.588862    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.589565 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.589551    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.589618 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.589573    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.589618 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.589582    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.590021 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.590010    2564 policy_none.go:49] "None policy: Start"
Jul 17 10:57:25.590054 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.590025    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 10:57:25.590054 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.590036    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 10:57:25.591002 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.590992    2564 policy_none.go:47] "Start"
Jul 17 10:57:25.637653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.637528    2564 manager.go:337] "Starting Device Plugin manager"
Jul 17 10:57:25.637742 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.637669    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 10:57:25.637742 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.637682    2564 server.go:87] "Starting device plugin registration server"
Jul 17 10:57:25.637895 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.637884    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 10:57:25.637957 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.637900    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 10:57:25.638021 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.638001    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 10:57:25.638088 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.638075    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 10:57:25.638088 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.638087    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 10:57:25.638718 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.638704    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 10:57:25.638760 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.638743    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:25.708230 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.708203    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 10:57:25.709391 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.709372    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 10:57:25.709464 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.709412    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 10:57:25.709464 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.709432    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 10:57:25.709538 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.709466    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 10:57:25.711242 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.711224    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:57:25.737981 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.737961    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.738715 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.738702    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.738762 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.738726    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.738762 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.738739    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.738822 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.738764    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.744601 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.744559    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.744601 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.744577    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-118.ec2.internal\": node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:25.759723 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.759707    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:25.809774 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.809755    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"]
Jul 17 10:57:25.809839 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.809804    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.811366 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.811352    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.811437 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.811380    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.811437 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.811391    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.812528 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.812517    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.812631 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.812620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.812664 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.812645    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.814322 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.814310    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.814381 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.814335    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.814381 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.814354    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.814381 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.814364    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.814468 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.814339    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.814468 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.814426    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.815570 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.815558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.815608 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.815580    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:57:25.816259 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.816240    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:57:25.816320 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.816277    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:57:25.816320 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.816294    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:57:25.842452 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.842436    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-118.ec2.internal\" not found" node="ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.846595 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.846580    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-118.ec2.internal\" not found" node="ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.860619 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.860603    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:25.873309 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.873294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fdd423a4ac1939d0a7793cd663fa352-config\") pod \"kube-apiserver-proxy-ip-10-0-131-118.ec2.internal\" (UID: \"2fdd423a4ac1939d0a7793cd663fa352\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.873374 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.873317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db2d9f09623d80cff2a5d9e10804ec9c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal\" (UID: \"db2d9f09623d80cff2a5d9e10804ec9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.873374 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.873335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db2d9f09623d80cff2a5d9e10804ec9c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal\" (UID: \"db2d9f09623d80cff2a5d9e10804ec9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.961527 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:25.961511    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:25.973597 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.973579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fdd423a4ac1939d0a7793cd663fa352-config\") pod \"kube-apiserver-proxy-ip-10-0-131-118.ec2.internal\" (UID: \"2fdd423a4ac1939d0a7793cd663fa352\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.973645 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.973600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fdd423a4ac1939d0a7793cd663fa352-config\") pod \"kube-apiserver-proxy-ip-10-0-131-118.ec2.internal\" (UID: \"2fdd423a4ac1939d0a7793cd663fa352\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.973645 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.973612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db2d9f09623d80cff2a5d9e10804ec9c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal\" (UID: \"db2d9f09623d80cff2a5d9e10804ec9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.973645 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.973630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db2d9f09623d80cff2a5d9e10804ec9c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal\" (UID: \"db2d9f09623d80cff2a5d9e10804ec9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.973732 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.973645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db2d9f09623d80cff2a5d9e10804ec9c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal\" (UID: \"db2d9f09623d80cff2a5d9e10804ec9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:25.973732 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:25.973663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db2d9f09623d80cff2a5d9e10804ec9c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal\" (UID: \"db2d9f09623d80cff2a5d9e10804ec9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:26.062430 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.062379    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.144809 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.144786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:26.151103 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.151088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:26.162933 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.162904    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.263425 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.263400    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.363833 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.363785    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.464166 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.464143    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.511581 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.511563    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 10:57:26.511947 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.511687    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 10:57:26.564291 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.564274    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.585709 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.585672    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 10:52:25 +0000 UTC" deadline="2028-02-16 19:15:15.398525155 +0000 UTC"
Jul 17 10:57:26.585709 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.585708    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13904h17m48.812821753s"
Jul 17 10:57:26.654099 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:26.654070    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2d9f09623d80cff2a5d9e10804ec9c.slice/crio-3decdc24048627b0c9f2f41caa9f8fd272af8b6778af0ae3e4fa29121f0372eb WatchSource:0}: Error finding container 3decdc24048627b0c9f2f41caa9f8fd272af8b6778af0ae3e4fa29121f0372eb: Status 404 returned error can't find the container with id 3decdc24048627b0c9f2f41caa9f8fd272af8b6778af0ae3e4fa29121f0372eb
Jul 17 10:57:26.654343 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:26.654322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdd423a4ac1939d0a7793cd663fa352.slice/crio-883c50ce35c1445a9cc2452eb3972159b69c3da313b459c987cf89b2f10b5e27 WatchSource:0}: Error finding container 883c50ce35c1445a9cc2452eb3972159b69c3da313b459c987cf89b2f10b5e27: Status 404 returned error can't find the container with id 883c50ce35c1445a9cc2452eb3972159b69c3da313b459c987cf89b2f10b5e27
Jul 17 10:57:26.659056 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.659040    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 10:57:26.664359 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.664342    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.712639 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.712598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal" event={"ID":"2fdd423a4ac1939d0a7793cd663fa352","Type":"ContainerStarted","Data":"883c50ce35c1445a9cc2452eb3972159b69c3da313b459c987cf89b2f10b5e27"}
Jul 17 10:57:26.713659 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.713641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal" event={"ID":"db2d9f09623d80cff2a5d9e10804ec9c","Type":"ContainerStarted","Data":"3decdc24048627b0c9f2f41caa9f8fd272af8b6778af0ae3e4fa29121f0372eb"}
Jul 17 10:57:26.758046 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.758027    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:57:26.764785 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.764766    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.865265 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:26.865246    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-118.ec2.internal\" not found"
Jul 17 10:57:26.950910 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.950864    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:57:26.971710 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.971691    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:26.985750 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.985727    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 10:57:26.986780 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.986765    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal"
Jul 17 10:57:26.994103 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:26.994083    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 10:57:27.005143 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.005122    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:57:27.436376 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.436352    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:57:27.551001 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.550978    2564 apiserver.go:52] "Watching apiserver"
Jul 17 10:57:27.559567 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.559544    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 10:57:27.560248 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.559989    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rwnn6","kube-system/global-pull-secret-syncer-9kgz7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v","openshift-image-registry/node-ca-9n87w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal","openshift-network-diagnostics/network-check-target-n7bhz","openshift-ovn-kubernetes/ovnkube-node-jktbl","kube-system/konnectivity-agent-x8b5k","kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal","openshift-cluster-node-tuning-operator/tuned-82dck","openshift-dns/node-resolver-52nv6","openshift-multus/multus-additional-cni-plugins-csw6c","openshift-multus/multus-npbj8","openshift-multus/network-metrics-daemon-7dzqr"]
Jul 17 10:57:27.562557 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.562230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.564779 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.564760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.567444 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.567423    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.568859 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.568824    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 10:57:27.570356 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.570328    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.571014 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.570612    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.571705 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.571467    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 10:57:27.572274 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572255    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.572583 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572565    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fdx6n\""
Jul 17 10:57:27.572698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572597    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 10:57:27.572758 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572737    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 10:57:27.572812 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572795    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:27.572854 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572823    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4nrpq\""
Jul 17 10:57:27.572893 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.572872    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:27.573332 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.572261    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.577521 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.574388    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.577521 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.575330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:27.577521 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.575395    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:27.577521 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.577374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.580324 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.579739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.581576 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.581561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.581744 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.581701    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:27.584450 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.584234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.585792 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-registration-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.585890 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.585890 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkf6\" (UniqueName: \"kubernetes.io/projected/74df6519-0525-4abd-ac4f-97cca931570e-kube-api-access-knkf6\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.585890 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfps6\" (UniqueName: \"kubernetes.io/projected/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-kube-api-access-pfps6\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:27.585890 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-env-overrides\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klllw\" (UniqueName: \"kubernetes.io/projected/6a377809-486f-4ecf-ac2f-1f7d363fd2db-kube-api-access-klllw\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmh5b\" (UniqueName: \"kubernetes.io/projected/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-kube-api-access-qmh5b\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.585969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-device-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35d634c1-7f8a-4020-9f6d-b7551e606135-serviceca\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-etc-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-ovn\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-run-ovn-kubernetes\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586408 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-socket-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.586408 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586408 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-sys-fs\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.586408 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586399    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-systemd\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586553 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-var-lib-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586553 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-node-log\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586553 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-log-socket\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586553 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-cni-netd\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586553 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovn-node-metrics-cert\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovnkube-script-lib\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-cni-bin\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpstg\" (UniqueName: \"kubernetes.io/projected/35d634c1-7f8a-4020-9f6d-b7551e606135-kube-api-access-vpstg\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-kubelet\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-systemd-units\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.586776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-run-netns\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586780    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-tmp-dir\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35d634c1-7f8a-4020-9f6d-b7551e606135-host\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-slash\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovnkube-config\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.587109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.586977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-hosts-file\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.589206 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.588928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.593012 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.592981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.594248 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.593579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-87k2x\""
Jul 17 10:57:27.594248 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.593932    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.594248 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.593978    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.594738    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.594911    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.595337    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.595480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.595579    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.595692    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.595878    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.595909    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596285    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596326    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.596855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596650    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7pvpj\""
Jul 17 10:57:27.597434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596869    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.597434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596931    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vw8c9\""
Jul 17 10:57:27.597434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596987    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 10:57:27.597434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.596871    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:57:27.597434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.597146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 10:57:27.597685 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.597588    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x6s7k\""
Jul 17 10:57:27.597685 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.597626    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hkhm8\""
Jul 17 10:57:27.597786 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.597689    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-psgt2\""
Jul 17 10:57:27.597786 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.597628    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 10:57:27.598829 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.598796    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 10:57:27.599027 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.598990    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 10:57:27.599240 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.599137    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g78kz\""
Jul 17 10:57:27.629029 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.629003    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 10:57:27.637901 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.637879    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bp7sg"
Jul 17 10:57:27.651642 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.651614    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bp7sg"
Jul 17 10:57:27.672862 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.672833    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 10:57:27.687894 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.687842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysconfig\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.687894 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.687873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysctl-conf\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.688109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.687902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-slash\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.688109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.687925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-hosts-file\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.688109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-registration-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.688109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-slash\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.688109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-hosts-file\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.688109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knkf6\" (UniqueName: \"kubernetes.io/projected/74df6519-0525-4abd-ac4f-97cca931570e-kube-api-access-knkf6\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6p55\" (UniqueName: \"kubernetes.io/projected/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-kube-api-access-r6p55\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-registration-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-sys\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-k8s-cni-cncf-io\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-os-release\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-host\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-iptables-alerter-script\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-netns\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688393 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-multus-certs\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-cnibin\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-cni-binary-copy\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-kubernetes\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-var-lib-kubelet\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-run-ovn-kubernetes\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-cnibin\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-socket-dir-parent\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-run-ovn-kubernetes\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-cni-bin\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.688741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-cni-multus\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-daemon-config\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-cni-binary-copy\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-system-cni-dir\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5bedb6e8-b0d3-49d5-ae05-170c5bc0929e-konnectivity-ca\") pod \"konnectivity-agent-x8b5k\" (UID: \"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e\") " pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysctl-d\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.688991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-systemd\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689017    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-run\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-tmp\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhlf\" (UniqueName: \"kubernetes.io/projected/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-kube-api-access-fhhlf\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-node-log\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-log-socket\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-etc-kubernetes\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-cni-bin\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-node-log\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpstg\" (UniqueName: \"kubernetes.io/projected/35d634c1-7f8a-4020-9f6d-b7551e606135-kube-api-access-vpstg\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.689342 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5bedb6e8-b0d3-49d5-ae05-170c5bc0929e-agent-certs\") pod \"konnectivity-agent-x8b5k\" (UID: \"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e\") " pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-log-socket\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-cni-bin\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-lib-modules\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-kubelet\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-tmp-dir\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35d634c1-7f8a-4020-9f6d-b7551e606135-host\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-cni-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-conf-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjkk8\" (UniqueName: \"kubernetes.io/projected/f48418ba-9fa2-477c-bd0c-514970060925-kube-api-access-wjkk8\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35d634c1-7f8a-4020-9f6d-b7551e606135-host\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-kubelet\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovnkube-config\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfps6\" (UniqueName: \"kubernetes.io/projected/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-kube-api-access-pfps6\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-hostroot\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-tmp-dir\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.690125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-env-overrides\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klllw\" (UniqueName: \"kubernetes.io/projected/6a377809-486f-4ecf-ac2f-1f7d363fd2db-kube-api-access-klllw\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmh5b\" (UniqueName: \"kubernetes.io/projected/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-kube-api-access-qmh5b\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-device-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.689878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35d634c1-7f8a-4020-9f6d-b7551e606135-serviceca\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-env-overrides\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35d634c1-7f8a-4020-9f6d-b7551e606135-serviceca\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-kubelet\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-tuned\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-device-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-etc-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovnkube-config\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-ovn\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-etc-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-ovn\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-socket-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.690855 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-sys-fs\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-socket-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-system-cni-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-sys-fs\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-dbus\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-host-slash\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-systemd\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-var-lib-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.690993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-systemd\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-cni-netd\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-var-lib-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovn-node-metrics-cert\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovnkube-script-lib\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.691599 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-os-release\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-kubelet-config\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6bbs\" (UniqueName: \"kubernetes.io/projected/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-kube-api-access-l6bbs\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-systemd-units\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-run-netns\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-modprobe-d\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691410    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74df6519-0525-4abd-ac4f-97cca931570e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-systemd-units\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-run-netns\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovnkube-script-lib\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691648    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-run-openvswitch\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.691107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a377809-486f-4ecf-ac2f-1f7d363fd2db-host-cni-netd\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.691734    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:27.692325 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.691815    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:57:28.191796443 +0000 UTC m=+2.949606860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:27.695541 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.695520    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a377809-486f-4ecf-ac2f-1f7d363fd2db-ovn-node-metrics-cert\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.706578 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.706556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkf6\" (UniqueName: \"kubernetes.io/projected/74df6519-0525-4abd-ac4f-97cca931570e-kube-api-access-knkf6\") pod \"aws-ebs-csi-driver-node-bw67v\" (UID: \"74df6519-0525-4abd-ac4f-97cca931570e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.707015 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.706994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpstg\" (UniqueName: \"kubernetes.io/projected/35d634c1-7f8a-4020-9f6d-b7551e606135-kube-api-access-vpstg\") pod \"node-ca-9n87w\" (UID: \"35d634c1-7f8a-4020-9f6d-b7551e606135\") " pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.709874 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.709847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfps6\" (UniqueName: \"kubernetes.io/projected/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-kube-api-access-pfps6\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:27.709982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.709953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klllw\" (UniqueName: \"kubernetes.io/projected/6a377809-486f-4ecf-ac2f-1f7d363fd2db-kube-api-access-klllw\") pod \"ovnkube-node-jktbl\" (UID: \"6a377809-486f-4ecf-ac2f-1f7d363fd2db\") " pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.711081 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.711059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmh5b\" (UniqueName: \"kubernetes.io/projected/e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6-kube-api-access-qmh5b\") pod \"node-resolver-52nv6\" (UID: \"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6\") " pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.792057 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-k8s-cni-cncf-io\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792169 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-os-release\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.792169 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-host\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.792169 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-iptables-alerter-script\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.792169 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-netns\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792169 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-multus-certs\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-cnibin\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-cni-binary-copy\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-k8s-cni-cncf-io\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-kubernetes\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-multus-certs\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-var-lib-kubelet\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-var-lib-kubelet\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-cnibin\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-socket-dir-parent\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-cnibin\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-os-release\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.792415 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-cni-bin\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-cni-multus\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-daemon-config\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-cni-binary-copy\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-system-cni-dir\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5bedb6e8-b0d3-49d5-ae05-170c5bc0929e-konnectivity-ca\") pod \"konnectivity-agent-x8b5k\" (UID: \"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e\") " pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysctl-d\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-systemd\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-run\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-tmp\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhlf\" (UniqueName: \"kubernetes.io/projected/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-kube-api-access-fhhlf\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-etc-kubernetes\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5bedb6e8-b0d3-49d5-ae05-170c5bc0929e-agent-certs\") pod \"konnectivity-agent-x8b5k\" (UID: \"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e\") " pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-lib-modules\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-cni-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-conf-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjkk8\" (UniqueName: \"kubernetes.io/projected/f48418ba-9fa2-477c-bd0c-514970060925-kube-api-access-wjkk8\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.793109 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-hostroot\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-kubelet\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-tuned\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.792987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-system-cni-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-kubernetes\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-dbus\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-host-slash\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-os-release\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-kubelet-config\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6bbs\" (UniqueName: \"kubernetes.io/projected/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-kube-api-access-l6bbs\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-modprobe-d\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysconfig\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-dbus\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysctl-conf\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.793897 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-cni-bin\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysctl-d\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6p55\" (UniqueName: \"kubernetes.io/projected/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-kube-api-access-r6p55\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-host\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-sys\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-cnibin\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.794002    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.794079    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:57:28.294059499 +0000 UTC m=+3.051869920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-modprobe-d\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysconfig\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-sysctl-conf\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.794644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-host-slash\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-os-release\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-cni-binary-copy\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-kubelet-config\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-system-cni-dir\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.794004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-socket-dir-parent\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.793848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-run-netns\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-sys\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.795140 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-cni-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-iptables-alerter-script\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.795526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-systemd\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.795526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-run\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.795526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-cni-multus\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f48418ba-9fa2-477c-bd0c-514970060925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.795526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-etc-kubernetes\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795779 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-lib-modules\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.795828 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-cni-binary-copy\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795871 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-host-var-lib-kubelet\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.795920 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.795893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-conf-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.796155 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.796133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-hostroot\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.796216 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.796135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5bedb6e8-b0d3-49d5-ae05-170c5bc0929e-konnectivity-ca\") pod \"konnectivity-agent-x8b5k\" (UID: \"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e\") " pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.796266 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.796240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-system-cni-dir\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.798261 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.796642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f48418ba-9fa2-477c-bd0c-514970060925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.798261 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.796663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-multus-daemon-config\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.798614 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.798591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5bedb6e8-b0d3-49d5-ae05-170c5bc0929e-agent-certs\") pod \"konnectivity-agent-x8b5k\" (UID: \"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e\") " pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.799619 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.799596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-tmp\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.800035 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.800016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-etc-tuned\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.811466 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.811424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhlf\" (UniqueName: \"kubernetes.io/projected/6ff3fe0c-0f00-4ab9-88df-59a8f10b4965-kube-api-access-fhhlf\") pod \"tuned-82dck\" (UID: \"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965\") " pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.811825 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.811802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjkk8\" (UniqueName: \"kubernetes.io/projected/f48418ba-9fa2-477c-bd0c-514970060925-kube-api-access-wjkk8\") pod \"multus-additional-cni-plugins-csw6c\" (UID: \"f48418ba-9fa2-477c-bd0c-514970060925\") " pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:27.812739 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.812447    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:27.812739 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.812474    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:27.812739 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.812489    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:27.812739 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:27.812556    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:57:28.312538656 +0000 UTC m=+3.070349057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:27.814217 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.814197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6bbs\" (UniqueName: \"kubernetes.io/projected/201ebe7c-fe26-456b-a7f5-9327b2c0c5e6-kube-api-access-l6bbs\") pod \"iptables-alerter-rwnn6\" (UID: \"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6\") " pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.814331 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.814310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6p55\" (UniqueName: \"kubernetes.io/projected/80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28-kube-api-access-r6p55\") pod \"multus-npbj8\" (UID: \"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28\") " pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.876839 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.876813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:27.888531 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.888511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52nv6"
Jul 17 10:57:27.900180 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.900161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v"
Jul 17 10:57:27.907762 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.907744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9n87w"
Jul 17 10:57:27.915297 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.915280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:27.922834 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.922815    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-npbj8"
Jul 17 10:57:27.932442 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.932422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82dck"
Jul 17 10:57:27.940052 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.939992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwnn6"
Jul 17 10:57:27.946631 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:27.946599    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-csw6c"
Jul 17 10:57:28.197011 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.196921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:28.197158 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.197065    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:28.197158 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.197134    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:57:29.197118577 +0000 UTC m=+3.954928973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:28.297703 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.297674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:28.297831 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.297815    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:28.297885 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.297874    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:57:29.297860326 +0000 UTC m=+4.055670721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:28.398571 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.398543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:28.398700 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.398664    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:28.398700 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.398680    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:28.398700 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.398688    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:28.398812 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:28.398737    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:57:29.398720874 +0000 UTC m=+4.156531280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:28.631577 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.631535    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74df6519_0525_4abd_ac4f_97cca931570e.slice/crio-61a5e1c8ec378d89680fee7b05344b309c85a1d36186804aa2b90effcfde1296 WatchSource:0}: Error finding container 61a5e1c8ec378d89680fee7b05344b309c85a1d36186804aa2b90effcfde1296: Status 404 returned error can't find the container with id 61a5e1c8ec378d89680fee7b05344b309c85a1d36186804aa2b90effcfde1296
Jul 17 10:57:28.635928 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.635275    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48418ba_9fa2_477c_bd0c_514970060925.slice/crio-74549d729920023027e7ac2848e5d7745e722a202d14f39c8e2e153029b329ff WatchSource:0}: Error finding container 74549d729920023027e7ac2848e5d7745e722a202d14f39c8e2e153029b329ff: Status 404 returned error can't find the container with id 74549d729920023027e7ac2848e5d7745e722a202d14f39c8e2e153029b329ff
Jul 17 10:57:28.637467 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.637446    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode407fa24_ddf7_4838_8f36_bf3b1f3a3ae6.slice/crio-fae58cfc8844bd426bd2295077684f73c06f10d5b71d281ce58e45b396a75a46 WatchSource:0}: Error finding container fae58cfc8844bd426bd2295077684f73c06f10d5b71d281ce58e45b396a75a46: Status 404 returned error can't find the container with id fae58cfc8844bd426bd2295077684f73c06f10d5b71d281ce58e45b396a75a46
Jul 17 10:57:28.638107 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.637996    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201ebe7c_fe26_456b_a7f5_9327b2c0c5e6.slice/crio-2738b2bf00b1906ac6a3dd3f297c1b35a9ce90b1db4ff76d7efe956c5d52582e WatchSource:0}: Error finding container 2738b2bf00b1906ac6a3dd3f297c1b35a9ce90b1db4ff76d7efe956c5d52582e: Status 404 returned error can't find the container with id 2738b2bf00b1906ac6a3dd3f297c1b35a9ce90b1db4ff76d7efe956c5d52582e
Jul 17 10:57:28.638860 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.638748    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff3fe0c_0f00_4ab9_88df_59a8f10b4965.slice/crio-6704d3f86611a24e501555e15b843cf77d3486de9618802fed249ccc2b310d0d WatchSource:0}: Error finding container 6704d3f86611a24e501555e15b843cf77d3486de9618802fed249ccc2b310d0d: Status 404 returned error can't find the container with id 6704d3f86611a24e501555e15b843cf77d3486de9618802fed249ccc2b310d0d
Jul 17 10:57:28.640664 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.640616    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d634c1_7f8a_4020_9f6d_b7551e606135.slice/crio-e6eb2d8cba427d1970f2146a8a03a35f2a1c067831614c0b1fe71c214792ce8c WatchSource:0}: Error finding container e6eb2d8cba427d1970f2146a8a03a35f2a1c067831614c0b1fe71c214792ce8c: Status 404 returned error can't find the container with id e6eb2d8cba427d1970f2146a8a03a35f2a1c067831614c0b1fe71c214792ce8c
Jul 17 10:57:28.645140 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:57:28.645099    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bedb6e8_b0d3_49d5_ae05_170c5bc0929e.slice/crio-f454e7bee4c04df1538fd6a9aa0f2f174be93d77d73049ef5aa7b618584d83ef WatchSource:0}: Error finding container f454e7bee4c04df1538fd6a9aa0f2f174be93d77d73049ef5aa7b618584d83ef: Status 404 returned error can't find the container with id f454e7bee4c04df1538fd6a9aa0f2f174be93d77d73049ef5aa7b618584d83ef
Jul 17 10:57:28.654666 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.654640    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 10:52:27 +0000 UTC" deadline="2028-04-16 02:02:21.242005802 +0000 UTC"
Jul 17 10:57:28.654741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.654668    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15327h4m52.587342013s"
Jul 17 10:57:28.717952 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.717908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerStarted","Data":"74549d729920023027e7ac2848e5d7745e722a202d14f39c8e2e153029b329ff"}
Jul 17 10:57:28.718986 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.718964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"9055e03ad81db66e3ef2263965472818f35802f4c28e98e8420d65737f5c0ae5"}
Jul 17 10:57:28.719930 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.719908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v" event={"ID":"74df6519-0525-4abd-ac4f-97cca931570e","Type":"ContainerStarted","Data":"61a5e1c8ec378d89680fee7b05344b309c85a1d36186804aa2b90effcfde1296"}
Jul 17 10:57:28.720853 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.720830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8b5k" event={"ID":"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e","Type":"ContainerStarted","Data":"f454e7bee4c04df1538fd6a9aa0f2f174be93d77d73049ef5aa7b618584d83ef"}
Jul 17 10:57:28.721863 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.721840    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-npbj8" event={"ID":"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28","Type":"ContainerStarted","Data":"1f65586ec8de10ddf013a76fc3c6867cac51b5e1530c448d6822d153bfc3eb32"}
Jul 17 10:57:28.722927 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.722905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9n87w" event={"ID":"35d634c1-7f8a-4020-9f6d-b7551e606135","Type":"ContainerStarted","Data":"e6eb2d8cba427d1970f2146a8a03a35f2a1c067831614c0b1fe71c214792ce8c"}
Jul 17 10:57:28.723886 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.723863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82dck" event={"ID":"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965","Type":"ContainerStarted","Data":"6704d3f86611a24e501555e15b843cf77d3486de9618802fed249ccc2b310d0d"}
Jul 17 10:57:28.724928 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.724904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52nv6" event={"ID":"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6","Type":"ContainerStarted","Data":"fae58cfc8844bd426bd2295077684f73c06f10d5b71d281ce58e45b396a75a46"}
Jul 17 10:57:28.725925 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:28.725907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwnn6" event={"ID":"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6","Type":"ContainerStarted","Data":"2738b2bf00b1906ac6a3dd3f297c1b35a9ce90b1db4ff76d7efe956c5d52582e"}
Jul 17 10:57:29.209963 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.209218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:29.209963 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.209556    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:29.209963 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.209611    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:57:31.209593457 +0000 UTC m=+5.967403863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:29.310571 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.310343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:29.310571 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.310501    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:29.310571 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.310556    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:57:31.310539135 +0000 UTC m=+6.068349537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:29.411093 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.411059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:29.411241 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.411205    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:29.411241 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.411223    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:29.411241 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.411235    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:29.411408 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.411289    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:57:31.411271665 +0000 UTC m=+6.169082063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:29.655159 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.655074    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 10:52:27 +0000 UTC" deadline="2027-12-13 06:21:47.504048177 +0000 UTC"
Jul 17 10:57:29.655159 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.655129    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12331h24m17.848922588s"
Jul 17 10:57:29.711835 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.711054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:29.711835 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.711169    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:29.711835 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.711546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:29.711835 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.711630    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:29.711835 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.711701    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:29.711835 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:29.711779    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:29.752652 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.752493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal" event={"ID":"2fdd423a4ac1939d0a7793cd663fa352","Type":"ContainerStarted","Data":"efa52e974525554e6b9f1e0bbd8b6c1df9e0333915c4cb273c9fdc1330e1cc3b"}
Jul 17 10:57:29.781381 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.781348    2564 generic.go:356] "Generic (PLEG): container finished" podID="db2d9f09623d80cff2a5d9e10804ec9c" containerID="2b1cfe1ff03185dd63a0e9628049d7ec210ce0445c0f29612793adc0ea97d636" exitCode=0
Jul 17 10:57:29.781529 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.781397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal" event={"ID":"db2d9f09623d80cff2a5d9e10804ec9c","Type":"ContainerDied","Data":"2b1cfe1ff03185dd63a0e9628049d7ec210ce0445c0f29612793adc0ea97d636"}
Jul 17 10:57:29.802806 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:29.802685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-118.ec2.internal" podStartSLOduration=3.802666575 podStartE2EDuration="3.802666575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:29.771713044 +0000 UTC m=+4.529523464" watchObservedRunningTime="2026-07-17 10:57:29.802666575 +0000 UTC m=+4.560476996"
Jul 17 10:57:30.813566 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:30.813413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal" event={"ID":"db2d9f09623d80cff2a5d9e10804ec9c","Type":"ContainerStarted","Data":"8eb74a8f9eb6dcefa7aee3e7f220d15dbdb85032ca69ca4f5c9969ba22490b65"}
Jul 17 10:57:31.226071 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:31.226034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:31.226246 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.226194    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:31.226304 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.226257    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:57:35.226239159 +0000 UTC m=+9.984049598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:31.326593 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:31.326547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:31.326771 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.326704    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:31.326830 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.326774    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:57:35.326755115 +0000 UTC m=+10.084565515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:31.427468 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:31.427433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:31.427721 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.427692    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:31.427790 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.427736    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:31.427790 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.427780    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:31.427898 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.427882    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:57:35.427855298 +0000 UTC m=+10.185665697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:31.711062 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:31.711030    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:31.711229 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.711167    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:31.711526 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:31.711505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:31.711641 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.711622    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:31.711705 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:31.711666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:31.711786 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:31.711737    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:33.710508 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:33.710477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:33.710975 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:33.710603    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:33.710975 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:33.710597    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:33.710975 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:33.710710    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:33.710975 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:33.710486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:33.710975 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:33.710772    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:35.259258 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:35.259221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:35.259722 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.259369    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:35.259722 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.259432    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:57:43.259413827 +0000 UTC m=+18.017224230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:35.359985 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:35.359947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:35.360156 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.360120    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:35.360221 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.360183    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:57:43.360163564 +0000 UTC m=+18.117973974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:35.460644 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:35.460605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:35.460824 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.460771    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:35.460824 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.460793    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:35.460824 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.460805    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:35.461016 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.460863    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:57:43.460844608 +0000 UTC m=+18.218655004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:35.711124 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:35.711062    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:35.711288 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.711178    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:35.711288 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:35.711259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:35.711417 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.711364    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:35.711484 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:35.711413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:35.711534 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:35.711507    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:37.710431 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:37.710397    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:37.710888 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:37.710399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:37.710888 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:37.710549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:37.710888 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:37.710529    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:37.710888 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:37.710648    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:37.710888 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:37.710774    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:39.710433 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:39.710403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:39.710433 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:39.710417    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:39.710867 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:39.710404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:39.710867 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:39.710501    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:39.710867 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:39.710589    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:39.710867 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:39.710637    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:41.710277 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:41.710242    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:41.710277 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:41.710256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:41.710760 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:41.710250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:41.710760 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:41.710357    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:41.710760 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:41.710421    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:41.710760 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:41.710548    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:43.321683 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:43.321649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:43.322276 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.321830    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:43.322276 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.321911    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:57:59.32188882 +0000 UTC m=+34.079699239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:43.422662 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:43.422628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:43.422832 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.422770    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:43.422885 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.422836    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:57:59.422816336 +0000 UTC m=+34.180626731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:43.523114 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:43.523083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:43.523269 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.523213    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:43.523269 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.523231    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:43.523269 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.523243    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:43.523435 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.523300    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:57:59.523282515 +0000 UTC m=+34.281092911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:43.710628 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:43.710602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:43.710802 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:43.710602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:43.710802 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.710710    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:43.710802 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:43.710602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:43.711011 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.710813    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:43.711011 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:43.710871    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:45.711405 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:45.711369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:45.711851 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:45.711459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:45.711851 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:45.711466    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:45.711851 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:45.711567    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:45.711851 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:45.711608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:45.711851 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:45.711710    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:47.710240 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.709947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:47.710887 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.709968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:47.710887 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:47.710333    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:47.710887 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:47.710377    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:47.710887 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.710019    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:47.710887 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:47.710451    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:47.847013 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.846986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-npbj8" event={"ID":"80e1b4a5-fb98-4e89-9b4d-3dd4bbd25b28","Type":"ContainerStarted","Data":"08a56c45d72b50d189a67b92a323244649a9850e584bbfc3484b5897e71d0308"}
Jul 17 10:57:47.848467 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.848434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9n87w" event={"ID":"35d634c1-7f8a-4020-9f6d-b7551e606135","Type":"ContainerStarted","Data":"337b0ceb6dc3c759a03a149e31f493dc7b28fd4bea37a79d8c5872f1f84588a9"}
Jul 17 10:57:47.849764 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.849746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82dck" event={"ID":"6ff3fe0c-0f00-4ab9-88df-59a8f10b4965","Type":"ContainerStarted","Data":"0c75045fea1b7b6d4d9232b8ba2c16ff999744c5690fdf145e2f3a221ba62da2"}
Jul 17 10:57:47.851035 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.851013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52nv6" event={"ID":"e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6","Type":"ContainerStarted","Data":"f3b2ca2f8de17f54c66beaa38b7b73b5db726d8b90783e0a2f06f287d6217bd4"}
Jul 17 10:57:47.852341 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.852322    2564 generic.go:356] "Generic (PLEG): container finished" podID="f48418ba-9fa2-477c-bd0c-514970060925" containerID="aa85185e8961b01a2acd8c9287703baa398b3f3e62dfcb1ed487860edd6d2b8a" exitCode=0
Jul 17 10:57:47.852453 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.852388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerDied","Data":"aa85185e8961b01a2acd8c9287703baa398b3f3e62dfcb1ed487860edd6d2b8a"}
Jul 17 10:57:47.854819 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.854802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"d12c9c51e413ec10077c4bff9d6c801df7c158ad249e6c7e5844c1206f332855"}
Jul 17 10:57:47.854895 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.854866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"d0d3fd70853d67128c87acd8e54eec3a246c15c6fefbf2ad1e308b22875ab6d7"}
Jul 17 10:57:47.854963 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.854914    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"140430b0ca0df248780af40455ca2a50d4e17fc4b73738aa1d070ecf6ff79791"}
Jul 17 10:57:47.855003 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.854974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"dcd7e83c4d2938b3336029794c32aa8f5b2d0e954054986c2edab207608c99d8"}
Jul 17 10:57:47.855036 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.855019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"9578770be2088d27e4b3e7d14c4920c67fc892e39ca0fb34ee5fb99ac08100ae"}
Jul 17 10:57:47.856141 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.856123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v" event={"ID":"74df6519-0525-4abd-ac4f-97cca931570e","Type":"ContainerStarted","Data":"33040cd6c9c9e34056ca542bd56a1153e3826e969279d418652dd0a3e98de93b"}
Jul 17 10:57:47.857290 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.857273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8b5k" event={"ID":"5bedb6e8-b0d3-49d5-ae05-170c5bc0929e","Type":"ContainerStarted","Data":"ed56f4ffade4f5d74a59d838f52575299c41f7ef9aefab424e8549b646b39a65"}
Jul 17 10:57:47.865468 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.865428    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-npbj8" podStartSLOduration=3.978130419 podStartE2EDuration="22.865414314s" totalImagesPullingTime="18.887283895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:47.865101254 +0000 UTC m=+22.622911702" watchObservedRunningTime="2026-07-17 10:57:47.865414314 +0000 UTC m=+22.623224734"
Jul 17 10:57:47.865745 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.865721    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-118.ec2.internal" podStartSLOduration=21.8657131 podStartE2EDuration="21.8657131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:30.833150786 +0000 UTC m=+5.590961209" watchObservedRunningTime="2026-07-17 10:57:47.8657131 +0000 UTC m=+22.623523517"
Jul 17 10:57:47.881685 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.881653    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-52nv6" podStartSLOduration=4.195302404 podStartE2EDuration="22.881641164s" totalImagesPullingTime="18.68633876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:47.881054449 +0000 UTC m=+22.638864888" watchObservedRunningTime="2026-07-17 10:57:47.881641164 +0000 UTC m=+22.639451580"
Jul 17 10:57:47.919702 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.919667    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9n87w" podStartSLOduration=4.236166409 podStartE2EDuration="22.919654898s" totalImagesPullingTime="18.683488489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:47.899595975 +0000 UTC m=+22.657406411" watchObservedRunningTime="2026-07-17 10:57:47.919654898 +0000 UTC m=+22.677465380"
Jul 17 10:57:47.937119 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.937071    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x8b5k" podStartSLOduration=12.594907472 podStartE2EDuration="22.937057424s" totalImagesPullingTime="10.342149952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:47.919311892 +0000 UTC m=+22.677122310" watchObservedRunningTime="2026-07-17 10:57:47.937057424 +0000 UTC m=+22.694867836"
Jul 17 10:57:47.937215 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:47.937195    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82dck" podStartSLOduration=4.251668475 podStartE2EDuration="22.937191664s" totalImagesPullingTime="18.685523189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:47.937048041 +0000 UTC m=+22.694858455" watchObservedRunningTime="2026-07-17 10:57:47.937191664 +0000 UTC m=+22.695002080"
Jul 17 10:57:48.710249 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:48.710227    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 10:57:48.860683 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:48.860651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwnn6" event={"ID":"201ebe7c-fe26-456b-a7f5-9327b2c0c5e6","Type":"ContainerStarted","Data":"738622ccb55224782396163042e42522d38856a29d442391e7e22df36b2389eb"}
Jul 17 10:57:48.863399 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:48.863335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"aa0c849590535fd9899e84fddb55640aab83ef9b4abbf2a1b7ea35ec75a6be9c"}
Jul 17 10:57:48.864884 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:48.864863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v" event={"ID":"74df6519-0525-4abd-ac4f-97cca931570e","Type":"ContainerStarted","Data":"e85e9e9b661f9df067d37f1d02ff7e0e33a5f4786bd8205631b228791f7b4f05"}
Jul 17 10:57:48.879666 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:48.879623    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rwnn6" podStartSLOduration=5.194793805 podStartE2EDuration="23.879611243s" totalImagesPullingTime="18.684817438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:48.879561875 +0000 UTC m=+23.637372293" watchObservedRunningTime="2026-07-17 10:57:48.879611243 +0000 UTC m=+23.637421658"
Jul 17 10:57:49.650258 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:49.650174    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T10:57:48.710245678Z","UUID":"e26271e2-53ed-46a6-b2bd-9edb70e23bb6","Handler":null,"Name":"","Endpoint":""}
Jul 17 10:57:49.652836 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:49.652816    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 10:57:49.652976 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:49.652849    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 10:57:49.709925 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:49.709898    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:49.709925 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:49.709912    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:49.710106 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:49.710029    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:49.710106 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:49.710080    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:49.710180 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:49.710153    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:49.710276 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:49.710256    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:50.172782 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.172754    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:50.173356 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.173337    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:50.871500 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.871466    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"ba80b3951f2bcbf3a9b786320da1f257a740aeeefe89bc1217078cc776072479"}
Jul 17 10:57:50.873409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.873382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v" event={"ID":"74df6519-0525-4abd-ac4f-97cca931570e","Type":"ContainerStarted","Data":"5ce1f582d0f0b1abb5c40face466d959c4117486bae866783c5f0f977a7d4edc"}
Jul 17 10:57:50.873638 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.873609    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:50.874026 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.874007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x8b5k"
Jul 17 10:57:50.908153 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:50.908112    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bw67v" podStartSLOduration=5.076939322 podStartE2EDuration="25.908095834s" totalImagesPullingTime="20.831156512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:50.907919433 +0000 UTC m=+25.665729876" watchObservedRunningTime="2026-07-17 10:57:50.908095834 +0000 UTC m=+25.665906251"
Jul 17 10:57:51.710584 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:51.710552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:51.710584 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:51.710577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:51.710807 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:51.710552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:51.710807 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:51.710682    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:51.710807 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:51.710758    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:51.710962 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:51.710832    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:53.709774 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.709631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:53.710363 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.709635    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:53.710363 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:53.709852    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:53.710363 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:53.709915    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:53.710363 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.709649    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:53.710363 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:53.710130    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:53.881451 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.881421    2564 generic.go:356] "Generic (PLEG): container finished" podID="f48418ba-9fa2-477c-bd0c-514970060925" containerID="753e55a4c5a0b1d9b96b5a0311d02830107f49423965b6ad2447c8c3331c2025" exitCode=0
Jul 17 10:57:53.881559 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.881477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerDied","Data":"753e55a4c5a0b1d9b96b5a0311d02830107f49423965b6ad2447c8c3331c2025"}
Jul 17 10:57:53.884879 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.884861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" event={"ID":"6a377809-486f-4ecf-ac2f-1f7d363fd2db","Type":"ContainerStarted","Data":"a45e16ee6ec6da0935a1be38c45b000121b654845c45383637e0498175775391"}
Jul 17 10:57:53.885126 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.885112    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:53.885174 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.885166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:53.899457 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.899441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:53.938829 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:53.938755    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl" podStartSLOduration=10.23003004 podStartE2EDuration="28.938743663s" totalImagesPullingTime="18.708713623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:53.938500442 +0000 UTC m=+28.696310859" watchObservedRunningTime="2026-07-17 10:57:53.938743663 +0000 UTC m=+28.696554080"
Jul 17 10:57:54.888092 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:54.888063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:54.905752 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:54.905724    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:57:55.309442 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.309421    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9kgz7"]
Jul 17 10:57:55.309538 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.309529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:55.309622 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:55.309605    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:55.311876 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.311853    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dzqr"]
Jul 17 10:57:55.312004 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.311976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:55.312073 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:55.312058    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:55.321850 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.321831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n7bhz"]
Jul 17 10:57:55.322142 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.321919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:55.322142 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:55.322026    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:55.891594 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.891560    2564 generic.go:356] "Generic (PLEG): container finished" podID="f48418ba-9fa2-477c-bd0c-514970060925" containerID="5f6a15c22e81bf62f80e4c9e93bfc279d40ad406c63a608b1cabe8d59a848a6d" exitCode=0
Jul 17 10:57:55.892004 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:55.891645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerDied","Data":"5f6a15c22e81bf62f80e4c9e93bfc279d40ad406c63a608b1cabe8d59a848a6d"}
Jul 17 10:57:56.710479 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:56.710449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:56.710659 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:56.710555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:56.710659 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:56.710560    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:56.710659 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:56.710590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:56.710819 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:56.710680    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:56.710819 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:56.710783    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:57.897835 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:57.897658    2564 generic.go:356] "Generic (PLEG): container finished" podID="f48418ba-9fa2-477c-bd0c-514970060925" containerID="86377b54649277f60bc88ecdbee6cf18308a26fae1848857a0374ff5a9d4babb" exitCode=0
Jul 17 10:57:57.897835 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:57.897731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerDied","Data":"86377b54649277f60bc88ecdbee6cf18308a26fae1848857a0374ff5a9d4babb"}
Jul 17 10:57:58.710634 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:58.710604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:58.710805 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:58.710604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:58.710805 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:58.710728    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dzqr" podUID="05ca34f9-7d5c-4c9e-bd52-d3a723698edf"
Jul 17 10:57:58.710805 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:58.710605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:58.710805 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:58.710770    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7bhz" podUID="0cf70841-f32d-4007-a733-70eb9c9589ca"
Jul 17 10:57:58.711032 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:58.710830    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9kgz7" podUID="08fc6b70-ad90-4d8d-b032-9a4ccb0328d3"
Jul 17 10:57:59.347243 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:59.347215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:57:59.347633 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.347347    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:59.347633 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.347401    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:58:31.347386322 +0000 UTC m=+66.105196717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:57:59.448141 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:59.448097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:57:59.448307 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.448211    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:59.448307 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.448279    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret podName:08fc6b70-ad90-4d8d-b032-9a4ccb0328d3 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:31.448260897 +0000 UTC m=+66.206071307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret") pod "global-pull-secret-syncer-9kgz7" (UID: "08fc6b70-ad90-4d8d-b032-9a4ccb0328d3") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:57:59.548593 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:57:59.548564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:57:59.548769 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.548706    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:57:59.548769 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.548727    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:57:59.548769 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.548738    2564 projected.go:196] Error preparing data for projected volume kube-api-access-27xgq for pod openshift-network-diagnostics/network-check-target-n7bhz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:57:59.548923 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:57:59.548796    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq podName:0cf70841-f32d-4007-a733-70eb9c9589ca nodeName:}" failed. No retries permitted until 2026-07-17 10:58:31.548779014 +0000 UTC m=+66.306589411 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-27xgq" (UniqueName: "kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq") pod "network-check-target-n7bhz" (UID: "0cf70841-f32d-4007-a733-70eb9c9589ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:58:00.104677 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.104645    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-118.ec2.internal" event="NodeReady"
Jul 17 10:58:00.104829 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.104778    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 10:58:00.163391 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.163359    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7rkfb"]
Jul 17 10:58:00.165092 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.165075    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghzgg"]
Jul 17 10:58:00.165226 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.165210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.166609 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.166595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.167552 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.167524    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 10:58:00.167552 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.167524    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 10:58:00.167694 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.167609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w544b\""
Jul 17 10:58:00.168842 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.168826    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 10:58:00.168954 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.168893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9lr9m\""
Jul 17 10:58:00.168954 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.168904    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 10:58:00.172307 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.169316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 10:58:00.177040 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.177021    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghzgg"]
Jul 17 10:58:00.180241 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.180223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rkfb"]
Jul 17 10:58:00.253512 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.253459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.253512 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.253503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhw2w\" (UniqueName: \"kubernetes.io/projected/bce6f35f-9599-47db-9418-a912dcb988b0-kube-api-access-bhw2w\") pod \"ingress-canary-ghzgg\" (UID: \"bce6f35f-9599-47db-9418-a912dcb988b0\") " pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.253626 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.253523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bce6f35f-9599-47db-9418-a912dcb988b0-cert\") pod \"ingress-canary-ghzgg\" (UID: \"bce6f35f-9599-47db-9418-a912dcb988b0\") " pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.253626 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.253546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/823e6c37-b200-443d-b6b1-ddd0ba79cad7-tmp-dir\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.253626 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.253595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lmt7\" (UniqueName: \"kubernetes.io/projected/823e6c37-b200-443d-b6b1-ddd0ba79cad7-kube-api-access-9lmt7\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.253719 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.253637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/823e6c37-b200-443d-b6b1-ddd0ba79cad7-config-volume\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.354158 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/823e6c37-b200-443d-b6b1-ddd0ba79cad7-config-volume\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhw2w\" (UniqueName: \"kubernetes.io/projected/bce6f35f-9599-47db-9418-a912dcb988b0-kube-api-access-bhw2w\") pod \"ingress-canary-ghzgg\" (UID: \"bce6f35f-9599-47db-9418-a912dcb988b0\") " pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bce6f35f-9599-47db-9418-a912dcb988b0-cert\") pod \"ingress-canary-ghzgg\" (UID: \"bce6f35f-9599-47db-9418-a912dcb988b0\") " pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/823e6c37-b200-443d-b6b1-ddd0ba79cad7-tmp-dir\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lmt7\" (UniqueName: \"kubernetes.io/projected/823e6c37-b200-443d-b6b1-ddd0ba79cad7-kube-api-access-9lmt7\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:00.354363    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:00.354611 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:00.354420    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:00.85440244 +0000 UTC m=+35.612212836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:00.354857 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/823e6c37-b200-443d-b6b1-ddd0ba79cad7-tmp-dir\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.354857 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.354786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/823e6c37-b200-443d-b6b1-ddd0ba79cad7-config-volume\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.358798 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.358775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bce6f35f-9599-47db-9418-a912dcb988b0-cert\") pod \"ingress-canary-ghzgg\" (UID: \"bce6f35f-9599-47db-9418-a912dcb988b0\") " pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.364700 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.364683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lmt7\" (UniqueName: \"kubernetes.io/projected/823e6c37-b200-443d-b6b1-ddd0ba79cad7-kube-api-access-9lmt7\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.365122 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.365098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhw2w\" (UniqueName: \"kubernetes.io/projected/bce6f35f-9599-47db-9418-a912dcb988b0-kube-api-access-bhw2w\") pod \"ingress-canary-ghzgg\" (UID: \"bce6f35f-9599-47db-9418-a912dcb988b0\") " pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.482328 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.482302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghzgg"
Jul 17 10:58:00.623198 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.623017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghzgg"]
Jul 17 10:58:00.626277 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:00.626248    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce6f35f_9599_47db_9418_a912dcb988b0.slice/crio-42393ac54f49e4edc5ea994ffbe6c63981ce78d367bee094dcfe625c560a82fd WatchSource:0}: Error finding container 42393ac54f49e4edc5ea994ffbe6c63981ce78d367bee094dcfe625c560a82fd: Status 404 returned error can't find the container with id 42393ac54f49e4edc5ea994ffbe6c63981ce78d367bee094dcfe625c560a82fd
Jul 17 10:58:00.710239 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.710215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:58:00.710360 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.710245    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:58:00.710360 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.710246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:58:00.713494 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.713321    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 10:58:00.713603 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.713339    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 10:58:00.713603 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.713340    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 10:58:00.713603 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.713342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m4ccj\""
Jul 17 10:58:00.713741 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.713606    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 10:58:00.713792 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.713740    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvrbg\""
Jul 17 10:58:00.857114 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.857013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:00.857258 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:00.857121    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:00.857258 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:00.857207    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:01.857187125 +0000 UTC m=+36.614997525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:00.906543 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:00.906511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghzgg" event={"ID":"bce6f35f-9599-47db-9418-a912dcb988b0","Type":"ContainerStarted","Data":"42393ac54f49e4edc5ea994ffbe6c63981ce78d367bee094dcfe625c560a82fd"}
Jul 17 10:58:01.865101 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:01.865058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:01.865861 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:01.865212    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:01.865861 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:01.865301    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:03.865283907 +0000 UTC m=+38.623094308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:02.913560 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:02.913526    2564 generic.go:356] "Generic (PLEG): container finished" podID="f48418ba-9fa2-477c-bd0c-514970060925" containerID="68f1bcb3d916aca70982189b1ecf6736e67758da452d9c987a663ebb0046556d" exitCode=0
Jul 17 10:58:02.913991 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:02.913589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerDied","Data":"68f1bcb3d916aca70982189b1ecf6736e67758da452d9c987a663ebb0046556d"}
Jul 17 10:58:03.879150 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:03.879106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:03.879311 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:03.879289    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:03.879388 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:03.879376    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:07.879352129 +0000 UTC m=+42.637162547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:03.919751 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:03.919718    2564 generic.go:356] "Generic (PLEG): container finished" podID="f48418ba-9fa2-477c-bd0c-514970060925" containerID="8435cd786e11e35c5d45a686d67495c4dbb7a6577e34ef15d3ff1d242a18ea10" exitCode=0
Jul 17 10:58:03.920198 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:03.919783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerDied","Data":"8435cd786e11e35c5d45a686d67495c4dbb7a6577e34ef15d3ff1d242a18ea10"}
Jul 17 10:58:04.926134 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:04.925871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csw6c" event={"ID":"f48418ba-9fa2-477c-bd0c-514970060925","Type":"ContainerStarted","Data":"7b69a931540bc28faf01a956e57e34a29c64fae43d7b9900fc15c82d9cf4ee5f"}
Jul 17 10:58:04.927226 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:04.927201    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghzgg" event={"ID":"bce6f35f-9599-47db-9418-a912dcb988b0","Type":"ContainerStarted","Data":"bdbf22ceb3d1cbd7e7409c8d14fc94e969cd6ec4a9468de1029b639eb5d2126b"}
Jul 17 10:58:04.948735 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:04.948692    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-csw6c" podStartSLOduration=8.974628865 podStartE2EDuration="39.9486774s" totalImagesPullingTime="30.974048535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:04.947127645 +0000 UTC m=+39.704938081" watchObservedRunningTime="2026-07-17 10:58:04.9486774 +0000 UTC m=+39.706487815"
Jul 17 10:58:04.963373 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:04.963331    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghzgg" podStartSLOduration=0.938129945 podStartE2EDuration="4.963315894s" totalImagesPullingTime="4.025185949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:04.962759367 +0000 UTC m=+39.720569794" watchObservedRunningTime="2026-07-17 10:58:04.963315894 +0000 UTC m=+39.721126311"
Jul 17 10:58:07.905071 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:07.905030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:07.905436 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:07.905174    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:07.905436 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:07.905232    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:15.905217685 +0000 UTC m=+50.663028080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:15.956898 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:15.956865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:15.957396 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:15.956988    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:15.957396 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:15.957040    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:31.957026909 +0000 UTC m=+66.714837308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:26.909403 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:26.909376    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jktbl"
Jul 17 10:58:31.353777 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.353748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:58:31.356457 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.356440    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 10:58:31.364279 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:31.364263    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 17 10:58:31.364329 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:31.364320    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs podName:05ca34f9-7d5c-4c9e-bd52-d3a723698edf nodeName:}" failed. No retries permitted until 2026-07-17 10:59:35.364306807 +0000 UTC m=+130.122117215 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs") pod "network-metrics-daemon-7dzqr" (UID: "05ca34f9-7d5c-4c9e-bd52-d3a723698edf") : secret "metrics-daemon-secret" not found
Jul 17 10:58:31.454375 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.454331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:58:31.456885 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.456870    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 10:58:31.468370 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.468349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08fc6b70-ad90-4d8d-b032-9a4ccb0328d3-original-pull-secret\") pod \"global-pull-secret-syncer-9kgz7\" (UID: \"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3\") " pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:58:31.555012 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.554993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:58:31.557222 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.557207    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 10:58:31.567139 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.567123    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 10:58:31.577919 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.577891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xgq\" (UniqueName: \"kubernetes.io/projected/0cf70841-f32d-4007-a733-70eb9c9589ca-kube-api-access-27xgq\") pod \"network-check-target-n7bhz\" (UID: \"0cf70841-f32d-4007-a733-70eb9c9589ca\") " pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:58:31.628000 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.627953    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9kgz7"
Jul 17 10:58:31.634882 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.634867    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvrbg\""
Jul 17 10:58:31.642914 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.642899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:58:31.774833 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.774801    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9kgz7"]
Jul 17 10:58:31.778273 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:31.778251    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08fc6b70_ad90_4d8d_b032_9a4ccb0328d3.slice/crio-51a886a9f003e81c59949f4d6cb7a275bf8fd92d91656d7c12b19ee715eb01ec WatchSource:0}: Error finding container 51a886a9f003e81c59949f4d6cb7a275bf8fd92d91656d7c12b19ee715eb01ec: Status 404 returned error can't find the container with id 51a886a9f003e81c59949f4d6cb7a275bf8fd92d91656d7c12b19ee715eb01ec
Jul 17 10:58:31.789292 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.789269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n7bhz"]
Jul 17 10:58:31.791867 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:31.791845    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf70841_f32d_4007_a733_70eb9c9589ca.slice/crio-93262d4413b600fe5d5d3c840167fb58f34ed9e4e5d2d0b37d13ab0b28fde6fd WatchSource:0}: Error finding container 93262d4413b600fe5d5d3c840167fb58f34ed9e4e5d2d0b37d13ab0b28fde6fd: Status 404 returned error can't find the container with id 93262d4413b600fe5d5d3c840167fb58f34ed9e4e5d2d0b37d13ab0b28fde6fd
Jul 17 10:58:31.958641 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.958614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:58:31.958777 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:31.958718    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:58:31.958777 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:31.958763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls podName:823e6c37-b200-443d-b6b1-ddd0ba79cad7 nodeName:}" failed. No retries permitted until 2026-07-17 10:59:03.958751463 +0000 UTC m=+98.716561859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls") pod "dns-default-7rkfb" (UID: "823e6c37-b200-443d-b6b1-ddd0ba79cad7") : secret "dns-default-metrics-tls" not found
Jul 17 10:58:31.986388 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.986362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n7bhz" event={"ID":"0cf70841-f32d-4007-a733-70eb9c9589ca","Type":"ContainerStarted","Data":"93262d4413b600fe5d5d3c840167fb58f34ed9e4e5d2d0b37d13ab0b28fde6fd"}
Jul 17 10:58:31.987382 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:31.987361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9kgz7" event={"ID":"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3","Type":"ContainerStarted","Data":"51a886a9f003e81c59949f4d6cb7a275bf8fd92d91656d7c12b19ee715eb01ec"}
Jul 17 10:58:37.001197 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:37.001169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n7bhz" event={"ID":"0cf70841-f32d-4007-a733-70eb9c9589ca","Type":"ContainerStarted","Data":"3179d163cd2664df61e4156abf08bf42d40f90400adf2907b05fcd4e9f0aa04d"}
Jul 17 10:58:37.001680 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:37.001286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:58:37.002563 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:37.002542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9kgz7" event={"ID":"08fc6b70-ad90-4d8d-b032-9a4ccb0328d3","Type":"ContainerStarted","Data":"ed07ba75af862d893fdf02a87208ed9859d3e2b05426656b368686cef07eb70e"}
Jul 17 10:58:37.019427 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:37.018164    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n7bhz" podStartSLOduration=67.665821077 podStartE2EDuration="1m12.018148077s" totalImagesPullingTime="4.352327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:37.016830839 +0000 UTC m=+71.774641257" watchObservedRunningTime="2026-07-17 10:58:37.018148077 +0000 UTC m=+71.775958498"
Jul 17 10:58:37.031563 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:37.031522    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9kgz7" podStartSLOduration=67.662330911 podStartE2EDuration="1m12.031507864s" totalImagesPullingTime="4.369176953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:37.031355052 +0000 UTC m=+71.789165492" watchObservedRunningTime="2026-07-17 10:58:37.031507864 +0000 UTC m=+71.789318282"
Jul 17 10:58:42.775588 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.775554    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"]
Jul 17 10:58:42.777382 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.777367    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"]
Jul 17 10:58:42.777494 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.777477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"
Jul 17 10:58:42.778976 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.778951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:42.783748 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.783381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:58:42.783748 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.783471    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:58:42.783978 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.783960    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 10:58:42.784077 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.783986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-958cf\""
Jul 17 10:58:42.784272 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.784258    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 10:58:42.784460 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.784446    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wxg5z\""
Jul 17 10:58:42.784552 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.784518    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 10:58:42.793099 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.793078    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"]
Jul 17 10:58:42.798044 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.798024    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"]
Jul 17 10:58:42.830974 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.830911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8mw\" (UniqueName: \"kubernetes.io/projected/4f99535e-1828-43d1-8370-2bcea13eb01e-kube-api-access-6l8mw\") pod \"volume-data-source-validator-78cf4c6f6-6pz87\" (UID: \"4f99535e-1828-43d1-8370-2bcea13eb01e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"
Jul 17 10:58:42.831095 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.831052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:42.831095 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.831091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln6x6\" (UniqueName: \"kubernetes.io/projected/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-kube-api-access-ln6x6\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:42.867829 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.867801    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"]
Jul 17 10:58:42.869510 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.869496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:42.873184 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.873163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sljk8\""
Jul 17 10:58:42.873313 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.873296    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:58:42.873720 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.873703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 10:58:42.873846 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.873827    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 10:58:42.874095 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.874081    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 10:58:42.890265 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.890249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"]
Jul 17 10:58:42.931656 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.931629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/829ad259-4110-4f31-ae45-6a7da8540a3b-config\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:42.931742 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.931656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8c5z\" (UniqueName: \"kubernetes.io/projected/829ad259-4110-4f31-ae45-6a7da8540a3b-kube-api-access-x8c5z\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:42.931742 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.931681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln6x6\" (UniqueName: \"kubernetes.io/projected/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-kube-api-access-ln6x6\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:42.931742 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.931698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8mw\" (UniqueName: \"kubernetes.io/projected/4f99535e-1828-43d1-8370-2bcea13eb01e-kube-api-access-6l8mw\") pod \"volume-data-source-validator-78cf4c6f6-6pz87\" (UID: \"4f99535e-1828-43d1-8370-2bcea13eb01e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"
Jul 17 10:58:42.931742 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.931738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/829ad259-4110-4f31-ae45-6a7da8540a3b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:42.931896 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.931796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:42.931896 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:42.931874    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 10:58:42.932015 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:42.931926    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls podName:365559ff-6ffc-40f4-bbb8-e62250a1ca2c nodeName:}" failed. No retries permitted until 2026-07-17 10:58:43.431912466 +0000 UTC m=+78.189722862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-v95gv" (UID: "365559ff-6ffc-40f4-bbb8-e62250a1ca2c") : secret "samples-operator-tls" not found
Jul 17 10:58:42.943470 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.943448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8mw\" (UniqueName: \"kubernetes.io/projected/4f99535e-1828-43d1-8370-2bcea13eb01e-kube-api-access-6l8mw\") pod \"volume-data-source-validator-78cf4c6f6-6pz87\" (UID: \"4f99535e-1828-43d1-8370-2bcea13eb01e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"
Jul 17 10:58:42.944105 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.944081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln6x6\" (UniqueName: \"kubernetes.io/projected/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-kube-api-access-ln6x6\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:42.977346 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.977321    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tx8mp"]
Jul 17 10:58:42.979032 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.979016    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6876c6d6d4-dqdzq"]
Jul 17 10:58:42.979144 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.979128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:42.980588 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.980570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:42.981322 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.981305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 17 10:58:42.981858 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.981840    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 10:58:42.981858 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.981848    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 17 10:58:42.982025 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.981903    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h94vp\""
Jul 17 10:58:42.982080 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.982054    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 10:58:42.986753 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.986733    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 10:58:42.986927 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.986905    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 10:58:42.987036 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.986961    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 10:58:42.987036 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.987006    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 10:58:42.987138 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.987007    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 10:58:42.987434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.987418    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 10:58:42.988165 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.988151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f5mx2\""
Jul 17 10:58:42.994459 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.994440    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 17 10:58:42.999288 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:42.999271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6876c6d6d4-dqdzq"]
Jul 17 10:58:43.000055 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.000035    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tx8mp"]
Jul 17 10:58:43.032150 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c3ec98-d7b6-4384-af89-c4f515b6b856-service-ca-bundle\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.032150 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/829ad259-4110-4f31-ae45-6a7da8540a3b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.032150 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c3ec98-d7b6-4384-af89-c4f515b6b856-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.032330 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-default-certificate\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.032330 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.032518 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mj9\" (UniqueName: \"kubernetes.io/projected/a68c3e38-b162-4249-b041-07bfad19e101-kube-api-access-45mj9\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.032518 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28kp8\" (UniqueName: \"kubernetes.io/projected/33c3ec98-d7b6-4384-af89-c4f515b6b856-kube-api-access-28kp8\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.032518 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-stats-auth\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.032518 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33c3ec98-d7b6-4384-af89-c4f515b6b856-tmp\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.032698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/829ad259-4110-4f31-ae45-6a7da8540a3b-config\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.032698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8c5z\" (UniqueName: \"kubernetes.io/projected/829ad259-4110-4f31-ae45-6a7da8540a3b-kube-api-access-x8c5z\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.032698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.032698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/33c3ec98-d7b6-4384-af89-c4f515b6b856-snapshots\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.032698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c3ec98-d7b6-4384-af89-c4f515b6b856-serving-cert\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.032976 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.032961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/829ad259-4110-4f31-ae45-6a7da8540a3b-config\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.034230 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.034214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/829ad259-4110-4f31-ae45-6a7da8540a3b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.045127 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.045100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8c5z\" (UniqueName: \"kubernetes.io/projected/829ad259-4110-4f31-ae45-6a7da8540a3b-kube-api-access-x8c5z\") pod \"service-ca-operator-5bcbc94c78-9nzf2\" (UID: \"829ad259-4110-4f31-ae45-6a7da8540a3b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.086677 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.086650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c3ec98-d7b6-4384-af89-c4f515b6b856-serving-cert\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c3ec98-d7b6-4384-af89-c4f515b6b856-service-ca-bundle\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c3ec98-d7b6-4384-af89-c4f515b6b856-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-default-certificate\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mj9\" (UniqueName: \"kubernetes.io/projected/a68c3e38-b162-4249-b041-07bfad19e101-kube-api-access-45mj9\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28kp8\" (UniqueName: \"kubernetes.io/projected/33c3ec98-d7b6-4384-af89-c4f515b6b856-kube-api-access-28kp8\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-stats-auth\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33c3ec98-d7b6-4384-af89-c4f515b6b856-tmp\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.133516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/33c3ec98-d7b6-4384-af89-c4f515b6b856-snapshots\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.133985    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.134047    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:43.634029025 +0000 UTC m=+78.391839436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : secret "router-metrics-certs-default" not found
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.134071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33c3ec98-d7b6-4384-af89-c4f515b6b856-tmp\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.134275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.134124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/33c3ec98-d7b6-4384-af89-c4f515b6b856-snapshots\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.135093 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.134250    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:43.634236016 +0000 UTC m=+78.392046433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : configmap references non-existent config key: service-ca.crt
Jul 17 10:58:43.135093 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.134657    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c3ec98-d7b6-4384-af89-c4f515b6b856-service-ca-bundle\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.135510 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.135486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c3ec98-d7b6-4384-af89-c4f515b6b856-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.136221 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.136197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c3ec98-d7b6-4384-af89-c4f515b6b856-serving-cert\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.136462 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.136444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-default-certificate\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.136574 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.136558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-stats-auth\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.145928 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.145895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28kp8\" (UniqueName: \"kubernetes.io/projected/33c3ec98-d7b6-4384-af89-c4f515b6b856-kube-api-access-28kp8\") pod \"insights-operator-555d9d7885-tx8mp\" (UID: \"33c3ec98-d7b6-4384-af89-c4f515b6b856\") " pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.146547 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.146531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mj9\" (UniqueName: \"kubernetes.io/projected/a68c3e38-b162-4249-b041-07bfad19e101-kube-api-access-45mj9\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.177279 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.177253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"
Jul 17 10:58:43.203125 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.203103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87"]
Jul 17 10:58:43.205404 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:43.205378    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f99535e_1828_43d1_8370_2bcea13eb01e.slice/crio-d997781b9f3b87b63ced769be88ec202187ae95a4f470ca6ae1ed68e922f52e7 WatchSource:0}: Error finding container d997781b9f3b87b63ced769be88ec202187ae95a4f470ca6ae1ed68e922f52e7: Status 404 returned error can't find the container with id d997781b9f3b87b63ced769be88ec202187ae95a4f470ca6ae1ed68e922f52e7
Jul 17 10:58:43.289279 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.289228    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-tx8mp"
Jul 17 10:58:43.295650 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.295620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2"]
Jul 17 10:58:43.298385 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:43.298361    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829ad259_4110_4f31_ae45_6a7da8540a3b.slice/crio-0c28a7241cd782732ab9048b4b1ad48e66ea1548e0cc8f9189278602b2d6eea3 WatchSource:0}: Error finding container 0c28a7241cd782732ab9048b4b1ad48e66ea1548e0cc8f9189278602b2d6eea3: Status 404 returned error can't find the container with id 0c28a7241cd782732ab9048b4b1ad48e66ea1548e0cc8f9189278602b2d6eea3
Jul 17 10:58:43.401422 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.401270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tx8mp"]
Jul 17 10:58:43.405127 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:43.405099    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c3ec98_d7b6_4384_af89_c4f515b6b856.slice/crio-1d254b4137067d3d565ec4e5689daf71b28907ed92265d817e0369ad3911d921 WatchSource:0}: Error finding container 1d254b4137067d3d565ec4e5689daf71b28907ed92265d817e0369ad3911d921: Status 404 returned error can't find the container with id 1d254b4137067d3d565ec4e5689daf71b28907ed92265d817e0369ad3911d921
Jul 17 10:58:43.436503 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.436471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:43.436589 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.436580    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 10:58:43.436626 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.436620    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls podName:365559ff-6ffc-40f4-bbb8-e62250a1ca2c nodeName:}" failed. No retries permitted until 2026-07-17 10:58:44.436608295 +0000 UTC m=+79.194418695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-v95gv" (UID: "365559ff-6ffc-40f4-bbb8-e62250a1ca2c") : secret "samples-operator-tls" not found
Jul 17 10:58:43.637903 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.637847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.637995 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:43.637909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:43.638037 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.637998    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:44.637984148 +0000 UTC m=+79.395794543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : configmap references non-existent config key: service-ca.crt
Jul 17 10:58:43.638037 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.637998    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:58:43.638037 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:43.638030    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:44.638023407 +0000 UTC m=+79.395833846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : secret "router-metrics-certs-default" not found
Jul 17 10:58:44.021490 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:44.021456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tx8mp" event={"ID":"33c3ec98-d7b6-4384-af89-c4f515b6b856","Type":"ContainerStarted","Data":"1d254b4137067d3d565ec4e5689daf71b28907ed92265d817e0369ad3911d921"}
Jul 17 10:58:44.023365 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:44.023335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2" event={"ID":"829ad259-4110-4f31-ae45-6a7da8540a3b","Type":"ContainerStarted","Data":"0c28a7241cd782732ab9048b4b1ad48e66ea1548e0cc8f9189278602b2d6eea3"}
Jul 17 10:58:44.024904 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:44.024851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87" event={"ID":"4f99535e-1828-43d1-8370-2bcea13eb01e","Type":"ContainerStarted","Data":"d997781b9f3b87b63ced769be88ec202187ae95a4f470ca6ae1ed68e922f52e7"}
Jul 17 10:58:44.444593 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:44.444524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:44.444662 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:44.444639    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 10:58:44.444704 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:44.444686    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls podName:365559ff-6ffc-40f4-bbb8-e62250a1ca2c nodeName:}" failed. No retries permitted until 2026-07-17 10:58:46.444671961 +0000 UTC m=+81.202482362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-v95gv" (UID: "365559ff-6ffc-40f4-bbb8-e62250a1ca2c") : secret "samples-operator-tls" not found
Jul 17 10:58:44.646538 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:44.646502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:44.646711 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:44.646574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:44.646711 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:44.646647    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:58:44.646711 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:44.646708    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:46.646692991 +0000 UTC m=+81.404503392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : configmap references non-existent config key: service-ca.crt
Jul 17 10:58:44.646890 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:44.646730    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:46.646720174 +0000 UTC m=+81.404530579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : secret "router-metrics-certs-default" not found
Jul 17 10:58:45.030332 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:45.030245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87" event={"ID":"4f99535e-1828-43d1-8370-2bcea13eb01e","Type":"ContainerStarted","Data":"a43353419484839a54c8de6f7a67bde14818a92252e21074a8cf108f3cfd03a0"}
Jul 17 10:58:45.050288 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:45.050222    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6pz87" podStartSLOduration=1.8778852019999999 podStartE2EDuration="3.050201861s" totalImagesPullingTime="1.172316659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:45.048886375 +0000 UTC m=+79.806696809" watchObservedRunningTime="2026-07-17 10:58:45.050201861 +0000 UTC m=+79.808012278"
Jul 17 10:58:46.035505 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.035470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tx8mp" event={"ID":"33c3ec98-d7b6-4384-af89-c4f515b6b856","Type":"ContainerStarted","Data":"7de5d4e08dfbf2d249bff16e709f77d0e94d92e71a922e4e5ca3bbfe4340d1b7"}
Jul 17 10:58:46.036991 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.036965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2" event={"ID":"829ad259-4110-4f31-ae45-6a7da8540a3b","Type":"ContainerStarted","Data":"bcd93200d5c713ae9cc5f87ad2f93bfe3da931d06589fc0549233e055242ce64"}
Jul 17 10:58:46.074022 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.073977    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-tx8mp" podStartSLOduration=1.8938782079999998 podStartE2EDuration="4.07396516s" totalImagesPullingTime="2.180086952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:46.0692991 +0000 UTC m=+80.827109535" watchObservedRunningTime="2026-07-17 10:58:46.07396516 +0000 UTC m=+80.831775555"
Jul 17 10:58:46.095048 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.094951    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2" podStartSLOduration=1.809754625 podStartE2EDuration="4.094923796s" totalImagesPullingTime="2.285169171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:46.094176467 +0000 UTC m=+80.851986894" watchObservedRunningTime="2026-07-17 10:58:46.094923796 +0000 UTC m=+80.852734214"
Jul 17 10:58:46.459144 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.459110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:46.459290 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:46.459217    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 10:58:46.459290 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:46.459270    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls podName:365559ff-6ffc-40f4-bbb8-e62250a1ca2c nodeName:}" failed. No retries permitted until 2026-07-17 10:58:50.459256902 +0000 UTC m=+85.217067301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-v95gv" (UID: "365559ff-6ffc-40f4-bbb8-e62250a1ca2c") : secret "samples-operator-tls" not found
Jul 17 10:58:46.661031 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.660996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:46.661184 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:46.661058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:46.661184 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:46.661146    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:58:46.661289 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:46.661203    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:50.661189262 +0000 UTC m=+85.418999661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : secret "router-metrics-certs-default" not found
Jul 17 10:58:46.661289 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:46.661255    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:50.66123544 +0000 UTC m=+85.419045852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : configmap references non-existent config key: service-ca.crt
Jul 17 10:58:47.095896 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.095865    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-69jq9"]
Jul 17 10:58:47.099275 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.099256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.103381 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.103358    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 10:58:47.103468 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.103450    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 10:58:47.103536 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.103487    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gfnlk\""
Jul 17 10:58:47.113221 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.113198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-69jq9"]
Jul 17 10:58:47.164848 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.164819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.164998 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.164856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.164998 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.164881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bfdac47a-29e5-411f-9a84-a5c0ded371ac-crio-socket\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.164998 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.164970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfdac47a-29e5-411f-9a84-a5c0ded371ac-data-volume\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.165119 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.165009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7wm7\" (UniqueName: \"kubernetes.io/projected/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-api-access-l7wm7\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266309 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266413 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266413 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bfdac47a-29e5-411f-9a84-a5c0ded371ac-crio-socket\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266413 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.266385    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:58:47.266544 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.266415    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:47.266544 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.266450    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:47.766433935 +0000 UTC m=+82.524244334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : configmap "kube-rbac-proxy" not found
Jul 17 10:58:47.266544 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bfdac47a-29e5-411f-9a84-a5c0ded371ac-crio-socket\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266544 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.266522    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:47.766496464 +0000 UTC m=+82.524306873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:47.266750 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfdac47a-29e5-411f-9a84-a5c0ded371ac-data-volume\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266750 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7wm7\" (UniqueName: \"kubernetes.io/projected/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-api-access-l7wm7\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.266908 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.266895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfdac47a-29e5-411f-9a84-a5c0ded371ac-data-volume\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.278172 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.278151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7wm7\" (UniqueName: \"kubernetes.io/projected/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-api-access-l7wm7\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.771327 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.771220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.771327 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:47.771254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:47.771531 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.771375    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:47.771531 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.771392    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:58:47.771531 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.771436    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:48.771421866 +0000 UTC m=+83.529232268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:47.771531 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:47.771452    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:48.77144532 +0000 UTC m=+83.529255715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : configmap "kube-rbac-proxy" not found
Jul 17 10:58:48.779851 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:48.779815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:48.779851 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:48.779848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:48.780334 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:48.779921    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:58:48.780334 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:48.779996    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:50.779981186 +0000 UTC m=+85.537791584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : configmap "kube-rbac-proxy" not found
Jul 17 10:58:48.780334 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:48.780002    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:48.780334 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:48.780069    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:50.780051052 +0000 UTC m=+85.537861468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:49.693267 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:49.693243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52nv6_e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6/dns-node-resolver/0.log"
Jul 17 10:58:50.492136 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:50.492103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:50.492503 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.492210    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 10:58:50.492503 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.492263    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls podName:365559ff-6ffc-40f4-bbb8-e62250a1ca2c nodeName:}" failed. No retries permitted until 2026-07-17 10:58:58.492250108 +0000 UTC m=+93.250060507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-v95gv" (UID: "365559ff-6ffc-40f4-bbb8-e62250a1ca2c") : secret "samples-operator-tls" not found
Jul 17 10:58:50.694044 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:50.694013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:50.694250 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:50.694061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:50.694250 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.694163    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:58:50.694250 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.694222    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:58.69420815 +0000 UTC m=+93.452018572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : secret "router-metrics-certs-default" not found
Jul 17 10:58:50.694250 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.694237    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle podName:a68c3e38-b162-4249-b041-07bfad19e101 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:58.694231252 +0000 UTC m=+93.452041660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle") pod "router-default-6876c6d6d4-dqdzq" (UID: "a68c3e38-b162-4249-b041-07bfad19e101") : configmap references non-existent config key: service-ca.crt
Jul 17 10:58:50.694860 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:50.694843    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9n87w_35d634c1-7f8a-4020-9f6d-b7551e606135/node-ca/0.log"
Jul 17 10:58:50.795266 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:50.795200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:50.795266 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:50.795230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:50.795417 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.795335    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:58:50.795417 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.795391    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:54.795375621 +0000 UTC m=+89.553186025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : configmap "kube-rbac-proxy" not found
Jul 17 10:58:50.795417 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.795340    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:50.795516 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:50.795468    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:58:54.795453165 +0000 UTC m=+89.553263566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:51.692446 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:51.692414    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghzgg_bce6f35f-9599-47db-9418-a912dcb988b0/serve-healthcheck-canary/0.log"
Jul 17 10:58:54.824258 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:54.824225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:54.824258 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:54.824261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:58:54.824736 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:54.824380    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:58:54.824736 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:54.824421    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:54.824736 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:54.824433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:59:02.824419068 +0000 UTC m=+97.582229464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : configmap "kube-rbac-proxy" not found
Jul 17 10:58:54.824736 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:58:54.824492    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls podName:bfdac47a-29e5-411f-9a84-a5c0ded371ac nodeName:}" failed. No retries permitted until 2026-07-17 10:59:02.824475182 +0000 UTC m=+97.582285584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-69jq9" (UID: "bfdac47a-29e5-411f-9a84-a5c0ded371ac") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:58:58.555285 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.555246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:58.557608 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.557589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/365559ff-6ffc-40f4-bbb8-e62250a1ca2c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-v95gv\" (UID: \"365559ff-6ffc-40f4-bbb8-e62250a1ca2c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:58.691711 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.691683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"
Jul 17 10:58:58.757014 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.756984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:58.757179 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.757045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:58.757622 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.757600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68c3e38-b162-4249-b041-07bfad19e101-service-ca-bundle\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:58.759165 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.759149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a68c3e38-b162-4249-b041-07bfad19e101-metrics-certs\") pod \"router-default-6876c6d6d4-dqdzq\" (UID: \"a68c3e38-b162-4249-b041-07bfad19e101\") " pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:58.813752 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.813688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv"]
Jul 17 10:58:58.893197 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:58.893170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:59.012529 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.012486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6876c6d6d4-dqdzq"]
Jul 17 10:58:59.015461 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:58:59.015436    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68c3e38_b162_4249_b041_07bfad19e101.slice/crio-796d1662f98e92d7f14660f5653de3d3f54a62069b3020a956ca0b47b85d95a5 WatchSource:0}: Error finding container 796d1662f98e92d7f14660f5653de3d3f54a62069b3020a956ca0b47b85d95a5: Status 404 returned error can't find the container with id 796d1662f98e92d7f14660f5653de3d3f54a62069b3020a956ca0b47b85d95a5
Jul 17 10:58:59.073893 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.073863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq" event={"ID":"a68c3e38-b162-4249-b041-07bfad19e101","Type":"ContainerStarted","Data":"7d3aac98907828912d63fa38d9e779bfc6a802b0656e721b1e80656e275f4025"}
Jul 17 10:58:59.074016 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.073920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq" event={"ID":"a68c3e38-b162-4249-b041-07bfad19e101","Type":"ContainerStarted","Data":"796d1662f98e92d7f14660f5653de3d3f54a62069b3020a956ca0b47b85d95a5"}
Jul 17 10:58:59.074951 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.074916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv" event={"ID":"365559ff-6ffc-40f4-bbb8-e62250a1ca2c","Type":"ContainerStarted","Data":"9bd44af9e90b4f98cb34d1b0ef817a610c1e55248973f3de0aadd9c7374632ff"}
Jul 17 10:58:59.093473 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.093004    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq" podStartSLOduration=17.092988393 podStartE2EDuration="17.092988393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:59.092658185 +0000 UTC m=+93.850468624" watchObservedRunningTime="2026-07-17 10:58:59.092988393 +0000 UTC m=+93.850798811"
Jul 17 10:58:59.893630 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.893590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:58:59.896468 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:58:59.896444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:59:00.078906 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:00.078875    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:59:00.080274 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:00.080252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6876c6d6d4-dqdzq"
Jul 17 10:59:01.083677 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:01.083637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv" event={"ID":"365559ff-6ffc-40f4-bbb8-e62250a1ca2c","Type":"ContainerStarted","Data":"5cdea6c8653da93a62df1beee7212847cbae947cddc7de1a399eddecbd4577d9"}
Jul 17 10:59:01.083677 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:01.083687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv" event={"ID":"365559ff-6ffc-40f4-bbb8-e62250a1ca2c","Type":"ContainerStarted","Data":"102165496c89d6b120bc48f736378070dbe4e9cb1bc88f7c3be33f0ee94a7b53"}
Jul 17 10:59:01.101989 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:01.101925    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-v95gv" podStartSLOduration=17.551322716 podStartE2EDuration="19.101912232s" totalImagesPullingTime="1.550589516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:01.101491314 +0000 UTC m=+95.859301750" watchObservedRunningTime="2026-07-17 10:59:01.101912232 +0000 UTC m=+95.859722650"
Jul 17 10:59:02.892350 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:02.892309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:59:02.892350 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:02.892353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:59:02.892856 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:02.892839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfdac47a-29e5-411f-9a84-a5c0ded371ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:59:02.894562 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:02.894543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfdac47a-29e5-411f-9a84-a5c0ded371ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-69jq9\" (UID: \"bfdac47a-29e5-411f-9a84-a5c0ded371ac\") " pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:59:03.007887 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:03.007838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-69jq9"
Jul 17 10:59:03.142041 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:03.142001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-69jq9"]
Jul 17 10:59:03.146657 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:03.146630    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdac47a_29e5_411f_9a84_a5c0ded371ac.slice/crio-3252dbaabb16e5155c6d5c83129a277bbffd29a35dfa9d2f4052378c46090eb2 WatchSource:0}: Error finding container 3252dbaabb16e5155c6d5c83129a277bbffd29a35dfa9d2f4052378c46090eb2: Status 404 returned error can't find the container with id 3252dbaabb16e5155c6d5c83129a277bbffd29a35dfa9d2f4052378c46090eb2
Jul 17 10:59:04.000507 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:04.000457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:59:04.003292 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:04.003260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/823e6c37-b200-443d-b6b1-ddd0ba79cad7-metrics-tls\") pod \"dns-default-7rkfb\" (UID: \"823e6c37-b200-443d-b6b1-ddd0ba79cad7\") " pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:59:04.078618 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:04.078575    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w544b\""
Jul 17 10:59:04.086831 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:04.086793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:59:04.094015 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:04.093982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-69jq9" event={"ID":"bfdac47a-29e5-411f-9a84-a5c0ded371ac","Type":"ContainerStarted","Data":"3252dbaabb16e5155c6d5c83129a277bbffd29a35dfa9d2f4052378c46090eb2"}
Jul 17 10:59:04.230290 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:04.230260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rkfb"]
Jul 17 10:59:04.233525 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:04.233496    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823e6c37_b200_443d_b6b1_ddd0ba79cad7.slice/crio-38f36407a6a8a022c33b0405cbc8ce5a53bb5744ad8ef8e056c48da713990928 WatchSource:0}: Error finding container 38f36407a6a8a022c33b0405cbc8ce5a53bb5744ad8ef8e056c48da713990928: Status 404 returned error can't find the container with id 38f36407a6a8a022c33b0405cbc8ce5a53bb5744ad8ef8e056c48da713990928
Jul 17 10:59:05.099350 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:05.099313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rkfb" event={"ID":"823e6c37-b200-443d-b6b1-ddd0ba79cad7","Type":"ContainerStarted","Data":"38f36407a6a8a022c33b0405cbc8ce5a53bb5744ad8ef8e056c48da713990928"}
Jul 17 10:59:08.007844 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:08.007812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n7bhz"
Jul 17 10:59:09.786686 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.786655    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-nzmhn"]
Jul 17 10:59:09.808032 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.807956    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-nzmhn"]
Jul 17 10:59:09.808158 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.808131    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:09.810843 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.810820    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 10:59:09.811221 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.811203    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-76nws\""
Jul 17 10:59:09.811859 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.811842    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 10:59:09.947210 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:09.947178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vnvt\" (UniqueName: \"kubernetes.io/projected/d27b3795-3fa6-4998-b579-c6968df9bbf4-kube-api-access-8vnvt\") pod \"downloads-5bc67dcd46-nzmhn\" (UID: \"d27b3795-3fa6-4998-b579-c6968df9bbf4\") " pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:10.048423 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.048355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vnvt\" (UniqueName: \"kubernetes.io/projected/d27b3795-3fa6-4998-b579-c6968df9bbf4-kube-api-access-8vnvt\") pod \"downloads-5bc67dcd46-nzmhn\" (UID: \"d27b3795-3fa6-4998-b579-c6968df9bbf4\") " pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:10.059226 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.059203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vnvt\" (UniqueName: \"kubernetes.io/projected/d27b3795-3fa6-4998-b579-c6968df9bbf4-kube-api-access-8vnvt\") pod \"downloads-5bc67dcd46-nzmhn\" (UID: \"d27b3795-3fa6-4998-b579-c6968df9bbf4\") " pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:10.117495 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.117475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:10.117615 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.117519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-69jq9" event={"ID":"bfdac47a-29e5-411f-9a84-a5c0ded371ac","Type":"ContainerStarted","Data":"b07eb693591e91c7abf79a3ad77c324756486a6cf09418440cc92c25eccfa405"}
Jul 17 10:59:10.119276 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.119253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rkfb" event={"ID":"823e6c37-b200-443d-b6b1-ddd0ba79cad7","Type":"ContainerStarted","Data":"19f72686c14595fe2a3fb5657189750e6e6ed7118da180f8a86c840cd868364d"}
Jul 17 10:59:10.119368 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.119292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rkfb" event={"ID":"823e6c37-b200-443d-b6b1-ddd0ba79cad7","Type":"ContainerStarted","Data":"ea116b73321a7d90b2b2392ac5724281eb61eea432584cbc7b3e94ac8f368798"}
Jul 17 10:59:10.119427 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.119403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:59:10.144458 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.144419    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7rkfb" podStartSLOduration=65.338255205 podStartE2EDuration="1m10.144404193s" totalImagesPullingTime="4.806148988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:10.143420528 +0000 UTC m=+104.901230964" watchObservedRunningTime="2026-07-17 10:59:10.144404193 +0000 UTC m=+104.902214611"
Jul 17 10:59:10.263577 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:10.263547    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-nzmhn"]
Jul 17 10:59:10.266986 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:10.266958    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27b3795_3fa6_4998_b579_c6968df9bbf4.slice/crio-ca063d20a33155559234a7bc717a138bdae258cb2cec136a69efbfab4a0c95fd WatchSource:0}: Error finding container ca063d20a33155559234a7bc717a138bdae258cb2cec136a69efbfab4a0c95fd: Status 404 returned error can't find the container with id ca063d20a33155559234a7bc717a138bdae258cb2cec136a69efbfab4a0c95fd
Jul 17 10:59:11.125185 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:11.125147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-nzmhn" event={"ID":"d27b3795-3fa6-4998-b579-c6968df9bbf4","Type":"ContainerStarted","Data":"ca063d20a33155559234a7bc717a138bdae258cb2cec136a69efbfab4a0c95fd"}
Jul 17 10:59:14.141026 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:14.140981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-69jq9" event={"ID":"bfdac47a-29e5-411f-9a84-a5c0ded371ac","Type":"ContainerStarted","Data":"c13c9761ffe79307393a1fef8d472930c827b04ec1823014331f5f2f2e91a972"}
Jul 17 10:59:18.158652 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.158568    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-69jq9" event={"ID":"bfdac47a-29e5-411f-9a84-a5c0ded371ac","Type":"ContainerStarted","Data":"c4246b03c667b3c954c13c498bdd18645aabc1566c72ba37d6d43f23e10a9ac2"}
Jul 17 10:59:18.178662 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.178612    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-69jq9" podStartSLOduration=17.151972418 podStartE2EDuration="31.178597882s" totalImagesPullingTime="14.026625464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:58:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:18.176671148 +0000 UTC m=+112.934481600" watchObservedRunningTime="2026-07-17 10:59:18.178597882 +0000 UTC m=+112.936408299"
Jul 17 10:59:18.746543 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.746512    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"]
Jul 17 10:59:18.748776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.748751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:18.751260 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.751236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 17 10:59:18.751531 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.751508    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sqgzc\""
Jul 17 10:59:18.759965 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.759922    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"]
Jul 17 10:59:18.925704 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:18.925662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7da3a782-c728-4735-aac5-2ae4cc1cc31c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vbqp8\" (UID: \"7da3a782-c728-4735-aac5-2ae4cc1cc31c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:19.026371 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:19.026295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7da3a782-c728-4735-aac5-2ae4cc1cc31c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vbqp8\" (UID: \"7da3a782-c728-4735-aac5-2ae4cc1cc31c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:19.028920 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:19.028894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7da3a782-c728-4735-aac5-2ae4cc1cc31c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vbqp8\" (UID: \"7da3a782-c728-4735-aac5-2ae4cc1cc31c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:19.060009 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:19.059980    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:19.208784 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:19.208604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"]
Jul 17 10:59:19.211224 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:19.211195    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da3a782_c728_4735_aac5_2ae4cc1cc31c.slice/crio-bcf448b41ca139b16aad8c66713c01679db0b46f04d7fb623dea61bf8ee3dcf9 WatchSource:0}: Error finding container bcf448b41ca139b16aad8c66713c01679db0b46f04d7fb623dea61bf8ee3dcf9: Status 404 returned error can't find the container with id bcf448b41ca139b16aad8c66713c01679db0b46f04d7fb623dea61bf8ee3dcf9
Jul 17 10:59:20.127575 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:20.127536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7rkfb"
Jul 17 10:59:20.169230 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:20.169196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8" event={"ID":"7da3a782-c728-4735-aac5-2ae4cc1cc31c","Type":"ContainerStarted","Data":"bcf448b41ca139b16aad8c66713c01679db0b46f04d7fb623dea61bf8ee3dcf9"}
Jul 17 10:59:28.200120 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.200079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-nzmhn" event={"ID":"d27b3795-3fa6-4998-b579-c6968df9bbf4","Type":"ContainerStarted","Data":"6afc4bcabe39be2ea7258978e4704b0064ec3f12a29edb02ba77425602622078"}
Jul 17 10:59:28.200635 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.200271    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:28.202344 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.202311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8" event={"ID":"7da3a782-c728-4735-aac5-2ae4cc1cc31c","Type":"ContainerStarted","Data":"fdd17870cfd56fc1b06783ba8381c9935ef474a96c2636942e57d387c3df270c"}
Jul 17 10:59:28.202575 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.202557    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:28.207677 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.207655    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8"
Jul 17 10:59:28.218911 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.218883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-nzmhn"
Jul 17 10:59:28.225020 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.224976    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-nzmhn" podStartSLOduration=2.091447123 podStartE2EDuration="19.224963082s" totalImagesPullingTime="17.133515959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:28.224573706 +0000 UTC m=+122.982384148" watchObservedRunningTime="2026-07-17 10:59:28.224963082 +0000 UTC m=+122.982773500"
Jul 17 10:59:28.794462 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.794400    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vbqp8" podStartSLOduration=2.650577588 podStartE2EDuration="10.794376922s" totalImagesPullingTime="8.143799334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:28.275963488 +0000 UTC m=+123.033773905" watchObservedRunningTime="2026-07-17 10:59:28.794376922 +0000 UTC m=+123.552187341"
Jul 17 10:59:28.795121 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.795096    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"]
Jul 17 10:59:28.828369 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.828331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"]
Jul 17 10:59:28.828532 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.828477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:28.833152 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.833123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 17 10:59:28.833479 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.833458    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9c5hf\""
Jul 17 10:59:28.834204 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.834175    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 17 10:59:28.834325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.834177    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 10:59:28.834325 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.834179    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 10:59:28.834434 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:28.834351    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 10:59:29.007280 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.007239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/040d7e1f-e49e-4029-bb9a-0195400b9af8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.007474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.007348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xx7\" (UniqueName: \"kubernetes.io/projected/040d7e1f-e49e-4029-bb9a-0195400b9af8-kube-api-access-z7xx7\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.007474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.007396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/040d7e1f-e49e-4029-bb9a-0195400b9af8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.007474 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.007428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/040d7e1f-e49e-4029-bb9a-0195400b9af8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.108250 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.108160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/040d7e1f-e49e-4029-bb9a-0195400b9af8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.108250 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.108234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/040d7e1f-e49e-4029-bb9a-0195400b9af8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.108453 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.108296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xx7\" (UniqueName: \"kubernetes.io/projected/040d7e1f-e49e-4029-bb9a-0195400b9af8-kube-api-access-z7xx7\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.108453 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.108339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/040d7e1f-e49e-4029-bb9a-0195400b9af8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.109338 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.109310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/040d7e1f-e49e-4029-bb9a-0195400b9af8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.111427 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.111403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/040d7e1f-e49e-4029-bb9a-0195400b9af8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.111539 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.111426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/040d7e1f-e49e-4029-bb9a-0195400b9af8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.120931 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.120906    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xx7\" (UniqueName: \"kubernetes.io/projected/040d7e1f-e49e-4029-bb9a-0195400b9af8-kube-api-access-z7xx7\") pod \"prometheus-operator-5945b5cfd-jtpvw\" (UID: \"040d7e1f-e49e-4029-bb9a-0195400b9af8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.139410 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.139382    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"
Jul 17 10:59:29.302331 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:29.302294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw"]
Jul 17 10:59:29.306118 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:29.306090    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040d7e1f_e49e_4029_bb9a_0195400b9af8.slice/crio-9a89b6cf4406189426b24e7e84f9b35add0ea5499c52e214b302ee1b8d6a2811 WatchSource:0}: Error finding container 9a89b6cf4406189426b24e7e84f9b35add0ea5499c52e214b302ee1b8d6a2811: Status 404 returned error can't find the container with id 9a89b6cf4406189426b24e7e84f9b35add0ea5499c52e214b302ee1b8d6a2811
Jul 17 10:59:30.214079 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:30.213978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw" event={"ID":"040d7e1f-e49e-4029-bb9a-0195400b9af8","Type":"ContainerStarted","Data":"9a89b6cf4406189426b24e7e84f9b35add0ea5499c52e214b302ee1b8d6a2811"}
Jul 17 10:59:32.224508 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:32.224460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw" event={"ID":"040d7e1f-e49e-4029-bb9a-0195400b9af8","Type":"ContainerStarted","Data":"b1bbdd8ffcacf40a8f5d91dd477957527df04b4c25bbd9b8bcfacbb7dff29788"}
Jul 17 10:59:32.224963 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:32.224528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw" event={"ID":"040d7e1f-e49e-4029-bb9a-0195400b9af8","Type":"ContainerStarted","Data":"f5424062c146c9faa4436aae9e913da4351eafc49e778ecf1c080e4238b3c271"}
Jul 17 10:59:32.243377 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:32.242777    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jtpvw" podStartSLOduration=2.135352556 podStartE2EDuration="4.242757051s" totalImagesPullingTime="2.107404495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:32.241699466 +0000 UTC m=+126.999509924" watchObservedRunningTime="2026-07-17 10:59:32.242757051 +0000 UTC m=+127.000567473"
Jul 17 10:59:34.185828 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.185790    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hmpj2"]
Jul 17 10:59:34.235370 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.235339    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"]
Jul 17 10:59:34.235612 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.235480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.237770 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.237748    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 10:59:34.238549 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.238522    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tpqvh\""
Jul 17 10:59:34.238658 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.238529    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 10:59:34.238889 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.238867    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 10:59:34.250847 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.250820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-sys\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251007 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.250865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-tls\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251007 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.250900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251007 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.250951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-wtmp\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251007 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.250988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-textfile\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251007 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.251004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-accelerators-collector-config\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251249 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.251047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebdb5308-a8dd-42d4-859b-70d9df607b53-metrics-client-ca\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251249 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.251112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-root\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.251249 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.251149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv95k\" (UniqueName: \"kubernetes.io/projected/ebdb5308-a8dd-42d4-859b-70d9df607b53-kube-api-access-hv95k\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.259479 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.259452    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"]
Jul 17 10:59:34.259605 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.259585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.262455 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.262427    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 10:59:34.262637 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.262616    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 10:59:34.262721 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.262624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 10:59:34.263022 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.263000    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nkcpn\""
Jul 17 10:59:34.351924 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.351881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.352123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.351953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mps\" (UniqueName: \"kubernetes.io/projected/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-api-access-x9mps\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.352123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.351998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-textfile\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-accelerators-collector-config\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebdb5308-a8dd-42d4-859b-70d9df607b53-metrics-client-ca\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b21743-f1df-45b4-b93b-aaf800c4f379-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.352123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-root\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv95k\" (UniqueName: \"kubernetes.io/projected/ebdb5308-a8dd-42d4-859b-70d9df607b53-kube-api-access-hv95k\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-sys\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-tls\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-textfile\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-root\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/94b21743-f1df-45b4-b93b-aaf800c4f379-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-sys\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352409 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-wtmp\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352992 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:59:34.352420    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 10:59:34.352992 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:59:34.352540    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-tls podName:ebdb5308-a8dd-42d4-859b-70d9df607b53 nodeName:}" failed. No retries permitted until 2026-07-17 10:59:34.852524733 +0000 UTC m=+129.610335132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-tls") pod "node-exporter-hmpj2" (UID: "ebdb5308-a8dd-42d4-859b-70d9df607b53") : secret "node-exporter-tls" not found
Jul 17 10:59:34.352992 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-wtmp\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.352992 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.352628    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebdb5308-a8dd-42d4-859b-70d9df607b53-metrics-client-ca\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.353185 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.353027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-accelerators-collector-config\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.354930 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.354902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.364288 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.364261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv95k\" (UniqueName: \"kubernetes.io/projected/ebdb5308-a8dd-42d4-859b-70d9df607b53-kube-api-access-hv95k\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.453910 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.453831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b21743-f1df-45b4-b93b-aaf800c4f379-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.453910 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.453905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.454144 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.453976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.454144 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.454029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/94b21743-f1df-45b4-b93b-aaf800c4f379-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.454144 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:59:34.454054    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 17 10:59:34.454144 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.454071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.454144 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.454097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mps\" (UniqueName: \"kubernetes.io/projected/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-api-access-x9mps\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.454144 ip-10-0-131-118 kubenswrapper[2564]: E0717 10:59:34.454140    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-tls podName:94b21743-f1df-45b4-b93b-aaf800c4f379 nodeName:}" failed. No retries permitted until 2026-07-17 10:59:34.954120605 +0000 UTC m=+129.711931003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-bdc5k" (UID: "94b21743-f1df-45b4-b93b-aaf800c4f379") : secret "kube-state-metrics-tls" not found
Jul 17 10:59:34.454460 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.454435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/94b21743-f1df-45b4-b93b-aaf800c4f379-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.454754 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.454720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.455108 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.455084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94b21743-f1df-45b4-b93b-aaf800c4f379-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.457077 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.457052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.470039 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.470005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mps\" (UniqueName: \"kubernetes.io/projected/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-api-access-x9mps\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.864302 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.864200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-tls\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.866995 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.866959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebdb5308-a8dd-42d4-859b-70d9df607b53-node-exporter-tls\") pod \"node-exporter-hmpj2\" (UID: \"ebdb5308-a8dd-42d4-859b-70d9df607b53\") " pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:34.965478 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.965439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:34.968227 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:34.968196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94b21743-f1df-45b4-b93b-aaf800c4f379-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bdc5k\" (UID: \"94b21743-f1df-45b4-b93b-aaf800c4f379\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:35.147305 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.147269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hmpj2"
Jul 17 10:59:35.170652 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.170619    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"
Jul 17 10:59:35.187534 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:35.187498    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdb5308_a8dd_42d4_859b_70d9df607b53.slice/crio-3a584a32d69888c19db782d7697fc6ef235f5fc344c1c6e3e30ad1b385e377f4 WatchSource:0}: Error finding container 3a584a32d69888c19db782d7697fc6ef235f5fc344c1c6e3e30ad1b385e377f4: Status 404 returned error can't find the container with id 3a584a32d69888c19db782d7697fc6ef235f5fc344c1c6e3e30ad1b385e377f4
Jul 17 10:59:35.239331 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.239282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmpj2" event={"ID":"ebdb5308-a8dd-42d4-859b-70d9df607b53","Type":"ContainerStarted","Data":"3a584a32d69888c19db782d7697fc6ef235f5fc344c1c6e3e30ad1b385e377f4"}
Jul 17 10:59:35.360787 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.360679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-bdc5k"]
Jul 17 10:59:35.363815 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:35.363775    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b21743_f1df_45b4_b93b_aaf800c4f379.slice/crio-7855c5cbdb6bda42efbf79bba444b07095a71773749130ddc916887ef2a5ad09 WatchSource:0}: Error finding container 7855c5cbdb6bda42efbf79bba444b07095a71773749130ddc916887ef2a5ad09: Status 404 returned error can't find the container with id 7855c5cbdb6bda42efbf79bba444b07095a71773749130ddc916887ef2a5ad09
Jul 17 10:59:35.371261 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.371236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:59:35.374165 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.374116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ca34f9-7d5c-4c9e-bd52-d3a723698edf-metrics-certs\") pod \"network-metrics-daemon-7dzqr\" (UID: \"05ca34f9-7d5c-4c9e-bd52-d3a723698edf\") " pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:59:35.525143 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.525065    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m4ccj\""
Jul 17 10:59:35.533367 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.533342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dzqr"
Jul 17 10:59:35.715759 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:35.715727    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ca34f9_7d5c_4c9e_bd52_d3a723698edf.slice/crio-9c3e953cfd0343b9feab720236991aec22411591f262cfe2f1d19fd5179cc356 WatchSource:0}: Error finding container 9c3e953cfd0343b9feab720236991aec22411591f262cfe2f1d19fd5179cc356: Status 404 returned error can't find the container with id 9c3e953cfd0343b9feab720236991aec22411591f262cfe2f1d19fd5179cc356
Jul 17 10:59:35.715968 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:35.715815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dzqr"]
Jul 17 10:59:36.245597 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:36.245555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k" event={"ID":"94b21743-f1df-45b4-b93b-aaf800c4f379","Type":"ContainerStarted","Data":"7855c5cbdb6bda42efbf79bba444b07095a71773749130ddc916887ef2a5ad09"}
Jul 17 10:59:36.247080 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:36.247027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dzqr" event={"ID":"05ca34f9-7d5c-4c9e-bd52-d3a723698edf","Type":"ContainerStarted","Data":"9c3e953cfd0343b9feab720236991aec22411591f262cfe2f1d19fd5179cc356"}
Jul 17 10:59:37.252924 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:37.252844    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmpj2" event={"ID":"ebdb5308-a8dd-42d4-859b-70d9df607b53","Type":"ContainerStarted","Data":"7b29732c52fefda7ce6299ec3897e18f48148eaef810a01040f6e907a3e43d69"}
Jul 17 10:59:38.259003 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.258963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k" event={"ID":"94b21743-f1df-45b4-b93b-aaf800c4f379","Type":"ContainerStarted","Data":"047259361d45ae0b6c4303413d692f2441fda2cca09ca3e9522c8647e9fc6e27"}
Jul 17 10:59:38.259477 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.259072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k" event={"ID":"94b21743-f1df-45b4-b93b-aaf800c4f379","Type":"ContainerStarted","Data":"53275383fc6e3a18bf89161fefdb28803c9af62ea6e2e37f62b9ee72a2ffcecb"}
Jul 17 10:59:38.259477 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.259107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k" event={"ID":"94b21743-f1df-45b4-b93b-aaf800c4f379","Type":"ContainerStarted","Data":"4669beaece18b0f2b63db4cd8bbdefdfbf62ff29aee0bfe40e7401aad7c0b4ec"}
Jul 17 10:59:38.260466 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.260440    2564 generic.go:356] "Generic (PLEG): container finished" podID="ebdb5308-a8dd-42d4-859b-70d9df607b53" containerID="7b29732c52fefda7ce6299ec3897e18f48148eaef810a01040f6e907a3e43d69" exitCode=0
Jul 17 10:59:38.260596 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.260517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmpj2" event={"ID":"ebdb5308-a8dd-42d4-859b-70d9df607b53","Type":"ContainerDied","Data":"7b29732c52fefda7ce6299ec3897e18f48148eaef810a01040f6e907a3e43d69"}
Jul 17 10:59:38.262414 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.262385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dzqr" event={"ID":"05ca34f9-7d5c-4c9e-bd52-d3a723698edf","Type":"ContainerStarted","Data":"e13f7a0188339478d5c534c47ca98a8b377600a16e17f51b154c1d7eba5a795c"}
Jul 17 10:59:38.262536 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.262436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dzqr" event={"ID":"05ca34f9-7d5c-4c9e-bd52-d3a723698edf","Type":"ContainerStarted","Data":"d85a1ec93d7eceb3ecc8ca26c4ec861cb635f3d7d2e9cf16437251a013e9ef45"}
Jul 17 10:59:38.280776 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.280717    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-bdc5k" podStartSLOduration=1.813150415 podStartE2EDuration="4.280700016s" totalImagesPullingTime="2.467549601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:38.279655526 +0000 UTC m=+133.037465964" watchObservedRunningTime="2026-07-17 10:59:38.280700016 +0000 UTC m=+133.038510436"
Jul 17 10:59:38.327008 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:38.326956    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7dzqr" podStartSLOduration=131.509314949 podStartE2EDuration="2m13.326917098s" totalImagesPullingTime="1.817602149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:38.325210438 +0000 UTC m=+133.083020875" watchObservedRunningTime="2026-07-17 10:59:38.326917098 +0000 UTC m=+133.084727519"
Jul 17 10:59:39.268427 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:39.268390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmpj2" event={"ID":"ebdb5308-a8dd-42d4-859b-70d9df607b53","Type":"ContainerStarted","Data":"92de2e336c8daf436f83850252fbd372dd70312f19d63f4c68e6200c40021014"}
Jul 17 10:59:39.269020 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:39.268448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hmpj2" event={"ID":"ebdb5308-a8dd-42d4-859b-70d9df607b53","Type":"ContainerStarted","Data":"a1123ad55b952378665b5b969ffa0c213083df445b05206aba39817ba312c093"}
Jul 17 10:59:39.293467 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:39.293421    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hmpj2" podStartSLOduration=3.493615061 podStartE2EDuration="5.293407284s" totalImagesPullingTime="1.715711501s" totalInitContainerRuntime="84.080722ms" isStatefulPod=true podCreationTimestamp="2026-07-17 10:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:39.291433106 +0000 UTC m=+134.049243547" watchObservedRunningTime="2026-07-17 10:59:39.293407284 +0000 UTC m=+134.051217702"
Jul 17 10:59:40.456874 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.456844    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:59:40.480837 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.480809    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:59:40.481080 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.480953    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.483869 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.483846    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 10:59:40.484123 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.484102    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 10:59:40.484241 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.484220    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 10:59:40.484405 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.484388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 10:59:40.485065 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.485042    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 10:59:40.485189 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.485055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 10:59:40.485595 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.485578    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 10:59:40.485870 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.485697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1mg00es4mriq1\""
Jul 17 10:59:40.485870 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.485790    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 10:59:40.486799 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.486771    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 10:59:40.489176 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.489152    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 10:59:40.489579 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.489559    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 10:59:40.492429 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.492406    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 10:59:40.493369 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.493343    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 10:59:40.493716 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.493694    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hw96s\""
Jul 17 10:59:40.507705 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.507678    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 10:59:40.510509 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.510489    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 10:59:40.511186 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-config\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511250 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511250 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-config-out\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511336 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511336 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511336 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511336 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511454 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511454 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511511 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511511 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511511 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-web-config\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511653 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mj2\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-kube-api-access-d9mj2\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511826 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.511826 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.511674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613115 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613115 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mj2\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-kube-api-access-d9mj2\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613115 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-config\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-config-out\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613432 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-web-config\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.613982 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.613625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.614698 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.614673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.615134 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.615092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.615488 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.615452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.615582 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.615497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.615856 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.615831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.616078 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.616054    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.616505 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.616474    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.618137 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.618112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.618231 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.618155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-config\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.618231 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.618205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.618528 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.618505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.618737 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.618715    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.618886 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.618861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-config-out\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.620095 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.620073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.620830 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.620760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-web-config\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.620830 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.620762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.621055 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.621034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.621187 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.621163    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.621187 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.621177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.626612 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.626589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mj2\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-kube-api-access-d9mj2\") pod \"prometheus-k8s-0\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.810823 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.810752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 10:59:40.970469 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:40.970421    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 10:59:40.973208 ip-10-0-131-118 kubenswrapper[2564]: W0717 10:59:40.973178    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f9925a_3772_4f9d_8555_a1e0de1478c9.slice/crio-bdbcb189055a232193a682337a40815f8f41779eaf07f95a18fd749dcaef52c8 WatchSource:0}: Error finding container bdbcb189055a232193a682337a40815f8f41779eaf07f95a18fd749dcaef52c8: Status 404 returned error can't find the container with id bdbcb189055a232193a682337a40815f8f41779eaf07f95a18fd749dcaef52c8
Jul 17 10:59:41.278324 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:41.278289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"bdbcb189055a232193a682337a40815f8f41779eaf07f95a18fd749dcaef52c8"}
Jul 17 10:59:43.292155 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:43.292113    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d" exitCode=0
Jul 17 10:59:43.292575 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:43.292199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"}
Jul 17 10:59:47.313451 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:47.313378    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"}
Jul 17 10:59:47.313817 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:47.313471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"}
Jul 17 10:59:49.324597 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:49.324567    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"}
Jul 17 10:59:50.331535 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:50.331498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"}
Jul 17 10:59:50.332118 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:50.331574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"}
Jul 17 10:59:50.332118 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:50.331615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerStarted","Data":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"}
Jul 17 10:59:50.811540 ip-10-0-131-118 kubenswrapper[2564]: I0717 10:59:50.811507    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:02.377343 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:02.377307    2564 generic.go:356] "Generic (PLEG): container finished" podID="33c3ec98-d7b6-4384-af89-c4f515b6b856" containerID="7de5d4e08dfbf2d249bff16e709f77d0e94d92e71a922e4e5ca3bbfe4340d1b7" exitCode=0
Jul 17 11:00:02.377712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:02.377381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tx8mp" event={"ID":"33c3ec98-d7b6-4384-af89-c4f515b6b856","Type":"ContainerDied","Data":"7de5d4e08dfbf2d249bff16e709f77d0e94d92e71a922e4e5ca3bbfe4340d1b7"}
Jul 17 11:00:02.377712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:02.377685    2564 scope.go:117] "RemoveContainer" containerID="7de5d4e08dfbf2d249bff16e709f77d0e94d92e71a922e4e5ca3bbfe4340d1b7"
Jul 17 11:00:02.397320 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:02.397272    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=15.270048859 podStartE2EDuration="22.397253304s" totalImagesPullingTime="7.105789731s" totalInitContainerRuntime="21.414714ms" isStatefulPod=false podCreationTimestamp="2026-07-17 10:59:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:59:50.366438628 +0000 UTC m=+145.124249046" watchObservedRunningTime="2026-07-17 11:00:02.397253304 +0000 UTC m=+157.155063722"
Jul 17 11:00:03.383376 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:03.383343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tx8mp" event={"ID":"33c3ec98-d7b6-4384-af89-c4f515b6b856","Type":"ContainerStarted","Data":"a3bc7b63af5d8af2936dd487c61d10053a6dc3c679bafe24fda776b8ebc99b34"}
Jul 17 11:00:06.395816 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:06.395781    2564 generic.go:356] "Generic (PLEG): container finished" podID="829ad259-4110-4f31-ae45-6a7da8540a3b" containerID="bcd93200d5c713ae9cc5f87ad2f93bfe3da931d06589fc0549233e055242ce64" exitCode=0
Jul 17 11:00:06.396242 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:06.395831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2" event={"ID":"829ad259-4110-4f31-ae45-6a7da8540a3b","Type":"ContainerDied","Data":"bcd93200d5c713ae9cc5f87ad2f93bfe3da931d06589fc0549233e055242ce64"}
Jul 17 11:00:06.396242 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:06.396170    2564 scope.go:117] "RemoveContainer" containerID="bcd93200d5c713ae9cc5f87ad2f93bfe3da931d06589fc0549233e055242ce64"
Jul 17 11:00:07.401679 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:07.401641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9nzf2" event={"ID":"829ad259-4110-4f31-ae45-6a7da8540a3b","Type":"ContainerStarted","Data":"bc461002e557652c2713a2d90e1555edb9949abaf5005dcc048bf382d8f1d2de"}
Jul 17 11:00:40.811468 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:40.811426    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:40.826692 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:40.826663    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:41.541654 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:41.541626    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.009024 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.008989    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 11:00:59.009517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.009292    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="prometheus" containerID="cri-o://573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08" gracePeriod=600
Jul 17 11:00:59.009517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.009300    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy" containerID="cri-o://2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83" gracePeriod=600
Jul 17 11:00:59.009517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.009335    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="thanos-sidecar" containerID="cri-o://784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df" gracePeriod=600
Jul 17 11:00:59.009517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.009394    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455" gracePeriod=600
Jul 17 11:00:59.009517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.009455    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-web" containerID="cri-o://55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955" gracePeriod=600
Jul 17 11:00:59.009517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.009401    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="config-reloader" containerID="cri-o://9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36" gracePeriod=600
Jul 17 11:00:59.252337 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.252309    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.290250 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-grpc-tls\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290250 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290226    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-1\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290261    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-config\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290317    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-tls-assets\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290354    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-trusted-ca-bundle\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-kubelet-serving-ca-bundle\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290864 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9mj2\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-kube-api-access-d9mj2\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.290864 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290847    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-tls\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291042 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-0\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291042 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290926    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-thanos-prometheus-http-client-file\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291042 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.290981    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-web-config\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291042 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291011    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-metrics-client-certs\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291049    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-2\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291068    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.291287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-metrics-client-ca\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291186    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291230    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-db\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291259    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-kube-rbac-proxy\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.291582 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291218    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.291582 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291357    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.291694 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.291614    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.294037 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.294004    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:00:59.294669 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.294646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-config" (OuterVolumeSpecName: "config") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.295624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.295002    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-kube-api-access-d9mj2" (OuterVolumeSpecName: "kube-api-access-d9mj2") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "kube-api-access-d9mj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:00:59.296525 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.295045    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.296635 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.295141    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-config-out\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.296755 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.296739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-serving-certs-ca-bundle\") pod \"87f9925a-3772-4f9d-8555-a1e0de1478c9\" (UID: \"87f9925a-3772-4f9d-8555-a1e0de1478c9\") "
Jul 17 11:00:59.298372 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.297316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.298372 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.297416    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:00:59.298372 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.297813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:00:59.298972 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.298951    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299105 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299091    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-metrics-client-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299198 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299183    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-db\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299283 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299271    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299372 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299361    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299446 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299435    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-config\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299562 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299548    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-tls-assets\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299657 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299645    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299747 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299735    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299827 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299815    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9mj2\" (UniqueName: \"kubernetes.io/projected/87f9925a-3772-4f9d-8555-a1e0de1478c9-kube-api-access-d9mj2\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.299907 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.299894    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/87f9925a-3772-4f9d-8555-a1e0de1478c9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.303593 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.303152    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.303593 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.303224    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.305282 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.305257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.305719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.305666    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.306188 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.306158    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.307033 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.307000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-config-out" (OuterVolumeSpecName: "config-out") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:00:59.307239 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.307210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.307330 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.307268    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.318717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.317905    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-web-config" (OuterVolumeSpecName: "web-config") pod "87f9925a-3772-4f9d-8555-a1e0de1478c9" (UID: "87f9925a-3772-4f9d-8555-a1e0de1478c9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:00:59.400383 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400357    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400383 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400381    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-kube-rbac-proxy\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400394    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87f9925a-3772-4f9d-8555-a1e0de1478c9-config-out\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400402    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-grpc-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400418    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400428    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400437    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400446    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-web-config\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.400529 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.400454    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/87f9925a-3772-4f9d-8555-a1e0de1478c9-secret-metrics-client-certs\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:00:59.600245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600168    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455" exitCode=0
Jul 17 11:00:59.600245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600199    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83" exitCode=0
Jul 17 11:00:59.600245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600209    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955" exitCode=0
Jul 17 11:00:59.600245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600217    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df" exitCode=0
Jul 17 11:00:59.600245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600227    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36" exitCode=0
Jul 17 11:00:59.600245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600236    2564 generic.go:356] "Generic (PLEG): container finished" podID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08" exitCode=0
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"}
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600275    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"}
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"}
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"}
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600425    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"}
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600461    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"}
Jul 17 11:00:59.600501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.600484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"87f9925a-3772-4f9d-8555-a1e0de1478c9","Type":"ContainerDied","Data":"bdbcb189055a232193a682337a40815f8f41779eaf07f95a18fd749dcaef52c8"}
Jul 17 11:00:59.609582 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.609558    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.616287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.616271    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.622450 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.622435    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.626498 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.626477    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 11:00:59.629999 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.629977    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.631142 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.631126    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 11:00:59.636385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.636367    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.643209 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.643193    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.651712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.651696    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.651981 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.651964    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.652037 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.651988    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"} err="failed to get container status \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist"
Jul 17 11:00:59.652037 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652019    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.652226 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.652212    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.652264 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652230    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"} err="failed to get container status \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist"
Jul 17 11:00:59.652264 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652248    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.652459 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.652435    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.652550 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652462    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"} err="failed to get container status \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist"
Jul 17 11:00:59.652550 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652478    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.652678 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.652663    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.652718 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652681    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"} err="failed to get container status \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist"
Jul 17 11:00:59.652718 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652694    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.652897 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.652879    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.653090 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652905    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"} err="failed to get container status \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist"
Jul 17 11:00:59.653090 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.652926    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.653230 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.653213    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.653288 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653233    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"} err="failed to get container status \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist"
Jul 17 11:00:59.653288 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653245    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.653429 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:00:59.653409    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.653461 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653434    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"} err="failed to get container status \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist"
Jul 17 11:00:59.653461 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653447    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.653629 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653615    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"} err="failed to get container status \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist"
Jul 17 11:00:59.653665 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653630    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.653814 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653797    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"} err="failed to get container status \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist"
Jul 17 11:00:59.653856 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.653815    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.654025 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654007    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"} err="failed to get container status \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist"
Jul 17 11:00:59.654065 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654027    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.654231 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654212    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"} err="failed to get container status \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist"
Jul 17 11:00:59.654298 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654234    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.654450 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654436    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"} err="failed to get container status \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist"
Jul 17 11:00:59.654495 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654450    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.654623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654605    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"} err="failed to get container status \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist"
Jul 17 11:00:59.654664 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654624    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.654804 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654789    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"} err="failed to get container status \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist"
Jul 17 11:00:59.654873 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.654806    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.655032 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655014    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"} err="failed to get container status \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist"
Jul 17 11:00:59.655075 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655032    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.655229 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655214    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"} err="failed to get container status \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist"
Jul 17 11:00:59.655267 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655229    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.655445 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655426    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"} err="failed to get container status \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist"
Jul 17 11:00:59.655493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655446    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.655668 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655647    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"} err="failed to get container status \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist"
Jul 17 11:00:59.655668 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655666    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.655850 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655833    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"} err="failed to get container status \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist"
Jul 17 11:00:59.655897 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.655851    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.656106 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656085    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"} err="failed to get container status \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist"
Jul 17 11:00:59.656168 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656106    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.656313 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656298    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"} err="failed to get container status \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist"
Jul 17 11:00:59.656369 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656313    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.656635 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656489    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"} err="failed to get container status \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist"
Jul 17 11:00:59.656635 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656631    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.657030 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.656958    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"} err="failed to get container status \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist"
Jul 17 11:00:59.657030 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657025    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.657301 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657280    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"} err="failed to get container status \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist"
Jul 17 11:00:59.657382 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657303    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.657559 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657536    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"} err="failed to get container status \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist"
Jul 17 11:00:59.657559 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657562    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.657821 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657792    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"} err="failed to get container status \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist"
Jul 17 11:00:59.657895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.657824    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.658084 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658064    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"} err="failed to get container status \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist"
Jul 17 11:00:59.658158 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658086    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.658419 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658397    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"} err="failed to get container status \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist"
Jul 17 11:00:59.658512 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658421    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.658724 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658703    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"} err="failed to get container status \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist"
Jul 17 11:00:59.658775 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658724    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.658925 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658909    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 11:00:59.658990 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658932    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"} err="failed to get container status \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist"
Jul 17 11:00:59.658990 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.658968    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.659197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659175    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-web"
Jul 17 11:00:59.659197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659191    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-web"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659205    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-thanos"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659213    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-thanos"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659215    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"} err="failed to get container status \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659227    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="thanos-sidecar"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659232    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="thanos-sidecar"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659240    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659245    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659252    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="config-reloader"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659258    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="config-reloader"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659272    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="prometheus"
Jul 17 11:00:59.659278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659278    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="prometheus"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659284    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="init-config-reloader"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659289    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="init-config-reloader"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659232    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659337    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-thanos"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659350    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy-web"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659356    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="config-reloader"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659362    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="prometheus"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659368    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="thanos-sidecar"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659375    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" containerName="kube-rbac-proxy"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659498    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"} err="failed to get container status \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist"
Jul 17 11:00:59.659646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659513    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.660040 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659740    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"} err="failed to get container status \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist"
Jul 17 11:00:59.660040 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659756    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.660040 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659970    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"} err="failed to get container status \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist"
Jul 17 11:00:59.660040 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.659984    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.660220 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660164    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"} err="failed to get container status \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist"
Jul 17 11:00:59.660220 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660187    2564 scope.go:117] "RemoveContainer" containerID="4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"
Jul 17 11:00:59.660430 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660401    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455"} err="failed to get container status \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": rpc error: code = NotFound desc = could not find container \"4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455\": container with ID starting with 4ea77a838066cef16048bb9524f98ee8057f58cd7587d25e818ba4fe36dbb455 not found: ID does not exist"
Jul 17 11:00:59.660499 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660430    2564 scope.go:117] "RemoveContainer" containerID="2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"
Jul 17 11:00:59.660651 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660630    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83"} err="failed to get container status \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": rpc error: code = NotFound desc = could not find container \"2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83\": container with ID starting with 2f7c7149063255311a6ed0806efda0a726f85a94e73c9e928ba3340636309c83 not found: ID does not exist"
Jul 17 11:00:59.660722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660652    2564 scope.go:117] "RemoveContainer" containerID="55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"
Jul 17 11:00:59.660868 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660850    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955"} err="failed to get container status \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": rpc error: code = NotFound desc = could not find container \"55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955\": container with ID starting with 55ba3c8ea9e10134123f8aaffc7558e1e25794413bbdeb321c278f9810844955 not found: ID does not exist"
Jul 17 11:00:59.660918 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.660869    2564 scope.go:117] "RemoveContainer" containerID="784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"
Jul 17 11:00:59.661075 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661059    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df"} err="failed to get container status \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": rpc error: code = NotFound desc = could not find container \"784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df\": container with ID starting with 784e6c60e09605eb499087d9410f5b521bcc6a92cd445133f48ce217822c86df not found: ID does not exist"
Jul 17 11:00:59.661118 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661074    2564 scope.go:117] "RemoveContainer" containerID="9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"
Jul 17 11:00:59.661265 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661247    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36"} err="failed to get container status \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": rpc error: code = NotFound desc = could not find container \"9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36\": container with ID starting with 9b6a57b87247d55d6511a6e844dee1580f5d0a96321e7ce59af0cf8405731e36 not found: ID does not exist"
Jul 17 11:00:59.661321 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661265    2564 scope.go:117] "RemoveContainer" containerID="573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"
Jul 17 11:00:59.661446 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661431    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08"} err="failed to get container status \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": rpc error: code = NotFound desc = could not find container \"573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08\": container with ID starting with 573e40acf980778a874abd4ce61060503db00dff38715b7011fe329e70334e08 not found: ID does not exist"
Jul 17 11:00:59.661499 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661447    2564 scope.go:117] "RemoveContainer" containerID="02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"
Jul 17 11:00:59.661650 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.661633    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d"} err="failed to get container status \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": rpc error: code = NotFound desc = could not find container \"02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d\": container with ID starting with 02b16f92bdaed7d63faa47f288f81e30bd0b0bc78db0a13be26d2bf97b63422d not found: ID does not exist"
Jul 17 11:00:59.663385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.663365    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.665871 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.665851    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hw96s\""
Jul 17 11:00:59.666005 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.665983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 11:00:59.666103 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 11:00:59.666103 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666030    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 11:00:59.666103 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666077    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 11:00:59.666285 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666027    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 11:00:59.666285 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666122    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 11:00:59.666401 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666336    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 11:00:59.666401 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666338    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 11:00:59.666609 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666413    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1mg00es4mriq1\""
Jul 17 11:00:59.666609 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666482    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 11:00:59.666701 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 11:00:59.666701 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666651    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 11:00:59.666701 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666677    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 11:00:59.666802 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.666677    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 11:00:59.670209 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.670184    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 11:00:59.672837 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.672815    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 11:00:59.681923 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.681897    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 11:00:59.702658 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-web-config\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702752 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702752 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zcm\" (UniqueName: \"kubernetes.io/projected/5981c9b4-646d-41ff-a139-18e2d1dc5da9-kube-api-access-79zcm\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702752 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702752 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5981c9b4-646d-41ff-a139-18e2d1dc5da9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.702895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.702977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5981c9b4-646d-41ff-a139-18e2d1dc5da9-config-out\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703309 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-config\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703309 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.703309 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.703142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.714815 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.714788    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f9925a-3772-4f9d-8555-a1e0de1478c9" path="/var/lib/kubelet/pods/87f9925a-3772-4f9d-8555-a1e0de1478c9/volumes"
Jul 17 11:00:59.804159 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-config\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-web-config\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zcm\" (UniqueName: \"kubernetes.io/projected/5981c9b4-646d-41ff-a139-18e2d1dc5da9-kube-api-access-79zcm\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5981c9b4-646d-41ff-a139-18e2d1dc5da9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5981c9b4-646d-41ff-a139-18e2d1dc5da9-config-out\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.804901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.805282 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.804948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.806083 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.806056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.806191 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.806097    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.807238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.807601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.808320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-config\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.808508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.808573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.808691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.808821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.808930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.809623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.809190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.810154 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.810022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.810346 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.810325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.810439 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.810362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.810526 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.810510    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5981c9b4-646d-41ff-a139-18e2d1dc5da9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.811116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.811096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5981c9b4-646d-41ff-a139-18e2d1dc5da9-config-out\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.811279 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.811265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5981c9b4-646d-41ff-a139-18e2d1dc5da9-web-config\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.811340 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.811319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5981c9b4-646d-41ff-a139-18e2d1dc5da9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.815489 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.815468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zcm\" (UniqueName: \"kubernetes.io/projected/5981c9b4-646d-41ff-a139-18e2d1dc5da9-kube-api-access-79zcm\") pod \"prometheus-k8s-0\" (UID: \"5981c9b4-646d-41ff-a139-18e2d1dc5da9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:00:59.972848 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:00:59.972823    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:01:00.106727 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:00.106695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 11:01:00.109100 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:01:00.109073    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5981c9b4_646d_41ff_a139_18e2d1dc5da9.slice/crio-073242e19ea799888f1542743cb389d6b991ed6d8f59a47720c41bed31ca4ca4 WatchSource:0}: Error finding container 073242e19ea799888f1542743cb389d6b991ed6d8f59a47720c41bed31ca4ca4: Status 404 returned error can't find the container with id 073242e19ea799888f1542743cb389d6b991ed6d8f59a47720c41bed31ca4ca4
Jul 17 11:01:00.605094 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:00.605063    2564 generic.go:356] "Generic (PLEG): container finished" podID="5981c9b4-646d-41ff-a139-18e2d1dc5da9" containerID="30247be0b385a1d56123ad358c63cf732a5dc19b46b0fa8e1a2414a3c3b272df" exitCode=0
Jul 17 11:01:00.605221 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:00.605125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerDied","Data":"30247be0b385a1d56123ad358c63cf732a5dc19b46b0fa8e1a2414a3c3b272df"}
Jul 17 11:01:00.605221 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:00.605199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"073242e19ea799888f1542743cb389d6b991ed6d8f59a47720c41bed31ca4ca4"}
Jul 17 11:01:01.612714 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.612680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"a8b88511625dce28be5e0e33962fc3c89d07920a42cfb93e9aab3dbb81e21311"}
Jul 17 11:01:01.613176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.612779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"9a3c9c348f754d92239b807e2f8e9dd8aeb175d883760e853db30ea2cb985bbd"}
Jul 17 11:01:01.613176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.612821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"0707bddc9fd4b7f8b4e721c618989d10a2acf302e980c22d70b38ef7984c400a"}
Jul 17 11:01:01.613176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.612852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"2144f1a462e6cdc343a6e317f6342ab92a021a24ad034f7aa382c7a17db283b2"}
Jul 17 11:01:01.613176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.612881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"20050b3129b014354e7b22dd909d6e1ae8ce865c1534fd19f4d8b76f3a2e849c"}
Jul 17 11:01:01.613176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.612919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5981c9b4-646d-41ff-a139-18e2d1dc5da9","Type":"ContainerStarted","Data":"26e173af48896f12e60e77e207bf5dd106f118dd3949be06061aa1113e7ca775"}
Jul 17 11:01:01.641775 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:01.641710    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.61930342 podStartE2EDuration="2.641694365s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.390945ms" isStatefulPod=false podCreationTimestamp="2026-07-17 11:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:01.640295266 +0000 UTC m=+216.398105684" watchObservedRunningTime="2026-07-17 11:01:01.641694365 +0000 UTC m=+216.399504786"
Jul 17 11:01:04.973651 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:04.973620    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:01:59.974031 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:59.973929    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:01:59.988897 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:01:59.988873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:02:00.841521 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:00.841492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 11:02:25.592982 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:25.592951    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 11:02:27.089633 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.089598    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nwvhv"]
Jul 17 11:02:27.092788 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.092771    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.096157 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.096127    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 11:02:27.096157 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.096127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w8nsd\""
Jul 17 11:02:27.097032 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.097018    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 11:02:27.106729 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.106707    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nwvhv"]
Jul 17 11:02:27.134393 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.134370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b838f43-3a0a-4650-a1d6-ed400f5f7cbf-bound-sa-token\") pod \"cert-manager-55b4d954d5-nwvhv\" (UID: \"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf\") " pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.134490 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.134406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj8vc\" (UniqueName: \"kubernetes.io/projected/1b838f43-3a0a-4650-a1d6-ed400f5f7cbf-kube-api-access-qj8vc\") pod \"cert-manager-55b4d954d5-nwvhv\" (UID: \"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf\") " pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.235330 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.235306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b838f43-3a0a-4650-a1d6-ed400f5f7cbf-bound-sa-token\") pod \"cert-manager-55b4d954d5-nwvhv\" (UID: \"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf\") " pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.235397 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.235335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj8vc\" (UniqueName: \"kubernetes.io/projected/1b838f43-3a0a-4650-a1d6-ed400f5f7cbf-kube-api-access-qj8vc\") pod \"cert-manager-55b4d954d5-nwvhv\" (UID: \"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf\") " pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.245395 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.245378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj8vc\" (UniqueName: \"kubernetes.io/projected/1b838f43-3a0a-4650-a1d6-ed400f5f7cbf-kube-api-access-qj8vc\") pod \"cert-manager-55b4d954d5-nwvhv\" (UID: \"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf\") " pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.245457 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.245400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b838f43-3a0a-4650-a1d6-ed400f5f7cbf-bound-sa-token\") pod \"cert-manager-55b4d954d5-nwvhv\" (UID: \"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf\") " pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.409696 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.409670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nwvhv"
Jul 17 11:02:27.537620 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.537582    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nwvhv"]
Jul 17 11:02:27.540508 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:02:27.540483    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b838f43_3a0a_4650_a1d6_ed400f5f7cbf.slice/crio-17f1db16de02014ad32a86a44ff020bfeaea02e1eca3d25ef1aca3be3ab712f2 WatchSource:0}: Error finding container 17f1db16de02014ad32a86a44ff020bfeaea02e1eca3d25ef1aca3be3ab712f2: Status 404 returned error can't find the container with id 17f1db16de02014ad32a86a44ff020bfeaea02e1eca3d25ef1aca3be3ab712f2
Jul 17 11:02:27.542353 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.542337    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:02:27.923950 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:27.923898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nwvhv" event={"ID":"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf","Type":"ContainerStarted","Data":"17f1db16de02014ad32a86a44ff020bfeaea02e1eca3d25ef1aca3be3ab712f2"}
Jul 17 11:02:30.939451 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:30.939366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nwvhv" event={"ID":"1b838f43-3a0a-4650-a1d6-ed400f5f7cbf","Type":"ContainerStarted","Data":"bfc0452086a5741f61eec17a4514b489465b861381206b34c4f1e2171ad0db6a"}
Jul 17 11:02:30.959008 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:30.958964    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nwvhv" podStartSLOduration=0.83043141 podStartE2EDuration="3.95893256s" totalImagesPullingTime="3.12850115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:02:30.957671044 +0000 UTC m=+305.715481481" watchObservedRunningTime="2026-07-17 11:02:30.95893256 +0000 UTC m=+305.716742975"
Jul 17 11:02:49.084830 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.084789    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"]
Jul 17 11:02:49.088089 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.088071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.098073 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.098050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 11:02:49.098241 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.098228    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hx8rl\""
Jul 17 11:02:49.099223 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.099206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 11:02:49.099281 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.099218    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 11:02:49.101019 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.101001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 11:02:49.122592 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.122560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"]
Jul 17 11:02:49.225473 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.225421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb09e448-18d1-42fc-9d77-84f98476317e-tmp\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.225473 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.225473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb09e448-18d1-42fc-9d77-84f98476317e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.225696 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.225609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvvl\" (UniqueName: \"kubernetes.io/projected/fb09e448-18d1-42fc-9d77-84f98476317e-kube-api-access-szvvl\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.225696 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.225656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb09e448-18d1-42fc-9d77-84f98476317e-manifests\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.225768 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.225700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb09e448-18d1-42fc-9d77-84f98476317e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.326379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.326329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvvl\" (UniqueName: \"kubernetes.io/projected/fb09e448-18d1-42fc-9d77-84f98476317e-kube-api-access-szvvl\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.326569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.326389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb09e448-18d1-42fc-9d77-84f98476317e-manifests\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.326569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.326418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb09e448-18d1-42fc-9d77-84f98476317e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.326569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.326443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb09e448-18d1-42fc-9d77-84f98476317e-tmp\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.326569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.326460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb09e448-18d1-42fc-9d77-84f98476317e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.326917 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.326890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb09e448-18d1-42fc-9d77-84f98476317e-manifests\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.328879 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.328843    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb09e448-18d1-42fc-9d77-84f98476317e-tmp\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.329130 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.329106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb09e448-18d1-42fc-9d77-84f98476317e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.329197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.329135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb09e448-18d1-42fc-9d77-84f98476317e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.340673 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.340583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvvl\" (UniqueName: \"kubernetes.io/projected/fb09e448-18d1-42fc-9d77-84f98476317e-kube-api-access-szvvl\") pod \"opendatahub-operator-controller-manager-6cd97f7fc7-htl45\" (UID: \"fb09e448-18d1-42fc-9d77-84f98476317e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.398453 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.398405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:49.573214 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:49.573191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"]
Jul 17 11:02:49.575790 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:02:49.575764    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb09e448_18d1_42fc_9d77_84f98476317e.slice/crio-162643b5e00d9cce6bf701d441031692236e148f28d7e9a84994d83c8ca3cb0b WatchSource:0}: Error finding container 162643b5e00d9cce6bf701d441031692236e148f28d7e9a84994d83c8ca3cb0b: Status 404 returned error can't find the container with id 162643b5e00d9cce6bf701d441031692236e148f28d7e9a84994d83c8ca3cb0b
Jul 17 11:02:50.016833 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:50.016793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45" event={"ID":"fb09e448-18d1-42fc-9d77-84f98476317e","Type":"ContainerStarted","Data":"162643b5e00d9cce6bf701d441031692236e148f28d7e9a84994d83c8ca3cb0b"}
Jul 17 11:02:53.033959 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:53.033912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45" event={"ID":"fb09e448-18d1-42fc-9d77-84f98476317e","Type":"ContainerStarted","Data":"c4bf875128878a60f353308992cd1c4cbe9a304c435dc8e40b2e05b60bdffba6"}
Jul 17 11:02:54.039154 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:54.039119    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb09e448-18d1-42fc-9d77-84f98476317e" containerID="c4bf875128878a60f353308992cd1c4cbe9a304c435dc8e40b2e05b60bdffba6" exitCode=0
Jul 17 11:02:54.039500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:54.039175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45" event={"ID":"fb09e448-18d1-42fc-9d77-84f98476317e","Type":"ContainerDied","Data":"c4bf875128878a60f353308992cd1c4cbe9a304c435dc8e40b2e05b60bdffba6"}
Jul 17 11:02:55.045498 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:55.045468    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45" event={"ID":"fb09e448-18d1-42fc-9d77-84f98476317e","Type":"ContainerStarted","Data":"39b8b02d50dbdeec074b191b6bf2ce926765bc47f868e59079b62708e4f7aff9"}
Jul 17 11:02:55.045930 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:55.045580    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:02:55.069838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:02:55.069793    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45" podStartSLOduration=1.671396895 podStartE2EDuration="6.069778765s" totalImagesPullingTime="3.360097386s" totalInitContainerRuntime="1.038284484s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:02:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:02:55.067993741 +0000 UTC m=+329.825804161" watchObservedRunningTime="2026-07-17 11:02:55.069778765 +0000 UTC m=+329.827589183"
Jul 17 11:03:06.051799 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:06.051768    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cd97f7fc7-htl45"
Jul 17 11:03:10.567035 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.567005    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"]
Jul 17 11:03:10.583212 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.583187    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.587059 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.587034    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 11:03:10.587198 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.587182    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 11:03:10.587333 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.587314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 11:03:10.587485 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.587458    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 11:03:10.587956 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.587912    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z79dt\""
Jul 17 11:03:10.591634 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.591713 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.591713 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08239f16-8533-4b02-9f80-fc79aa974494-local-certs\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.591713 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zws\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-kube-api-access-v2zws\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.591835 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-cacerts\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.591835 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-istio-token\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.591899 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.591879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.606005 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.605979    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"]
Jul 17 11:03:10.692954 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.692918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693062 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.692967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693062 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.692990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08239f16-8533-4b02-9f80-fc79aa974494-local-certs\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693062 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.693008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zws\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-kube-api-access-v2zws\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693062 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.693036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-cacerts\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693062 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.693053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-istio-token\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693331 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.693075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.693796 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.693769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.695292 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.695273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08239f16-8533-4b02-9f80-fc79aa974494-local-certs\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.695374 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.695321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.695374 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.695353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.695477 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.695459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-cacerts\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.705445 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.705417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-istio-token\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.705908 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.705887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zws\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-kube-api-access-v2zws\") pod \"istiod-openshift-gateway-7574459656-hqcm7\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:10.892613 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:10.892587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:11.040022 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:11.039997    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"]
Jul 17 11:03:11.112184 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:11.112153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" event={"ID":"08239f16-8533-4b02-9f80-fc79aa974494","Type":"ContainerStarted","Data":"a08f062c6be3ca27c2fc003896a6d730ef4003d3fa05bf7493eed3af24036ff0"}
Jul 17 11:03:13.330827 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:13.330792    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 11:03:13.331140 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:13.330859    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 11:03:14.129513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:14.129480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" event={"ID":"08239f16-8533-4b02-9f80-fc79aa974494","Type":"ContainerStarted","Data":"4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac"}
Jul 17 11:03:14.129693 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:14.129652    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:14.131308 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:14.131276    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hqcm7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 11:03:14.131447 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:14.131334    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" podUID="08239f16-8533-4b02-9f80-fc79aa974494" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 11:03:14.153147 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:14.153099    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" podStartSLOduration=1.868706473 podStartE2EDuration="4.153086051s" totalImagesPullingTime="2.284379578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:03:14.151745278 +0000 UTC m=+348.909555710" watchObservedRunningTime="2026-07-17 11:03:14.153086051 +0000 UTC m=+348.910896469"
Jul 17 11:03:15.139468 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:15.139438    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:17.261497 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.261456    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"]
Jul 17 11:03:17.263796 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.263776    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.270780 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.270753    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 11:03:17.271767 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.271741    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 11:03:17.271895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.271774    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 11:03:17.272065 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.272048    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 11:03:17.272267 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.272249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 11:03:17.272521 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.272503    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qs7rv\""
Jul 17 11:03:17.285687 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.285660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"]
Jul 17 11:03:17.352056 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.352026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/902a948c-cad2-4389-a559-7eae1033c7ef-metrics-cert\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.352191 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.352086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhfq\" (UniqueName: \"kubernetes.io/projected/902a948c-cad2-4389-a559-7eae1033c7ef-kube-api-access-gqhfq\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.352191 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.352115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902a948c-cad2-4389-a559-7eae1033c7ef-cert\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.352191 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.352175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/902a948c-cad2-4389-a559-7eae1033c7ef-manager-config\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.453243 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.453207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/902a948c-cad2-4389-a559-7eae1033c7ef-metrics-cert\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.453392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.453295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhfq\" (UniqueName: \"kubernetes.io/projected/902a948c-cad2-4389-a559-7eae1033c7ef-kube-api-access-gqhfq\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.453392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.453337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902a948c-cad2-4389-a559-7eae1033c7ef-cert\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.453392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.453367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/902a948c-cad2-4389-a559-7eae1033c7ef-manager-config\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.454286 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.454259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/902a948c-cad2-4389-a559-7eae1033c7ef-manager-config\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.455875 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.455846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902a948c-cad2-4389-a559-7eae1033c7ef-cert\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.455875 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.455861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/902a948c-cad2-4389-a559-7eae1033c7ef-metrics-cert\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.463888 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.463865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhfq\" (UniqueName: \"kubernetes.io/projected/902a948c-cad2-4389-a559-7eae1033c7ef-kube-api-access-gqhfq\") pod \"lws-controller-manager-d4bfb48f4-s42hl\" (UID: \"902a948c-cad2-4389-a559-7eae1033c7ef\") " pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.576981 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.576686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:17.709039 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:17.709009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"]
Jul 17 11:03:17.712707 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:03:17.712676    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902a948c_cad2_4389_a559_7eae1033c7ef.slice/crio-ed9061d5c62cd5522cde4d664b9a48064398c9b324b470f4f6d0988d8b1859d0 WatchSource:0}: Error finding container ed9061d5c62cd5522cde4d664b9a48064398c9b324b470f4f6d0988d8b1859d0: Status 404 returned error can't find the container with id ed9061d5c62cd5522cde4d664b9a48064398c9b324b470f4f6d0988d8b1859d0
Jul 17 11:03:18.149730 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:18.149692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl" event={"ID":"902a948c-cad2-4389-a559-7eae1033c7ef","Type":"ContainerStarted","Data":"ed9061d5c62cd5522cde4d664b9a48064398c9b324b470f4f6d0988d8b1859d0"}
Jul 17 11:03:21.163869 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:21.163836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl" event={"ID":"902a948c-cad2-4389-a559-7eae1033c7ef","Type":"ContainerStarted","Data":"8120389bd9ec76bde197819d763816d188699a1d1ccdf40ac5ca5fe91f0fd5a0"}
Jul 17 11:03:21.164336 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:21.163963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:03:21.185746 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:21.185696    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl" podStartSLOduration=1.7690741970000001 podStartE2EDuration="4.185682312s" totalImagesPullingTime="2.416608115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:03:21.185036739 +0000 UTC m=+355.942847158" watchObservedRunningTime="2026-07-17 11:03:21.185682312 +0000 UTC m=+355.943492708"
Jul 17 11:03:23.258188 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.258145    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"]
Jul 17 11:03:23.258625 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.258393    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" podUID="08239f16-8533-4b02-9f80-fc79aa974494" containerName="discovery" containerID="cri-o://4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac" gracePeriod=30
Jul 17 11:03:23.506584 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.506556    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:23.607617 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607533    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-dns-cert\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.607617 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607581    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-istio-token\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.607617 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607603    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-kubeconfig\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.607903 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2zws\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-kube-api-access-v2zws\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.607903 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08239f16-8533-4b02-9f80-fc79aa974494-local-certs\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.607903 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607773    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-cacerts\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.607903 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.607832    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-ca-configmap\") pod \"08239f16-8533-4b02-9f80-fc79aa974494\" (UID: \"08239f16-8533-4b02-9f80-fc79aa974494\") "
Jul 17 11:03:23.608585 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.608547    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:03:23.610563 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.610517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:03:23.610563 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.610554    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08239f16-8533-4b02-9f80-fc79aa974494-local-certs" (OuterVolumeSpecName: "local-certs") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:03:23.610702 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.610560    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-cacerts" (OuterVolumeSpecName: "cacerts") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:03:23.610702 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.610597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:03:23.610702 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.610619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-kube-api-access-v2zws" (OuterVolumeSpecName: "kube-api-access-v2zws") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "kube-api-access-v2zws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:03:23.610702 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.610671    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-istio-token" (OuterVolumeSpecName: "istio-token") pod "08239f16-8533-4b02-9f80-fc79aa974494" (UID: "08239f16-8533-4b02-9f80-fc79aa974494"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:03:23.709385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709344    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-dns-cert\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:23.709385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709376    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-istio-token\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:23.709385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709385    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-istio-kubeconfig\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:23.709385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709394    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2zws\" (UniqueName: \"kubernetes.io/projected/08239f16-8533-4b02-9f80-fc79aa974494-kube-api-access-v2zws\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:23.709717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709403    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08239f16-8533-4b02-9f80-fc79aa974494-local-certs\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:23.709717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709411    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08239f16-8533-4b02-9f80-fc79aa974494-cacerts\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:23.709717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:23.709420    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08239f16-8533-4b02-9f80-fc79aa974494-istio-csr-ca-configmap\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:03:24.177869 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.177836    2564 generic.go:356] "Generic (PLEG): container finished" podID="08239f16-8533-4b02-9f80-fc79aa974494" containerID="4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac" exitCode=0
Jul 17 11:03:24.178048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.177894    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"
Jul 17 11:03:24.178048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.177907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" event={"ID":"08239f16-8533-4b02-9f80-fc79aa974494","Type":"ContainerDied","Data":"4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac"}
Jul 17 11:03:24.178048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.177993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7" event={"ID":"08239f16-8533-4b02-9f80-fc79aa974494","Type":"ContainerDied","Data":"a08f062c6be3ca27c2fc003896a6d730ef4003d3fa05bf7493eed3af24036ff0"}
Jul 17 11:03:24.178048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.178015    2564 scope.go:117] "RemoveContainer" containerID="4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac"
Jul 17 11:03:24.186228 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.186206    2564 scope.go:117] "RemoveContainer" containerID="4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac"
Jul 17 11:03:24.186467 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:03:24.186448    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac\": container with ID starting with 4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac not found: ID does not exist" containerID="4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac"
Jul 17 11:03:24.186527 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.186474    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac"} err="failed to get container status \"4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac\": rpc error: code = NotFound desc = could not find container \"4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac\": container with ID starting with 4008ece4ce460cb44614cca0306afc73d8abed9a028a00d64c2948af8f1cf6ac not found: ID does not exist"
Jul 17 11:03:24.198886 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.198861    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"]
Jul 17 11:03:24.203476 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:24.203455    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hqcm7"]
Jul 17 11:03:25.716061 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:25.716025    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08239f16-8533-4b02-9f80-fc79aa974494" path="/var/lib/kubelet/pods/08239f16-8533-4b02-9f80-fc79aa974494/volumes"
Jul 17 11:03:32.171913 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:03:32.171881    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d4bfb48f4-s42hl"
Jul 17 11:04:09.758116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.758084    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nw7c4"]
Jul 17 11:04:09.758507 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.758374    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08239f16-8533-4b02-9f80-fc79aa974494" containerName="discovery"
Jul 17 11:04:09.758507 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.758385    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08239f16-8533-4b02-9f80-fc79aa974494" containerName="discovery"
Jul 17 11:04:09.758507 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.758438    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08239f16-8533-4b02-9f80-fc79aa974494" containerName="discovery"
Jul 17 11:04:09.765802 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.765777    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:09.769116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.769055    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 11:04:09.770048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.769992    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 11:04:09.770048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.769992    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rklgw\""
Jul 17 11:04:09.773558 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.773530    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nw7c4"]
Jul 17 11:04:09.787514 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.787489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzzl2\" (UniqueName: \"kubernetes.io/projected/0d05cb08-157c-410a-a118-1f68e6611111-kube-api-access-lzzl2\") pod \"kuadrant-operator-catalog-nw7c4\" (UID: \"0d05cb08-157c-410a-a118-1f68e6611111\") " pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:09.888547 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.888517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzzl2\" (UniqueName: \"kubernetes.io/projected/0d05cb08-157c-410a-a118-1f68e6611111-kube-api-access-lzzl2\") pod \"kuadrant-operator-catalog-nw7c4\" (UID: \"0d05cb08-157c-410a-a118-1f68e6611111\") " pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:09.898000 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:09.897972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzzl2\" (UniqueName: \"kubernetes.io/projected/0d05cb08-157c-410a-a118-1f68e6611111-kube-api-access-lzzl2\") pod \"kuadrant-operator-catalog-nw7c4\" (UID: \"0d05cb08-157c-410a-a118-1f68e6611111\") " pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:10.087605 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.087529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:10.116120 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.116090    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nw7c4"]
Jul 17 11:04:10.238700 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.238680    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nw7c4"]
Jul 17 11:04:10.240904 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:04:10.240879    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d05cb08_157c_410a_a118_1f68e6611111.slice/crio-cc1f39ad2e54641c7ab8ee0eabe34179f5a61b9b8be98b93049fc584f9418d1f WatchSource:0}: Error finding container cc1f39ad2e54641c7ab8ee0eabe34179f5a61b9b8be98b93049fc584f9418d1f: Status 404 returned error can't find the container with id cc1f39ad2e54641c7ab8ee0eabe34179f5a61b9b8be98b93049fc584f9418d1f
Jul 17 11:04:10.328662 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.327193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfpl6"]
Jul 17 11:04:10.336789 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.336764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:10.338542 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.338485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfpl6"]
Jul 17 11:04:10.370826 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.370792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4" event={"ID":"0d05cb08-157c-410a-a118-1f68e6611111","Type":"ContainerStarted","Data":"cc1f39ad2e54641c7ab8ee0eabe34179f5a61b9b8be98b93049fc584f9418d1f"}
Jul 17 11:04:10.498389 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.498356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4r6f\" (UniqueName: \"kubernetes.io/projected/3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3-kube-api-access-r4r6f\") pod \"kuadrant-operator-catalog-tfpl6\" (UID: \"3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3\") " pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:10.599558 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.599503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4r6f\" (UniqueName: \"kubernetes.io/projected/3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3-kube-api-access-r4r6f\") pod \"kuadrant-operator-catalog-tfpl6\" (UID: \"3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3\") " pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:10.608334 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.608293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4r6f\" (UniqueName: \"kubernetes.io/projected/3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3-kube-api-access-r4r6f\") pod \"kuadrant-operator-catalog-tfpl6\" (UID: \"3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3\") " pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:10.647230 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.647195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:10.771732 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:10.771705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfpl6"]
Jul 17 11:04:10.774077 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:04:10.774054    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cce6f2b_5c5e_4cfd_a142_bd00fec7f0d3.slice/crio-d7a325ada510c6e38dd54041e9c3dc978ac7a405791f38e7917d4d2c744e4ab6 WatchSource:0}: Error finding container d7a325ada510c6e38dd54041e9c3dc978ac7a405791f38e7917d4d2c744e4ab6: Status 404 returned error can't find the container with id d7a325ada510c6e38dd54041e9c3dc978ac7a405791f38e7917d4d2c744e4ab6
Jul 17 11:04:11.378578 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:11.378541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6" event={"ID":"3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3","Type":"ContainerStarted","Data":"d7a325ada510c6e38dd54041e9c3dc978ac7a405791f38e7917d4d2c744e4ab6"}
Jul 17 11:04:13.387808 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.387765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6" event={"ID":"3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3","Type":"ContainerStarted","Data":"9edff547e6ab76ccc7ff58424ed39386d9bc6645fc3446bbca37f54741679ed4"}
Jul 17 11:04:13.389152 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.389129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4" event={"ID":"0d05cb08-157c-410a-a118-1f68e6611111","Type":"ContainerStarted","Data":"cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8"}
Jul 17 11:04:13.389263 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.389168    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4" podUID="0d05cb08-157c-410a-a118-1f68e6611111" containerName="registry-server" containerID="cri-o://cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8" gracePeriod=2
Jul 17 11:04:13.405326 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.405283    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6" podStartSLOduration=1.8076697240000001 podStartE2EDuration="3.405269329s" totalImagesPullingTime="1.597599605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:04:13.403325989 +0000 UTC m=+408.161136419" watchObservedRunningTime="2026-07-17 11:04:13.405269329 +0000 UTC m=+408.163079746"
Jul 17 11:04:13.421392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.421351    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4" podStartSLOduration=2.291085794 podStartE2EDuration="4.421337384s" totalImagesPullingTime="2.13025159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:04:13.420236798 +0000 UTC m=+408.178047242" watchObservedRunningTime="2026-07-17 11:04:13.421337384 +0000 UTC m=+408.179147802"
Jul 17 11:04:13.626103 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.626081    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:13.724189 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.724168    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzzl2\" (UniqueName: \"kubernetes.io/projected/0d05cb08-157c-410a-a118-1f68e6611111-kube-api-access-lzzl2\") pod \"0d05cb08-157c-410a-a118-1f68e6611111\" (UID: \"0d05cb08-157c-410a-a118-1f68e6611111\") "
Jul 17 11:04:13.726133 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.726104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d05cb08-157c-410a-a118-1f68e6611111-kube-api-access-lzzl2" (OuterVolumeSpecName: "kube-api-access-lzzl2") pod "0d05cb08-157c-410a-a118-1f68e6611111" (UID: "0d05cb08-157c-410a-a118-1f68e6611111"). InnerVolumeSpecName "kube-api-access-lzzl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:04:13.825642 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:13.825613    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzzl2\" (UniqueName: \"kubernetes.io/projected/0d05cb08-157c-410a-a118-1f68e6611111-kube-api-access-lzzl2\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:04:14.394994 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.394932    2564 generic.go:356] "Generic (PLEG): container finished" podID="0d05cb08-157c-410a-a118-1f68e6611111" containerID="cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8" exitCode=0
Jul 17 11:04:14.394994 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.394971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4" event={"ID":"0d05cb08-157c-410a-a118-1f68e6611111","Type":"ContainerDied","Data":"cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8"}
Jul 17 11:04:14.394994 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.394992    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4"
Jul 17 11:04:14.395564 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.395024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nw7c4" event={"ID":"0d05cb08-157c-410a-a118-1f68e6611111","Type":"ContainerDied","Data":"cc1f39ad2e54641c7ab8ee0eabe34179f5a61b9b8be98b93049fc584f9418d1f"}
Jul 17 11:04:14.395564 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.395044    2564 scope.go:117] "RemoveContainer" containerID="cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8"
Jul 17 11:04:14.404115 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.404099    2564 scope.go:117] "RemoveContainer" containerID="cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8"
Jul 17 11:04:14.404388 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:04:14.404370    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8\": container with ID starting with cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8 not found: ID does not exist" containerID="cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8"
Jul 17 11:04:14.404442 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.404403    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8"} err="failed to get container status \"cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8\": rpc error: code = NotFound desc = could not find container \"cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8\": container with ID starting with cfa84d00cd8cecca4059dddd4a8ec9d24b69201cb6963049133d0804601e72b8 not found: ID does not exist"
Jul 17 11:04:14.420126 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.420104    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nw7c4"]
Jul 17 11:04:14.422711 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:14.422684    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nw7c4"]
Jul 17 11:04:15.715041 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:15.715006    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d05cb08-157c-410a-a118-1f68e6611111" path="/var/lib/kubelet/pods/0d05cb08-157c-410a-a118-1f68e6611111/volumes"
Jul 17 11:04:20.647633 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:20.647585    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:20.648046 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:20.647690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:20.670170 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:20.670145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:21.447867 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:21.447836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tfpl6"
Jul 17 11:04:42.061836 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.061800    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"]
Jul 17 11:04:42.062309 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.062105    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d05cb08-157c-410a-a118-1f68e6611111" containerName="registry-server"
Jul 17 11:04:42.062309 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.062116    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d05cb08-157c-410a-a118-1f68e6611111" containerName="registry-server"
Jul 17 11:04:42.062309 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.062185    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d05cb08-157c-410a-a118-1f68e6611111" containerName="registry-server"
Jul 17 11:04:42.068565 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.068545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:42.071184 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.071165    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mfx5b\""
Jul 17 11:04:42.076506 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.076484    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"]
Jul 17 11:04:42.122845 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.122818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t79j2\" (UniqueName: \"kubernetes.io/projected/e25f291c-cf65-4048-a5b6-16d382d7302d-kube-api-access-t79j2\") pod \"authorino-operator-75cc8d5cb7-zpmjk\" (UID: \"e25f291c-cf65-4048-a5b6-16d382d7302d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:42.223810 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.223782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t79j2\" (UniqueName: \"kubernetes.io/projected/e25f291c-cf65-4048-a5b6-16d382d7302d-kube-api-access-t79j2\") pod \"authorino-operator-75cc8d5cb7-zpmjk\" (UID: \"e25f291c-cf65-4048-a5b6-16d382d7302d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:42.244269 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.244242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t79j2\" (UniqueName: \"kubernetes.io/projected/e25f291c-cf65-4048-a5b6-16d382d7302d-kube-api-access-t79j2\") pod \"authorino-operator-75cc8d5cb7-zpmjk\" (UID: \"e25f291c-cf65-4048-a5b6-16d382d7302d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:42.378857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.378801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:42.503622 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.503600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"]
Jul 17 11:04:42.506245 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:04:42.506217    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25f291c_cf65_4048_a5b6_16d382d7302d.slice/crio-77c7acbb0b2ba87801c8890270fa234b761de11bb27d5b6aed97d5274438a0c1 WatchSource:0}: Error finding container 77c7acbb0b2ba87801c8890270fa234b761de11bb27d5b6aed97d5274438a0c1: Status 404 returned error can't find the container with id 77c7acbb0b2ba87801c8890270fa234b761de11bb27d5b6aed97d5274438a0c1
Jul 17 11:04:42.513136 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:42.513080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk" event={"ID":"e25f291c-cf65-4048-a5b6-16d382d7302d","Type":"ContainerStarted","Data":"77c7acbb0b2ba87801c8890270fa234b761de11bb27d5b6aed97d5274438a0c1"}
Jul 17 11:04:45.529878 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:45.529845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk" event={"ID":"e25f291c-cf65-4048-a5b6-16d382d7302d","Type":"ContainerStarted","Data":"3d56e37fb6c6d23facf14598239754204aece90d0951dbe66a1ed417ff7ea5c8"}
Jul 17 11:04:45.530262 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:45.529979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:45.559196 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:45.559149    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk" podStartSLOduration=1.324361385 podStartE2EDuration="3.559135828s" totalImagesPullingTime="2.234774443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:04:45.558412342 +0000 UTC m=+440.316222760" watchObservedRunningTime="2026-07-17 11:04:45.559135828 +0000 UTC m=+440.316946245"
Jul 17 11:04:46.323604 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.323566    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"]
Jul 17 11:04:46.329692 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.329662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.332528 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.332499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zd2x4\""
Jul 17 11:04:46.342819 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.342798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"]
Jul 17 11:04:46.457184 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.457160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrs4x\" (UniqueName: \"kubernetes.io/projected/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-kube-api-access-xrs4x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.457310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.457273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.558191 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.558165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.558471 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.558208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrs4x\" (UniqueName: \"kubernetes.io/projected/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-kube-api-access-xrs4x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.558519 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.558499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.573126 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.573099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrs4x\" (UniqueName: \"kubernetes.io/projected/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-kube-api-access-xrs4x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.640621 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.640601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:46.774050 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:46.773893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"]
Jul 17 11:04:46.776371 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:04:46.776339    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0942de6_9c20_4c1d_8e3c_c2d8623f563f.slice/crio-009f93d9da0fde1906237e2231782d3332db402936544260b081be517acab102 WatchSource:0}: Error finding container 009f93d9da0fde1906237e2231782d3332db402936544260b081be517acab102: Status 404 returned error can't find the container with id 009f93d9da0fde1906237e2231782d3332db402936544260b081be517acab102
Jul 17 11:04:47.542576 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:47.542492    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz" event={"ID":"b0942de6-9c20-4c1d-8e3c-c2d8623f563f","Type":"ContainerStarted","Data":"009f93d9da0fde1906237e2231782d3332db402936544260b081be517acab102"}
Jul 17 11:04:50.647180 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.647151    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"]
Jul 17 11:04:50.650472 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.650452    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:04:50.652917 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.652895    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zr2jk\""
Jul 17 11:04:50.653028 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.652950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 11:04:50.661437 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.661416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"]
Jul 17 11:04:50.693646 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.693616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5q2s\" (UniqueName: \"kubernetes.io/projected/ed4344e7-bd71-41b1-b2d6-3193b87b22c8-kube-api-access-h5q2s\") pod \"dns-operator-controller-manager-864dd78c4c-2k78k\" (UID: \"ed4344e7-bd71-41b1-b2d6-3193b87b22c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:04:50.795078 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.795046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5q2s\" (UniqueName: \"kubernetes.io/projected/ed4344e7-bd71-41b1-b2d6-3193b87b22c8-kube-api-access-h5q2s\") pod \"dns-operator-controller-manager-864dd78c4c-2k78k\" (UID: \"ed4344e7-bd71-41b1-b2d6-3193b87b22c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:04:50.804992 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.804965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5q2s\" (UniqueName: \"kubernetes.io/projected/ed4344e7-bd71-41b1-b2d6-3193b87b22c8-kube-api-access-h5q2s\") pod \"dns-operator-controller-manager-864dd78c4c-2k78k\" (UID: \"ed4344e7-bd71-41b1-b2d6-3193b87b22c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:04:50.961525 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:50.961444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:04:51.092549 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:51.092527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"]
Jul 17 11:04:51.094595 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:04:51.094562    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4344e7_bd71_41b1_b2d6_3193b87b22c8.slice/crio-ae30527cd16620515358932f286a1f14768c40cd1f20c409ea96e20f59fecafc WatchSource:0}: Error finding container ae30527cd16620515358932f286a1f14768c40cd1f20c409ea96e20f59fecafc: Status 404 returned error can't find the container with id ae30527cd16620515358932f286a1f14768c40cd1f20c409ea96e20f59fecafc
Jul 17 11:04:51.561673 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:51.561638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k" event={"ID":"ed4344e7-bd71-41b1-b2d6-3193b87b22c8","Type":"ContainerStarted","Data":"ae30527cd16620515358932f286a1f14768c40cd1f20c409ea96e20f59fecafc"}
Jul 17 11:04:53.574135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:53.574102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz" event={"ID":"b0942de6-9c20-4c1d-8e3c-c2d8623f563f","Type":"ContainerStarted","Data":"e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f"}
Jul 17 11:04:53.574624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:53.574257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:04:53.598160 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:53.598105    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz" podStartSLOduration=1.462284304 podStartE2EDuration="7.598087575s" totalImagesPullingTime="6.135803271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:04:53.596131102 +0000 UTC m=+448.353941553" watchObservedRunningTime="2026-07-17 11:04:53.598087575 +0000 UTC m=+448.355897992"
Jul 17 11:04:55.584509 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.584465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k" event={"ID":"ed4344e7-bd71-41b1-b2d6-3193b87b22c8","Type":"ContainerStarted","Data":"658bcbe0a482de5daf8c0ef6775aa896ac1b86557d4cc80d1ef1e7d98aca7474"}
Jul 17 11:04:55.584973 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.584552    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:04:55.615541 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.615497    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k" podStartSLOduration=2.145356171 podStartE2EDuration="5.615484905s" totalImagesPullingTime="3.470128734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:04:55.613886468 +0000 UTC m=+450.371696909" watchObservedRunningTime="2026-07-17 11:04:55.615484905 +0000 UTC m=+450.373295323"
Jul 17 11:04:55.838282 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.838204    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"]
Jul 17 11:04:55.841439 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.841417    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:55.844033 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.844007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 17 11:04:55.844147 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.844011    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5xfhp\""
Jul 17 11:04:55.844147 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.844051    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 17 11:04:55.854300 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.854280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"]
Jul 17 11:04:55.938932 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.938905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44dba105-c86b-4260-818e-1694924367e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:55.939107 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.938975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44dba105-c86b-4260-818e-1694924367e2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:55.939107 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:55.939004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpbzw\" (UniqueName: \"kubernetes.io/projected/44dba105-c86b-4260-818e-1694924367e2-kube-api-access-dpbzw\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.040334 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.040311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44dba105-c86b-4260-818e-1694924367e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.040437 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.040341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44dba105-c86b-4260-818e-1694924367e2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.040437 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.040360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpbzw\" (UniqueName: \"kubernetes.io/projected/44dba105-c86b-4260-818e-1694924367e2-kube-api-access-dpbzw\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.040551 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:04:56.040475    2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 17 11:04:56.040551 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:04:56.040542    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44dba105-c86b-4260-818e-1694924367e2-plugin-serving-cert podName:44dba105-c86b-4260-818e-1694924367e2 nodeName:}" failed. No retries permitted until 2026-07-17 11:04:56.540522411 +0000 UTC m=+451.298332808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/44dba105-c86b-4260-818e-1694924367e2-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-vkt9x" (UID: "44dba105-c86b-4260-818e-1694924367e2") : secret "plugin-serving-cert" not found
Jul 17 11:04:56.040924 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.040904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44dba105-c86b-4260-818e-1694924367e2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.052728 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.052700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpbzw\" (UniqueName: \"kubernetes.io/projected/44dba105-c86b-4260-818e-1694924367e2-kube-api-access-dpbzw\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.536826 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.536803    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpmjk"
Jul 17 11:04:56.543872 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.543843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44dba105-c86b-4260-818e-1694924367e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.546120 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.546099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44dba105-c86b-4260-818e-1694924367e2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vkt9x\" (UID: \"44dba105-c86b-4260-818e-1694924367e2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.751035 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.751005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"
Jul 17 11:04:56.881832 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:56.881763    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x"]
Jul 17 11:04:56.883954 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:04:56.883912    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44dba105_c86b_4260_818e_1694924367e2.slice/crio-9ddd5b8da730ba6c94397f54d68cecf277af11a06698a163de66673cddb3e0a1 WatchSource:0}: Error finding container 9ddd5b8da730ba6c94397f54d68cecf277af11a06698a163de66673cddb3e0a1: Status 404 returned error can't find the container with id 9ddd5b8da730ba6c94397f54d68cecf277af11a06698a163de66673cddb3e0a1
Jul 17 11:04:57.594014 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:04:57.593985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x" event={"ID":"44dba105-c86b-4260-818e-1694924367e2","Type":"ContainerStarted","Data":"9ddd5b8da730ba6c94397f54d68cecf277af11a06698a163de66673cddb3e0a1"}
Jul 17 11:05:04.580415 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:04.580378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:05.887657 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:05.887532    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"]
Jul 17 11:05:05.894594 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:05.894567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:05.907721 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:05.907687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"]
Jul 17 11:05:06.023620 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.023579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhkkr\" (UniqueName: \"kubernetes.io/projected/14fc6002-355d-4974-b2da-0d6d5b6c5366-kube-api-access-vhkkr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.023800 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.023712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14fc6002-355d-4974-b2da-0d6d5b6c5366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.124680 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.124638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14fc6002-355d-4974-b2da-0d6d5b6c5366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.124856 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.124733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhkkr\" (UniqueName: \"kubernetes.io/projected/14fc6002-355d-4974-b2da-0d6d5b6c5366-kube-api-access-vhkkr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.125149 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.125110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14fc6002-355d-4974-b2da-0d6d5b6c5366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.148969 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.148925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhkkr\" (UniqueName: \"kubernetes.io/projected/14fc6002-355d-4974-b2da-0d6d5b6c5366-kube-api-access-vhkkr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.191952 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.191912    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"]
Jul 17 11:05:06.192234 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.192212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:06.276056 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.276022    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"]
Jul 17 11:05:06.281087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.281066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.314109 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.314087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"]
Jul 17 11:05:06.427690 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.427618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzb86\" (UniqueName: \"kubernetes.io/projected/b8fcc21f-5aee-4107-a0ae-7aacf908694b-kube-api-access-wzb86\") pod \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.427690 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.427673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8fcc21f-5aee-4107-a0ae-7aacf908694b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.528679 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.528648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzb86\" (UniqueName: \"kubernetes.io/projected/b8fcc21f-5aee-4107-a0ae-7aacf908694b-kube-api-access-wzb86\") pod \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.528846 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.528702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8fcc21f-5aee-4107-a0ae-7aacf908694b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.529188 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.529165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8fcc21f-5aee-4107-a0ae-7aacf908694b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.544896 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.544871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzb86\" (UniqueName: \"kubernetes.io/projected/b8fcc21f-5aee-4107-a0ae-7aacf908694b-kube-api-access-wzb86\") pod \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.587618 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.587591    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"]
Jul 17 11:05:06.587877 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.587861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:06.591882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.591860    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2k78k"
Jul 17 11:05:06.596589 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.596566    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"]
Jul 17 11:05:06.613390 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.613368    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"]
Jul 17 11:05:06.619240 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.619215    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"]
Jul 17 11:05:06.633123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.633096    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"]
Jul 17 11:05:06.637187 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.637168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.638275 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.638250    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"]
Jul 17 11:05:06.638628 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.638468    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" containerName="manager" containerID="cri-o://e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f" gracePeriod=2
Jul 17 11:05:06.657570 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.657538    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"]
Jul 17 11:05:06.662911 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.662887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"]
Jul 17 11:05:06.680113 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.680058    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"]
Jul 17 11:05:06.680469 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.680452    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" containerName="manager"
Jul 17 11:05:06.680546 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.680472    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" containerName="manager"
Jul 17 11:05:06.680546 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.680542    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" containerName="manager"
Jul 17 11:05:06.684641 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.684620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.693173 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:06.693142    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:06.695391 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:06.695358    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:06.699016 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.698995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"]
Jul 17 11:05:06.731549 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.731518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7976f725-13c6-44df-a6d6-ff3038e4e128-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lww88\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.731678 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.731566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8cn\" (UniqueName: \"kubernetes.io/projected/7976f725-13c6-44df-a6d6-ff3038e4e128-kube-api-access-gr8cn\") pod \"kuadrant-operator-controller-manager-55467d9f7-lww88\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.832076 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.832042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aea01691-d13e-420d-ad33-b3b30ff0feae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44zqn\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.832247 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.832099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7976f725-13c6-44df-a6d6-ff3038e4e128-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lww88\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.832247 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.832158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8cn\" (UniqueName: \"kubernetes.io/projected/7976f725-13c6-44df-a6d6-ff3038e4e128-kube-api-access-gr8cn\") pod \"kuadrant-operator-controller-manager-55467d9f7-lww88\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.832247 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.832222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kmcd\" (UniqueName: \"kubernetes.io/projected/aea01691-d13e-420d-ad33-b3b30ff0feae-kube-api-access-9kmcd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44zqn\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.832500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.832448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7976f725-13c6-44df-a6d6-ff3038e4e128-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lww88\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.847113 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.847069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8cn\" (UniqueName: \"kubernetes.io/projected/7976f725-13c6-44df-a6d6-ff3038e4e128-kube-api-access-gr8cn\") pod \"kuadrant-operator-controller-manager-55467d9f7-lww88\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:06.933261 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.933183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aea01691-d13e-420d-ad33-b3b30ff0feae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44zqn\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.933673 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.933256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kmcd\" (UniqueName: \"kubernetes.io/projected/aea01691-d13e-420d-ad33-b3b30ff0feae-kube-api-access-9kmcd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44zqn\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.933673 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.933604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aea01691-d13e-420d-ad33-b3b30ff0feae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44zqn\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.949519 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.949492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kmcd\" (UniqueName: \"kubernetes.io/projected/aea01691-d13e-420d-ad33-b3b30ff0feae-kube-api-access-9kmcd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44zqn\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:06.952147 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:06.952117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:07.007615 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:07.007590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:19.918794 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:19.918771    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"]
Jul 17 11:05:19.938973 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:05:19.938927    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7976f725_13c6_44df_a6d6_ff3038e4e128.slice/crio-3d585a93d9cc6f5c98d329c5b9925f38dd0461e84de47fcf54f229db031eb67e WatchSource:0}: Error finding container 3d585a93d9cc6f5c98d329c5b9925f38dd0461e84de47fcf54f229db031eb67e: Status 404 returned error can't find the container with id 3d585a93d9cc6f5c98d329c5b9925f38dd0461e84de47fcf54f229db031eb67e
Jul 17 11:05:19.940229 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:19.940191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"]
Jul 17 11:05:19.942418 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:05:19.942400    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea01691_d13e_420d_ad33_b3b30ff0feae.slice/crio-ca6ce94307feea4dedd9b1147975f936d253a072a2b859eead65ab21a49827e7 WatchSource:0}: Error finding container ca6ce94307feea4dedd9b1147975f936d253a072a2b859eead65ab21a49827e7: Status 404 returned error can't find the container with id ca6ce94307feea4dedd9b1147975f936d253a072a2b859eead65ab21a49827e7
Jul 17 11:05:19.978040 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:19.978018    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:19.980300 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:19.980266    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:20.155946 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.155909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-extensions-socket-volume\") pod \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") "
Jul 17 11:05:20.156047 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.156013    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrs4x\" (UniqueName: \"kubernetes.io/projected/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-kube-api-access-xrs4x\") pod \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\" (UID: \"b0942de6-9c20-4c1d-8e3c-c2d8623f563f\") "
Jul 17 11:05:20.156311 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.156280    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b0942de6-9c20-4c1d-8e3c-c2d8623f563f" (UID: "b0942de6-9c20-4c1d-8e3c-c2d8623f563f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:05:20.157703 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.157685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-kube-api-access-xrs4x" (OuterVolumeSpecName: "kube-api-access-xrs4x") pod "b0942de6-9c20-4c1d-8e3c-c2d8623f563f" (UID: "b0942de6-9c20-4c1d-8e3c-c2d8623f563f"). InnerVolumeSpecName "kube-api-access-xrs4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:05:20.257445 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.257419    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-extensions-socket-volume\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:20.257445 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.257440    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrs4x\" (UniqueName: \"kubernetes.io/projected/b0942de6-9c20-4c1d-8e3c-c2d8623f563f-kube-api-access-xrs4x\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:20.721612 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.721578    2564 generic.go:356] "Generic (PLEG): container finished" podID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" containerID="e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f" exitCode=0
Jul 17 11:05:20.721763 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.721637    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:20.721763 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.721657    2564 scope.go:117] "RemoveContainer" containerID="e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f"
Jul 17 11:05:20.723460 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.723436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88" event={"ID":"7976f725-13c6-44df-a6d6-ff3038e4e128","Type":"ContainerStarted","Data":"823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7"}
Jul 17 11:05:20.723607 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.723516    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:20.723607 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.723540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88" event={"ID":"7976f725-13c6-44df-a6d6-ff3038e4e128","Type":"ContainerStarted","Data":"3d585a93d9cc6f5c98d329c5b9925f38dd0461e84de47fcf54f229db031eb67e"}
Jul 17 11:05:20.724345 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:20.724315    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:20.725255 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.725223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn" event={"ID":"aea01691-d13e-420d-ad33-b3b30ff0feae","Type":"ContainerStarted","Data":"36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3"}
Jul 17 11:05:20.725381 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.725275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn" event={"ID":"aea01691-d13e-420d-ad33-b3b30ff0feae","Type":"ContainerStarted","Data":"ca6ce94307feea4dedd9b1147975f936d253a072a2b859eead65ab21a49827e7"}
Jul 17 11:05:20.725381 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.725303    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:20.726554 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:20.726525    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:20.726865 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.726838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x" event={"ID":"44dba105-c86b-4260-818e-1694924367e2","Type":"ContainerStarted","Data":"770cdaf5d22483b387c047341651a6d7c0bde822873ae6d4074c8a5bcdc99050"}
Jul 17 11:05:20.731148 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.731130    2564 scope.go:117] "RemoveContainer" containerID="e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f"
Jul 17 11:05:20.731397 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:20.731373    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f\": container with ID starting with e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f not found: ID does not exist" containerID="e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f"
Jul 17 11:05:20.731449 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.731407    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f"} err="failed to get container status \"e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f\": rpc error: code = NotFound desc = could not find container \"e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f\": container with ID starting with e7a9be16a70ed5fbd3bd356ee1f3f7d6a75fe19a13a1a7da2c77f1fda79bc46f not found: ID does not exist"
Jul 17 11:05:20.751948 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.751886    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88" podStartSLOduration=14.751870477 podStartE2EDuration="14.751870477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:05:20.750362775 +0000 UTC m=+475.508173212" watchObservedRunningTime="2026-07-17 11:05:20.751870477 +0000 UTC m=+475.509680896"
Jul 17 11:05:20.774061 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.774024    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vkt9x" podStartSLOduration=2.650507517 podStartE2EDuration="25.774012972s" totalImagesPullingTime="23.123505455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:05:20.773853775 +0000 UTC m=+475.531664194" watchObservedRunningTime="2026-07-17 11:05:20.774012972 +0000 UTC m=+475.531823404"
Jul 17 11:05:20.783342 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:20.783304    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6gqrz\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6gqrz"
Jul 17 11:05:20.813313 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:20.813268    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn" podStartSLOduration=14.813255316 podStartE2EDuration="14.813255316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:05:20.811162656 +0000 UTC m=+475.568973074" watchObservedRunningTime="2026-07-17 11:05:20.813255316 +0000 UTC m=+475.571065738"
Jul 17 11:05:21.716289 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:21.716245    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0942de6-9c20-4c1d-8e3c-c2d8623f563f" path="/var/lib/kubelet/pods/b0942de6-9c20-4c1d-8e3c-c2d8623f563f/volumes"
Jul 17 11:05:22.311746 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.311573    2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fknmx_kuadrant-system_b8fcc21f-5aee-4107-a0ae-7aacf908694b_0(b75f58233b6d0bbcc96921669c30897e00190e956c148a532fc94e56dc57159d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fknmx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 17 11:05:22.311746 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.311628    2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fknmx_kuadrant-system_b8fcc21f-5aee-4107-a0ae-7aacf908694b_0(b75f58233b6d0bbcc96921669c30897e00190e956c148a532fc94e56dc57159d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fknmx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.311746 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.311733    2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-4v2xb_kuadrant-system_14fc6002-355d-4974-b2da-0d6d5b6c5366_0(9b1ab019810d0df49ed2494395994cbc20fc6e8156e69f34d3b5db0fc361e882): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-4v2xb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 17 11:05:22.312014 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.311761    2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-4v2xb_kuadrant-system_14fc6002-355d-4974-b2da-0d6d5b6c5366_0(9b1ab019810d0df49ed2494395994cbc20fc6e8156e69f34d3b5db0fc361e882): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-4v2xb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.736580 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.736552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.736954 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.736562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.739115 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.739091    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.742221 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.742195    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.746255 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.746236    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.748098 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.748077    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.791694 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.791678    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.793782 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.793763    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.795722 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.795702    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.803687 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.803667    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.805800 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.805781    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:22.807591 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:22.807552    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:22.877971 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.877951    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8fcc21f-5aee-4107-a0ae-7aacf908694b-extensions-socket-volume\") pod \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") "
Jul 17 11:05:22.878160 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.878142    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fcc21f-5aee-4107-a0ae-7aacf908694b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b8fcc21f-5aee-4107-a0ae-7aacf908694b" (UID: "b8fcc21f-5aee-4107-a0ae-7aacf908694b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:05:22.978479 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.978458    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzb86\" (UniqueName: \"kubernetes.io/projected/b8fcc21f-5aee-4107-a0ae-7aacf908694b-kube-api-access-wzb86\") pod \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\" (UID: \"b8fcc21f-5aee-4107-a0ae-7aacf908694b\") "
Jul 17 11:05:22.978570 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.978492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhkkr\" (UniqueName: \"kubernetes.io/projected/14fc6002-355d-4974-b2da-0d6d5b6c5366-kube-api-access-vhkkr\") pod \"14fc6002-355d-4974-b2da-0d6d5b6c5366\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") "
Jul 17 11:05:22.978570 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.978511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14fc6002-355d-4974-b2da-0d6d5b6c5366-extensions-socket-volume\") pod \"14fc6002-355d-4974-b2da-0d6d5b6c5366\" (UID: \"14fc6002-355d-4974-b2da-0d6d5b6c5366\") "
Jul 17 11:05:22.978677 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.978641    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8fcc21f-5aee-4107-a0ae-7aacf908694b-extensions-socket-volume\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:22.978831 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.978804    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fc6002-355d-4974-b2da-0d6d5b6c5366-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "14fc6002-355d-4974-b2da-0d6d5b6c5366" (UID: "14fc6002-355d-4974-b2da-0d6d5b6c5366"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:05:22.980599 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.980574    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fc6002-355d-4974-b2da-0d6d5b6c5366-kube-api-access-vhkkr" (OuterVolumeSpecName: "kube-api-access-vhkkr") pod "14fc6002-355d-4974-b2da-0d6d5b6c5366" (UID: "14fc6002-355d-4974-b2da-0d6d5b6c5366"). InnerVolumeSpecName "kube-api-access-vhkkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:05:22.980666 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:22.980602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fcc21f-5aee-4107-a0ae-7aacf908694b-kube-api-access-wzb86" (OuterVolumeSpecName: "kube-api-access-wzb86") pod "b8fcc21f-5aee-4107-a0ae-7aacf908694b" (UID: "b8fcc21f-5aee-4107-a0ae-7aacf908694b"). InnerVolumeSpecName "kube-api-access-wzb86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:05:23.079651 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.079586    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzb86\" (UniqueName: \"kubernetes.io/projected/b8fcc21f-5aee-4107-a0ae-7aacf908694b-kube-api-access-wzb86\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:23.079651 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.079609    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhkkr\" (UniqueName: \"kubernetes.io/projected/14fc6002-355d-4974-b2da-0d6d5b6c5366-kube-api-access-vhkkr\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:23.079651 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.079619    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/14fc6002-355d-4974-b2da-0d6d5b6c5366-extensions-socket-volume\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:23.716604 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.716571    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" path="/var/lib/kubelet/pods/14fc6002-355d-4974-b2da-0d6d5b6c5366/volumes"
Jul 17 11:05:23.716822 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.716810    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" path="/var/lib/kubelet/pods/b8fcc21f-5aee-4107-a0ae-7aacf908694b/volumes"
Jul 17 11:05:23.740573 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.740554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:23.740826 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:23.740554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:23.742924 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:23.742896    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:23.744865 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:23.744842    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:23.746610 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:23.746588    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:23.748278 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:23.748253    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:25.716130 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:25.716098    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4v2xb\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="14fc6002-355d-4974-b2da-0d6d5b6c5366" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4v2xb"
Jul 17 11:05:25.718371 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:25.718347    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fknmx\" is forbidden: User \"system:node:ip-10-0-131-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-118.ec2.internal' and this object" podUID="b8fcc21f-5aee-4107-a0ae-7aacf908694b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fknmx"
Jul 17 11:05:31.734496 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:31.734463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:31.734928 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:31.734620    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:31.806615 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:31.806590    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"]
Jul 17 11:05:31.806766 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:31.806743    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn" podUID="aea01691-d13e-420d-ad33-b3b30ff0feae" containerName="manager" containerID="cri-o://36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3" gracePeriod=10
Jul 17 11:05:32.046120 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.046097    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:32.066661 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.066637    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"]
Jul 17 11:05:32.067032 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.067015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea01691-d13e-420d-ad33-b3b30ff0feae" containerName="manager"
Jul 17 11:05:32.067116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.067034    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea01691-d13e-420d-ad33-b3b30ff0feae" containerName="manager"
Jul 17 11:05:32.067169 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.067135    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea01691-d13e-420d-ad33-b3b30ff0feae" containerName="manager"
Jul 17 11:05:32.068898 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.068880    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.100160 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.100140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"]
Jul 17 11:05:32.147418 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.147398    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aea01691-d13e-420d-ad33-b3b30ff0feae-extensions-socket-volume\") pod \"aea01691-d13e-420d-ad33-b3b30ff0feae\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") "
Jul 17 11:05:32.147561 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.147469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kmcd\" (UniqueName: \"kubernetes.io/projected/aea01691-d13e-420d-ad33-b3b30ff0feae-kube-api-access-9kmcd\") pod \"aea01691-d13e-420d-ad33-b3b30ff0feae\" (UID: \"aea01691-d13e-420d-ad33-b3b30ff0feae\") "
Jul 17 11:05:32.147620 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.147603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pmr\" (UniqueName: \"kubernetes.io/projected/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-kube-api-access-h4pmr\") pod \"kuadrant-operator-controller-manager-86878c769f-g9v2p\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.147743 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.147716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g9v2p\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.147852 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.147822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea01691-d13e-420d-ad33-b3b30ff0feae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aea01691-d13e-420d-ad33-b3b30ff0feae" (UID: "aea01691-d13e-420d-ad33-b3b30ff0feae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:05:32.149505 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.149485    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aea01691-d13e-420d-ad33-b3b30ff0feae-kube-api-access-9kmcd" (OuterVolumeSpecName: "kube-api-access-9kmcd") pod "aea01691-d13e-420d-ad33-b3b30ff0feae" (UID: "aea01691-d13e-420d-ad33-b3b30ff0feae"). InnerVolumeSpecName "kube-api-access-9kmcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:05:32.248279 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.248257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g9v2p\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.248386 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.248322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pmr\" (UniqueName: \"kubernetes.io/projected/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-kube-api-access-h4pmr\") pod \"kuadrant-operator-controller-manager-86878c769f-g9v2p\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.248450 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.248376    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aea01691-d13e-420d-ad33-b3b30ff0feae-extensions-socket-volume\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:32.248450 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.248402    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kmcd\" (UniqueName: \"kubernetes.io/projected/aea01691-d13e-420d-ad33-b3b30ff0feae-kube-api-access-9kmcd\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:32.248640 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.248624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g9v2p\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.258396 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.258373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pmr\" (UniqueName: \"kubernetes.io/projected/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-kube-api-access-h4pmr\") pod \"kuadrant-operator-controller-manager-86878c769f-g9v2p\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.378451 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.378405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.531157 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.531132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"]
Jul 17 11:05:32.533975 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:05:32.533917    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7ca52b_1520_44a1_8c2b_ebefd7c1cf31.slice/crio-20502a32edddf5ffbeb7349695727a8cbbd8357d41e1b89a424066bb1e5d14a7 WatchSource:0}: Error finding container 20502a32edddf5ffbeb7349695727a8cbbd8357d41e1b89a424066bb1e5d14a7: Status 404 returned error can't find the container with id 20502a32edddf5ffbeb7349695727a8cbbd8357d41e1b89a424066bb1e5d14a7
Jul 17 11:05:32.786246 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.786219    2564 generic.go:356] "Generic (PLEG): container finished" podID="aea01691-d13e-420d-ad33-b3b30ff0feae" containerID="36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3" exitCode=0
Jul 17 11:05:32.786665 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.786269    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"
Jul 17 11:05:32.786665 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.786290    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn" event={"ID":"aea01691-d13e-420d-ad33-b3b30ff0feae","Type":"ContainerDied","Data":"36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3"}
Jul 17 11:05:32.786665 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.786340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn" event={"ID":"aea01691-d13e-420d-ad33-b3b30ff0feae","Type":"ContainerDied","Data":"ca6ce94307feea4dedd9b1147975f936d253a072a2b859eead65ab21a49827e7"}
Jul 17 11:05:32.786665 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.786371    2564 scope.go:117] "RemoveContainer" containerID="36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3"
Jul 17 11:05:32.788083 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.788060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p" event={"ID":"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31","Type":"ContainerStarted","Data":"5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4"}
Jul 17 11:05:32.788205 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.788106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:32.788205 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.788123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p" event={"ID":"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31","Type":"ContainerStarted","Data":"20502a32edddf5ffbeb7349695727a8cbbd8357d41e1b89a424066bb1e5d14a7"}
Jul 17 11:05:32.795843 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.795780    2564 scope.go:117] "RemoveContainer" containerID="36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3"
Jul 17 11:05:32.796451 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:32.796433    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3\": container with ID starting with 36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3 not found: ID does not exist" containerID="36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3"
Jul 17 11:05:32.796532 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.796458    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3"} err="failed to get container status \"36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3\": rpc error: code = NotFound desc = could not find container \"36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3\": container with ID starting with 36b8627b7420a587ff8c5c276b80a000534fe6f20970a05695ba2e729ffa4ce3 not found: ID does not exist"
Jul 17 11:05:32.826830 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.826779    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p" podStartSLOduration=0.826761472 podStartE2EDuration="826.761472ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:05:32.8251705 +0000 UTC m=+487.582980920" watchObservedRunningTime="2026-07-17 11:05:32.826761472 +0000 UTC m=+487.584571892"
Jul 17 11:05:32.841476 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.841453    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"]
Jul 17 11:05:32.852360 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:32.852332    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44zqn"]
Jul 17 11:05:33.715620 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:33.715577    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aea01691-d13e-420d-ad33-b3b30ff0feae" path="/var/lib/kubelet/pods/aea01691-d13e-420d-ad33-b3b30ff0feae/volumes"
Jul 17 11:05:43.795750 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:43.795720    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:05:43.856817 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:43.856788    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"]
Jul 17 11:05:43.856995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:43.856972    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88" podUID="7976f725-13c6-44df-a6d6-ff3038e4e128" containerName="manager" containerID="cri-o://823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7" gracePeriod=10
Jul 17 11:05:44.100241 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.100212    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:44.140364 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.140342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr8cn\" (UniqueName: \"kubernetes.io/projected/7976f725-13c6-44df-a6d6-ff3038e4e128-kube-api-access-gr8cn\") pod \"7976f725-13c6-44df-a6d6-ff3038e4e128\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") "
Jul 17 11:05:44.140499 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.140432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7976f725-13c6-44df-a6d6-ff3038e4e128-extensions-socket-volume\") pod \"7976f725-13c6-44df-a6d6-ff3038e4e128\" (UID: \"7976f725-13c6-44df-a6d6-ff3038e4e128\") "
Jul 17 11:05:44.140786 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.140761    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7976f725-13c6-44df-a6d6-ff3038e4e128-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7976f725-13c6-44df-a6d6-ff3038e4e128" (UID: "7976f725-13c6-44df-a6d6-ff3038e4e128"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:05:44.142219 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.142193    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7976f725-13c6-44df-a6d6-ff3038e4e128-kube-api-access-gr8cn" (OuterVolumeSpecName: "kube-api-access-gr8cn") pod "7976f725-13c6-44df-a6d6-ff3038e4e128" (UID: "7976f725-13c6-44df-a6d6-ff3038e4e128"). InnerVolumeSpecName "kube-api-access-gr8cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:05:44.241681 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.241659    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7976f725-13c6-44df-a6d6-ff3038e4e128-extensions-socket-volume\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:44.241681 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.241680    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr8cn\" (UniqueName: \"kubernetes.io/projected/7976f725-13c6-44df-a6d6-ff3038e4e128-kube-api-access-gr8cn\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:05:44.840572 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.840539    2564 generic.go:356] "Generic (PLEG): container finished" podID="7976f725-13c6-44df-a6d6-ff3038e4e128" containerID="823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7" exitCode=0
Jul 17 11:05:44.840929 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.840581    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"
Jul 17 11:05:44.840929 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.840595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88" event={"ID":"7976f725-13c6-44df-a6d6-ff3038e4e128","Type":"ContainerDied","Data":"823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7"}
Jul 17 11:05:44.840929 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.840634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88" event={"ID":"7976f725-13c6-44df-a6d6-ff3038e4e128","Type":"ContainerDied","Data":"3d585a93d9cc6f5c98d329c5b9925f38dd0461e84de47fcf54f229db031eb67e"}
Jul 17 11:05:44.840929 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.840655    2564 scope.go:117] "RemoveContainer" containerID="823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7"
Jul 17 11:05:44.848825 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.848810    2564 scope.go:117] "RemoveContainer" containerID="823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7"
Jul 17 11:05:44.849072 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:05:44.849052    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7\": container with ID starting with 823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7 not found: ID does not exist" containerID="823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7"
Jul 17 11:05:44.849139 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.849084    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7"} err="failed to get container status \"823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7\": rpc error: code = NotFound desc = could not find container \"823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7\": container with ID starting with 823f4a87cc586a50495f0deee8bc0ab66e6fdb5cad8015938c0b0a55cafc6ca7 not found: ID does not exist"
Jul 17 11:05:44.863375 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.863351    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"]
Jul 17 11:05:44.869525 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:44.869506    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lww88"]
Jul 17 11:05:45.716272 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:05:45.716240    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7976f725-13c6-44df-a6d6-ff3038e4e128" path="/var/lib/kubelet/pods/7976f725-13c6-44df-a6d6-ff3038e4e128/volumes"
Jul 17 11:06:04.974027 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:04.973998    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:04.974502 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:04.974484    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7976f725-13c6-44df-a6d6-ff3038e4e128" containerName="manager"
Jul 17 11:06:04.974583 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:04.974506    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7976f725-13c6-44df-a6d6-ff3038e4e128" containerName="manager"
Jul 17 11:06:04.974633 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:04.974612    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7976f725-13c6-44df-a6d6-ff3038e4e128" containerName="manager"
Jul 17 11:06:05.001089 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.001060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:05.001243 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.001175    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.007220 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.007192    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 11:06:05.078470 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.078438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:05.108408 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.108342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbtlc\" (UniqueName: \"kubernetes.io/projected/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-kube-api-access-jbtlc\") pod \"limitador-limitador-64c94fd64f-n7pck\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.108408 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.108400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-config-file\") pod \"limitador-limitador-64c94fd64f-n7pck\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.209470 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.209444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-config-file\") pod \"limitador-limitador-64c94fd64f-n7pck\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.209584 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.209508    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbtlc\" (UniqueName: \"kubernetes.io/projected/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-kube-api-access-jbtlc\") pod \"limitador-limitador-64c94fd64f-n7pck\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.210048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.210027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-config-file\") pod \"limitador-limitador-64c94fd64f-n7pck\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.219446 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.219418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbtlc\" (UniqueName: \"kubernetes.io/projected/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-kube-api-access-jbtlc\") pod \"limitador-limitador-64c94fd64f-n7pck\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.310894 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.310867    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:05.453505 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.453477    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:05.456548 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:06:05.456522    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a6efeb_dc1a_4a6f_a0f7_83dc01e28f88.slice/crio-ea2f86c9dbbdae7367b51922bac6a08d91876f3b5f94dc36eb54bf7e326c0ae7 WatchSource:0}: Error finding container ea2f86c9dbbdae7367b51922bac6a08d91876f3b5f94dc36eb54bf7e326c0ae7: Status 404 returned error can't find the container with id ea2f86c9dbbdae7367b51922bac6a08d91876f3b5f94dc36eb54bf7e326c0ae7
Jul 17 11:06:05.933506 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:05.933467    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck" event={"ID":"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88","Type":"ContainerStarted","Data":"ea2f86c9dbbdae7367b51922bac6a08d91876f3b5f94dc36eb54bf7e326c0ae7"}
Jul 17 11:06:06.040261 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.040226    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-td2lf"]
Jul 17 11:06:06.043657 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.043638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:06.047720 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.047695    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qm856\""
Jul 17 11:06:06.060258 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.060231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-td2lf"]
Jul 17 11:06:06.114763 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.114728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fh8\" (UniqueName: \"kubernetes.io/projected/ab6b3956-d70b-48c0-a696-daf9bbcdcb86-kube-api-access-f4fh8\") pod \"authorino-75d556bd77-td2lf\" (UID: \"ab6b3956-d70b-48c0-a696-daf9bbcdcb86\") " pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:06.216294 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.216123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fh8\" (UniqueName: \"kubernetes.io/projected/ab6b3956-d70b-48c0-a696-daf9bbcdcb86-kube-api-access-f4fh8\") pod \"authorino-75d556bd77-td2lf\" (UID: \"ab6b3956-d70b-48c0-a696-daf9bbcdcb86\") " pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:06.230443 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.230410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fh8\" (UniqueName: \"kubernetes.io/projected/ab6b3956-d70b-48c0-a696-daf9bbcdcb86-kube-api-access-f4fh8\") pod \"authorino-75d556bd77-td2lf\" (UID: \"ab6b3956-d70b-48c0-a696-daf9bbcdcb86\") " pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:06.354840 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.354805    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:06.522611 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.522579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-td2lf"]
Jul 17 11:06:06.524409 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:06:06.524371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab6b3956_d70b_48c0_a696_daf9bbcdcb86.slice/crio-ea3f740c223d48bcb05853af43a61b829fcbf71f1bc4d27d582ccab9c7745ce5 WatchSource:0}: Error finding container ea3f740c223d48bcb05853af43a61b829fcbf71f1bc4d27d582ccab9c7745ce5: Status 404 returned error can't find the container with id ea3f740c223d48bcb05853af43a61b829fcbf71f1bc4d27d582ccab9c7745ce5
Jul 17 11:06:06.939754 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:06.939721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-td2lf" event={"ID":"ab6b3956-d70b-48c0-a696-daf9bbcdcb86","Type":"ContainerStarted","Data":"ea3f740c223d48bcb05853af43a61b829fcbf71f1bc4d27d582ccab9c7745ce5"}
Jul 17 11:06:08.953665 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:08.953619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck" event={"ID":"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88","Type":"ContainerStarted","Data":"51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345"}
Jul 17 11:06:08.954131 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:08.953768    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:08.982435 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:08.982390    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck" podStartSLOduration=2.129803666 podStartE2EDuration="4.982377979s" totalImagesPullingTime="2.852574313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:08.980275282 +0000 UTC m=+523.738085723" watchObservedRunningTime="2026-07-17 11:06:08.982377979 +0000 UTC m=+523.740188397"
Jul 17 11:06:10.964327 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:10.964297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-td2lf" event={"ID":"ab6b3956-d70b-48c0-a696-daf9bbcdcb86","Type":"ContainerStarted","Data":"478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6"}
Jul 17 11:06:10.984846 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:10.984798    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-td2lf" podStartSLOduration=1.4734227610000001 podStartE2EDuration="4.984783891s" totalImagesPullingTime="3.51136113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:10.983664478 +0000 UTC m=+525.741474894" watchObservedRunningTime="2026-07-17 11:06:10.984783891 +0000 UTC m=+525.742594308"
Jul 17 11:06:19.952113 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:19.952029    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:19.952544 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:19.952259    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck" podUID="29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" containerName="limitador" containerID="cri-o://51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345" gracePeriod=30
Jul 17 11:06:19.952909 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:19.952890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:20.493908 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.493884    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:20.635297 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.635235    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-config-file\") pod \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") "
Jul 17 11:06:20.635413 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.635307    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbtlc\" (UniqueName: \"kubernetes.io/projected/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-kube-api-access-jbtlc\") pod \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\" (UID: \"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88\") "
Jul 17 11:06:20.635571 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.635540    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-config-file" (OuterVolumeSpecName: "config-file") pod "29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" (UID: "29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:06:20.637192 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.637172    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-kube-api-access-jbtlc" (OuterVolumeSpecName: "kube-api-access-jbtlc") pod "29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" (UID: "29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88"). InnerVolumeSpecName "kube-api-access-jbtlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:06:20.736417 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.736390    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbtlc\" (UniqueName: \"kubernetes.io/projected/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-kube-api-access-jbtlc\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:06:20.736417 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:20.736415    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88-config-file\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:06:21.007908 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.007879    2564 generic.go:356] "Generic (PLEG): container finished" podID="29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" containerID="51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345" exitCode=0
Jul 17 11:06:21.008266 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.007920    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck"
Jul 17 11:06:21.008266 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.007928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck" event={"ID":"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88","Type":"ContainerDied","Data":"51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345"}
Jul 17 11:06:21.008266 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.008004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n7pck" event={"ID":"29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88","Type":"ContainerDied","Data":"ea2f86c9dbbdae7367b51922bac6a08d91876f3b5f94dc36eb54bf7e326c0ae7"}
Jul 17 11:06:21.008266 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.008034    2564 scope.go:117] "RemoveContainer" containerID="51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345"
Jul 17 11:06:21.016295 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.016272    2564 scope.go:117] "RemoveContainer" containerID="51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345"
Jul 17 11:06:21.016552 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:06:21.016530    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345\": container with ID starting with 51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345 not found: ID does not exist" containerID="51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345"
Jul 17 11:06:21.016610 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.016560    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345"} err="failed to get container status \"51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345\": rpc error: code = NotFound desc = could not find container \"51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345\": container with ID starting with 51f036e331534405807983ca0b2fa3b9c1dbde805c29cdf64df1a10401509345 not found: ID does not exist"
Jul 17 11:06:21.034303 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.034284    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:21.041923 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.041899    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n7pck"]
Jul 17 11:06:21.720085 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:21.716962    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" path="/var/lib/kubelet/pods/29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88/volumes"
Jul 17 11:06:22.988540 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.988511    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"]
Jul 17 11:06:22.988886 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.988841    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" containerName="limitador"
Jul 17 11:06:22.988886 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.988851    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" containerName="limitador"
Jul 17 11:06:22.988991 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.988910    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a6efeb-dc1a-4a6f-a0f7-83dc01e28f88" containerName="limitador"
Jul 17 11:06:22.991433 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.991417    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:22.996852 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.996830    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 11:06:22.997242 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.997223    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:06:22.998283 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.998255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 11:06:22.998283 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:22.998266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-kclmx\""
Jul 17 11:06:23.004149 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.004128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"]
Jul 17 11:06:23.155806 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.155764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ea0c3e36-07fb-49ff-997b-6e097b4bf2b7-data\") pod \"postgres-69fb4594cf-h58qc\" (UID: \"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.155995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.155837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlk8\" (UniqueName: \"kubernetes.io/projected/ea0c3e36-07fb-49ff-997b-6e097b4bf2b7-kube-api-access-hrlk8\") pod \"postgres-69fb4594cf-h58qc\" (UID: \"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.257141 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.257073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlk8\" (UniqueName: \"kubernetes.io/projected/ea0c3e36-07fb-49ff-997b-6e097b4bf2b7-kube-api-access-hrlk8\") pod \"postgres-69fb4594cf-h58qc\" (UID: \"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.257141 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.257133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ea0c3e36-07fb-49ff-997b-6e097b4bf2b7-data\") pod \"postgres-69fb4594cf-h58qc\" (UID: \"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.257500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.257481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ea0c3e36-07fb-49ff-997b-6e097b4bf2b7-data\") pod \"postgres-69fb4594cf-h58qc\" (UID: \"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.268231 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.268209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlk8\" (UniqueName: \"kubernetes.io/projected/ea0c3e36-07fb-49ff-997b-6e097b4bf2b7-kube-api-access-hrlk8\") pod \"postgres-69fb4594cf-h58qc\" (UID: \"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.300976 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.300955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:23.451491 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:23.451449    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"]
Jul 17 11:06:23.453693 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:06:23.453665    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0c3e36_07fb_49ff_997b_6e097b4bf2b7.slice/crio-759ae85ab3e8ac7c0e6fc5c90723076516102ec1c66d63929fc81819fcfd1a07 WatchSource:0}: Error finding container 759ae85ab3e8ac7c0e6fc5c90723076516102ec1c66d63929fc81819fcfd1a07: Status 404 returned error can't find the container with id 759ae85ab3e8ac7c0e6fc5c90723076516102ec1c66d63929fc81819fcfd1a07
Jul 17 11:06:24.024676 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:24.024641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc" event={"ID":"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7","Type":"ContainerStarted","Data":"759ae85ab3e8ac7c0e6fc5c90723076516102ec1c66d63929fc81819fcfd1a07"}
Jul 17 11:06:28.071777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:28.071755    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 11:06:29.054491 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:29.054453    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc" event={"ID":"ea0c3e36-07fb-49ff-997b-6e097b4bf2b7","Type":"ContainerStarted","Data":"2bdb5e0a6cedbcaef4419a5c9b98f283fe09f54b780b66b2211f588636a3d12d"}
Jul 17 11:06:29.054692 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:29.054597    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:29.085205 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:29.085160    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc" podStartSLOduration=2.471394476 podStartE2EDuration="7.085145878s" totalImagesPullingTime="4.613751402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:29.083510792 +0000 UTC m=+543.841321211" watchObservedRunningTime="2026-07-17 11:06:29.085145878 +0000 UTC m=+543.842956295"
Jul 17 11:06:35.086752 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:35.086721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h58qc"
Jul 17 11:06:38.300545 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:38.300513    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-td2lf"]
Jul 17 11:06:38.301353 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:38.300759    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-td2lf" podUID="ab6b3956-d70b-48c0-a696-daf9bbcdcb86" containerName="authorino" containerID="cri-o://478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6" gracePeriod=30
Jul 17 11:06:39.094098 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.094068    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:39.095174 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.095151    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab6b3956-d70b-48c0-a696-daf9bbcdcb86" containerID="478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6" exitCode=0
Jul 17 11:06:39.095273 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.095225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-td2lf" event={"ID":"ab6b3956-d70b-48c0-a696-daf9bbcdcb86","Type":"ContainerDied","Data":"478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6"}
Jul 17 11:06:39.095273 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.095267    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-td2lf" event={"ID":"ab6b3956-d70b-48c0-a696-daf9bbcdcb86","Type":"ContainerDied","Data":"ea3f740c223d48bcb05853af43a61b829fcbf71f1bc4d27d582ccab9c7745ce5"}
Jul 17 11:06:39.095346 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.095288    2564 scope.go:117] "RemoveContainer" containerID="478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6"
Jul 17 11:06:39.102916 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.102900    2564 scope.go:117] "RemoveContainer" containerID="478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6"
Jul 17 11:06:39.103185 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:06:39.103169    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6\": container with ID starting with 478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6 not found: ID does not exist" containerID="478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6"
Jul 17 11:06:39.103245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.103196    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6"} err="failed to get container status \"478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6\": rpc error: code = NotFound desc = could not find container \"478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6\": container with ID starting with 478ef3202121d5629dd345c3fc378ab3559affb38dcf50dc6b6f6cfa1994ade6 not found: ID does not exist"
Jul 17 11:06:39.189682 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.189648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4fh8\" (UniqueName: \"kubernetes.io/projected/ab6b3956-d70b-48c0-a696-daf9bbcdcb86-kube-api-access-f4fh8\") pod \"ab6b3956-d70b-48c0-a696-daf9bbcdcb86\" (UID: \"ab6b3956-d70b-48c0-a696-daf9bbcdcb86\") "
Jul 17 11:06:39.191785 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.191728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6b3956-d70b-48c0-a696-daf9bbcdcb86-kube-api-access-f4fh8" (OuterVolumeSpecName: "kube-api-access-f4fh8") pod "ab6b3956-d70b-48c0-a696-daf9bbcdcb86" (UID: "ab6b3956-d70b-48c0-a696-daf9bbcdcb86"). InnerVolumeSpecName "kube-api-access-f4fh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:06:39.290993 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:39.290923    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4fh8\" (UniqueName: \"kubernetes.io/projected/ab6b3956-d70b-48c0-a696-daf9bbcdcb86-kube-api-access-f4fh8\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:06:40.100134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:40.100063    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-td2lf"
Jul 17 11:06:40.126118 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:40.126083    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-td2lf"]
Jul 17 11:06:40.130265 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:40.130235    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-td2lf"]
Jul 17 11:06:41.715401 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:41.715372    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6b3956-d70b-48c0-a696-daf9bbcdcb86" path="/var/lib/kubelet/pods/ab6b3956-d70b-48c0-a696-daf9bbcdcb86/volumes"
Jul 17 11:06:43.611751 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.611719    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b996c9c89-4tpgn"]
Jul 17 11:06:43.612107 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.612055    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6b3956-d70b-48c0-a696-daf9bbcdcb86" containerName="authorino"
Jul 17 11:06:43.612107 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.612067    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6b3956-d70b-48c0-a696-daf9bbcdcb86" containerName="authorino"
Jul 17 11:06:43.612176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.612133    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6b3956-d70b-48c0-a696-daf9bbcdcb86" containerName="authorino"
Jul 17 11:06:43.618237 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.618218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:43.632454 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.632422    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:06:43.632454 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.632439    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:06:43.633362 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.633346    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9s7h\""
Jul 17 11:06:43.661694 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.661674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b996c9c89-4tpgn"]
Jul 17 11:06:43.726318 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.726295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:43.726461 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.726339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgcl\" (UniqueName: \"kubernetes.io/projected/e8477df9-a5db-4811-96ac-830505b9a234-kube-api-access-czgcl\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:43.809609 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.809576    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7858c79586-v2hmp"]
Jul 17 11:06:43.811877 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.811861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:43.827386 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.827345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:43.827556 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.827420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czgcl\" (UniqueName: \"kubernetes.io/projected/e8477df9-a5db-4811-96ac-830505b9a234-kube-api-access-czgcl\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:43.827656 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:06:43.827557    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 17 11:06:43.827656 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:06:43.827628    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert podName:e8477df9-a5db-4811-96ac-830505b9a234 nodeName:}" failed. No retries permitted until 2026-07-17 11:06:44.327607045 +0000 UTC m=+559.085417455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert") pod "maas-controller-6b996c9c89-4tpgn" (UID: "e8477df9-a5db-4811-96ac-830505b9a234") : secret "maas-controller-webhook-cert" not found
Jul 17 11:06:43.829974 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.829953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7858c79586-v2hmp"]
Jul 17 11:06:43.842673 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.842631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgcl\" (UniqueName: \"kubernetes.io/projected/e8477df9-a5db-4811-96ac-830505b9a234-kube-api-access-czgcl\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:43.928629 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.928602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2sc\" (UniqueName: \"kubernetes.io/projected/44c65566-0f49-47c3-8c59-0428a07897aa-kube-api-access-bg2sc\") pod \"maas-controller-7858c79586-v2hmp\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") " pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:43.928796 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:43.928660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44c65566-0f49-47c3-8c59-0428a07897aa-webhook-cert\") pod \"maas-controller-7858c79586-v2hmp\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") " pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:44.029627 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.029593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44c65566-0f49-47c3-8c59-0428a07897aa-webhook-cert\") pod \"maas-controller-7858c79586-v2hmp\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") " pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:44.029797 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.029664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2sc\" (UniqueName: \"kubernetes.io/projected/44c65566-0f49-47c3-8c59-0428a07897aa-kube-api-access-bg2sc\") pod \"maas-controller-7858c79586-v2hmp\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") " pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:44.031911 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.031883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44c65566-0f49-47c3-8c59-0428a07897aa-webhook-cert\") pod \"maas-controller-7858c79586-v2hmp\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") " pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:44.040778 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.040755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2sc\" (UniqueName: \"kubernetes.io/projected/44c65566-0f49-47c3-8c59-0428a07897aa-kube-api-access-bg2sc\") pod \"maas-controller-7858c79586-v2hmp\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") " pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:44.121656 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.121633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:44.257289 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.257264    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7858c79586-v2hmp"]
Jul 17 11:06:44.259615 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:06:44.259585    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c65566_0f49_47c3_8c59_0428a07897aa.slice/crio-df95965ac1d55624f634cdbf5f0da8f643e2171696b2a97ff5dba0053d482992 WatchSource:0}: Error finding container df95965ac1d55624f634cdbf5f0da8f643e2171696b2a97ff5dba0053d482992: Status 404 returned error can't find the container with id df95965ac1d55624f634cdbf5f0da8f643e2171696b2a97ff5dba0053d482992
Jul 17 11:06:44.332246 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.332220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:44.334481 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.334464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert\") pod \"maas-controller-6b996c9c89-4tpgn\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") " pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:44.533144 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.533070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:44.661083 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:44.661061    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b996c9c89-4tpgn"]
Jul 17 11:06:44.663215 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:06:44.663193    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8477df9_a5db_4811_96ac_830505b9a234.slice/crio-d77f223724458f7d936214bc8b7b4de3ee8a6f5852aeb40b556c0e0c1722cf05 WatchSource:0}: Error finding container d77f223724458f7d936214bc8b7b4de3ee8a6f5852aeb40b556c0e0c1722cf05: Status 404 returned error can't find the container with id d77f223724458f7d936214bc8b7b4de3ee8a6f5852aeb40b556c0e0c1722cf05
Jul 17 11:06:45.127712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:45.127674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b996c9c89-4tpgn" event={"ID":"e8477df9-a5db-4811-96ac-830505b9a234","Type":"ContainerStarted","Data":"d77f223724458f7d936214bc8b7b4de3ee8a6f5852aeb40b556c0e0c1722cf05"}
Jul 17 11:06:45.130123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:45.130093    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-v2hmp" event={"ID":"44c65566-0f49-47c3-8c59-0428a07897aa","Type":"ContainerStarted","Data":"df95965ac1d55624f634cdbf5f0da8f643e2171696b2a97ff5dba0053d482992"}
Jul 17 11:06:47.141441 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:47.141409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b996c9c89-4tpgn" event={"ID":"e8477df9-a5db-4811-96ac-830505b9a234","Type":"ContainerStarted","Data":"b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5"}
Jul 17 11:06:47.141882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:47.141523    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:47.143006 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:47.142980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-v2hmp" event={"ID":"44c65566-0f49-47c3-8c59-0428a07897aa","Type":"ContainerStarted","Data":"bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b"}
Jul 17 11:06:47.143111 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:47.143057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:47.382795 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:47.382696    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7858c79586-v2hmp" podStartSLOduration=1.7259749100000001 podStartE2EDuration="4.38268124s" totalImagesPullingTime="2.65670633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:47.381570985 +0000 UTC m=+562.139381425" watchObservedRunningTime="2026-07-17 11:06:47.38268124 +0000 UTC m=+562.140491657"
Jul 17 11:06:47.383293 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:47.383267    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b996c9c89-4tpgn" podStartSLOduration=2.120986739 podStartE2EDuration="4.383257561s" totalImagesPullingTime="2.262270822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:06:47.221030295 +0000 UTC m=+561.978840712" watchObservedRunningTime="2026-07-17 11:06:47.383257561 +0000 UTC m=+562.141068018"
Jul 17 11:06:58.150813 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.150786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:06:58.151346 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.150862    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:58.237715 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.237679    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b996c9c89-4tpgn"]
Jul 17 11:06:58.237958 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.237889    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b996c9c89-4tpgn" podUID="e8477df9-a5db-4811-96ac-830505b9a234" containerName="manager" containerID="cri-o://b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5" gracePeriod=30
Jul 17 11:06:58.485399 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.485377    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:58.552570 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.552544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czgcl\" (UniqueName: \"kubernetes.io/projected/e8477df9-a5db-4811-96ac-830505b9a234-kube-api-access-czgcl\") pod \"e8477df9-a5db-4811-96ac-830505b9a234\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") "
Jul 17 11:06:58.552683 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.552622    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert\") pod \"e8477df9-a5db-4811-96ac-830505b9a234\" (UID: \"e8477df9-a5db-4811-96ac-830505b9a234\") "
Jul 17 11:06:58.554634 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.554605    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e8477df9-a5db-4811-96ac-830505b9a234" (UID: "e8477df9-a5db-4811-96ac-830505b9a234"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:06:58.554730 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.554646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8477df9-a5db-4811-96ac-830505b9a234-kube-api-access-czgcl" (OuterVolumeSpecName: "kube-api-access-czgcl") pod "e8477df9-a5db-4811-96ac-830505b9a234" (UID: "e8477df9-a5db-4811-96ac-830505b9a234"). InnerVolumeSpecName "kube-api-access-czgcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:06:58.653173 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.653151    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czgcl\" (UniqueName: \"kubernetes.io/projected/e8477df9-a5db-4811-96ac-830505b9a234-kube-api-access-czgcl\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:06:58.653173 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:58.653173    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8477df9-a5db-4811-96ac-830505b9a234-webhook-cert\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:06:59.204900 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.204867    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8477df9-a5db-4811-96ac-830505b9a234" containerID="b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5" exitCode=0
Jul 17 11:06:59.205305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.204908    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b996c9c89-4tpgn"
Jul 17 11:06:59.205305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.204910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b996c9c89-4tpgn" event={"ID":"e8477df9-a5db-4811-96ac-830505b9a234","Type":"ContainerDied","Data":"b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5"}
Jul 17 11:06:59.205305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.204997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b996c9c89-4tpgn" event={"ID":"e8477df9-a5db-4811-96ac-830505b9a234","Type":"ContainerDied","Data":"d77f223724458f7d936214bc8b7b4de3ee8a6f5852aeb40b556c0e0c1722cf05"}
Jul 17 11:06:59.205305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.205032    2564 scope.go:117] "RemoveContainer" containerID="b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5"
Jul 17 11:06:59.213785 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.213765    2564 scope.go:117] "RemoveContainer" containerID="b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5"
Jul 17 11:06:59.214068 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:06:59.214051    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5\": container with ID starting with b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5 not found: ID does not exist" containerID="b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5"
Jul 17 11:06:59.214125 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.214076    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5"} err="failed to get container status \"b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5\": rpc error: code = NotFound desc = could not find container \"b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5\": container with ID starting with b8d912cfdb0990512734685da49feaaa2f21536a8071a8a9a4f998cd6f4570e5 not found: ID does not exist"
Jul 17 11:06:59.230968 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.230925    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b996c9c89-4tpgn"]
Jul 17 11:06:59.238222 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.238203    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b996c9c89-4tpgn"]
Jul 17 11:06:59.715750 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:06:59.715712    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8477df9-a5db-4811-96ac-830505b9a234" path="/var/lib/kubelet/pods/e8477df9-a5db-4811-96ac-830505b9a234/volumes"
Jul 17 11:07:20.670017 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.669984    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"]
Jul 17 11:07:20.670434 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.670353    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8477df9-a5db-4811-96ac-830505b9a234" containerName="manager"
Jul 17 11:07:20.670434 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.670365    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8477df9-a5db-4811-96ac-830505b9a234" containerName="manager"
Jul 17 11:07:20.670507 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.670436    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8477df9-a5db-4811-96ac-830505b9a234" containerName="manager"
Jul 17 11:07:20.672455 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.672436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.677899 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.677878    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wf6jn\""
Jul 17 11:07:20.679037 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.679019    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 11:07:20.693263 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.693242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"]
Jul 17 11:07:20.834765 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.834723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-openshift-service-ca\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.834970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.834806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-maas-api-tls\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.834970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.834831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7grdn\" (UniqueName: \"kubernetes.io/projected/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-kube-api-access-7grdn\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.935709 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.935626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-maas-api-tls\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.935709 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.935667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7grdn\" (UniqueName: \"kubernetes.io/projected/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-kube-api-access-7grdn\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.935890 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.935731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-openshift-service-ca\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.936452 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.936431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-openshift-service-ca\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.937987 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.937964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-maas-api-tls\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:20.989758 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:20.989729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7grdn\" (UniqueName: \"kubernetes.io/projected/8a17ffe5-491e-4ceb-bc41-3d805b78fe62-kube-api-access-7grdn\") pod \"maas-api-7897454b47-t5xd9\" (UID: \"8a17ffe5-491e-4ceb-bc41-3d805b78fe62\") " pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:21.282021 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.281917    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:21.430980 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.430956    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"]
Jul 17 11:07:21.433917 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:07:21.433885    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a17ffe5_491e_4ceb_bc41_3d805b78fe62.slice/crio-f245b9c02efcb67b5e47911545faa7997ac9c07a587980d0a46f3c0b471400d4 WatchSource:0}: Error finding container f245b9c02efcb67b5e47911545faa7997ac9c07a587980d0a46f3c0b471400d4: Status 404 returned error can't find the container with id f245b9c02efcb67b5e47911545faa7997ac9c07a587980d0a46f3c0b471400d4
Jul 17 11:07:21.791997 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.791965    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-kfwdh"]
Jul 17 11:07:21.795277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.795259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:21.801048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.801015    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5wnnm\""
Jul 17 11:07:21.801203 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.801017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 11:07:21.812685 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.812661    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-kfwdh"]
Jul 17 11:07:21.886513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.886480    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-9qkps"]
Jul 17 11:07:21.889020 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.889001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:21.910510 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.910485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-9qkps"]
Jul 17 11:07:21.944660 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.944629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a20854fc-0992-41c4-8912-3b4672f95e02-plugins-config-volume\") pod \"payload-processing-5bf47cd988-kfwdh\" (UID: \"a20854fc-0992-41c4-8912-3b4672f95e02\") " pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:21.944761 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:21.944730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p696\" (UniqueName: \"kubernetes.io/projected/a20854fc-0992-41c4-8912-3b4672f95e02-kube-api-access-6p696\") pod \"payload-processing-5bf47cd988-kfwdh\" (UID: \"a20854fc-0992-41c4-8912-3b4672f95e02\") " pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:22.046079 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.045990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7knwr\" (UniqueName: \"kubernetes.io/projected/a91d0211-52a0-4dcf-81f1-50bd266ff108-kube-api-access-7knwr\") pod \"payload-pre-processing-7677b774bb-9qkps\" (UID: \"a91d0211-52a0-4dcf-81f1-50bd266ff108\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.046079 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.046048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p696\" (UniqueName: \"kubernetes.io/projected/a20854fc-0992-41c4-8912-3b4672f95e02-kube-api-access-6p696\") pod \"payload-processing-5bf47cd988-kfwdh\" (UID: \"a20854fc-0992-41c4-8912-3b4672f95e02\") " pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:22.046308 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.046101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a91d0211-52a0-4dcf-81f1-50bd266ff108-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-9qkps\" (UID: \"a91d0211-52a0-4dcf-81f1-50bd266ff108\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.046308 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.046207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a20854fc-0992-41c4-8912-3b4672f95e02-plugins-config-volume\") pod \"payload-processing-5bf47cd988-kfwdh\" (UID: \"a20854fc-0992-41c4-8912-3b4672f95e02\") " pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:22.046880 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.046858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a20854fc-0992-41c4-8912-3b4672f95e02-plugins-config-volume\") pod \"payload-processing-5bf47cd988-kfwdh\" (UID: \"a20854fc-0992-41c4-8912-3b4672f95e02\") " pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:22.059658 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.059631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p696\" (UniqueName: \"kubernetes.io/projected/a20854fc-0992-41c4-8912-3b4672f95e02-kube-api-access-6p696\") pod \"payload-processing-5bf47cd988-kfwdh\" (UID: \"a20854fc-0992-41c4-8912-3b4672f95e02\") " pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:22.106370 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.106344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:22.147532 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.147489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7knwr\" (UniqueName: \"kubernetes.io/projected/a91d0211-52a0-4dcf-81f1-50bd266ff108-kube-api-access-7knwr\") pod \"payload-pre-processing-7677b774bb-9qkps\" (UID: \"a91d0211-52a0-4dcf-81f1-50bd266ff108\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.147733 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.147565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a91d0211-52a0-4dcf-81f1-50bd266ff108-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-9qkps\" (UID: \"a91d0211-52a0-4dcf-81f1-50bd266ff108\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.148489 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.148464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a91d0211-52a0-4dcf-81f1-50bd266ff108-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-9qkps\" (UID: \"a91d0211-52a0-4dcf-81f1-50bd266ff108\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.160320 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.160292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7knwr\" (UniqueName: \"kubernetes.io/projected/a91d0211-52a0-4dcf-81f1-50bd266ff108-kube-api-access-7knwr\") pod \"payload-pre-processing-7677b774bb-9qkps\" (UID: \"a91d0211-52a0-4dcf-81f1-50bd266ff108\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.198755 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.198545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:22.297635 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.297077    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-kfwdh"]
Jul 17 11:07:22.298314 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:07:22.298285    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20854fc_0992_41c4_8912_3b4672f95e02.slice/crio-a643bccf2b9133e7571869e4a49ae75e4b8370025d17532427769957094246c5 WatchSource:0}: Error finding container a643bccf2b9133e7571869e4a49ae75e4b8370025d17532427769957094246c5: Status 404 returned error can't find the container with id a643bccf2b9133e7571869e4a49ae75e4b8370025d17532427769957094246c5
Jul 17 11:07:22.317795 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.317745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9" event={"ID":"8a17ffe5-491e-4ceb-bc41-3d805b78fe62","Type":"ContainerStarted","Data":"f245b9c02efcb67b5e47911545faa7997ac9c07a587980d0a46f3c0b471400d4"}
Jul 17 11:07:22.319105 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.319077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh" event={"ID":"a20854fc-0992-41c4-8912-3b4672f95e02","Type":"ContainerStarted","Data":"a643bccf2b9133e7571869e4a49ae75e4b8370025d17532427769957094246c5"}
Jul 17 11:07:22.385781 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:22.385753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-9qkps"]
Jul 17 11:07:22.388750 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:07:22.388720    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91d0211_52a0_4dcf_81f1_50bd266ff108.slice/crio-8041b343ab889a10076e620b883ecfaeff0ec31272bc8a445b79fe5d8dbcc1ce WatchSource:0}: Error finding container 8041b343ab889a10076e620b883ecfaeff0ec31272bc8a445b79fe5d8dbcc1ce: Status 404 returned error can't find the container with id 8041b343ab889a10076e620b883ecfaeff0ec31272bc8a445b79fe5d8dbcc1ce
Jul 17 11:07:23.325546 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:23.325509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9" event={"ID":"8a17ffe5-491e-4ceb-bc41-3d805b78fe62","Type":"ContainerStarted","Data":"0faa50170449447fe6e3f15c5e4aeedcda8ab35899d8dcf2a2bd55f7fffac38a"}
Jul 17 11:07:23.326051 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:23.325715    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:23.326739 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:23.326713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps" event={"ID":"a91d0211-52a0-4dcf-81f1-50bd266ff108","Type":"ContainerStarted","Data":"8041b343ab889a10076e620b883ecfaeff0ec31272bc8a445b79fe5d8dbcc1ce"}
Jul 17 11:07:23.348121 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:23.348076    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9" podStartSLOduration=1.644790258 podStartE2EDuration="3.348061676s" totalImagesPullingTime="1.703271418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:07:23.347066556 +0000 UTC m=+598.104876992" watchObservedRunningTime="2026-07-17 11:07:23.348061676 +0000 UTC m=+598.105872119"
Jul 17 11:07:25.341049 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:25.340967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh" event={"ID":"a20854fc-0992-41c4-8912-3b4672f95e02","Type":"ContainerStarted","Data":"be43d46f7d19ad3bf422320eb0c55d0948b12f6afa61d08f338423ac006ebf91"}
Jul 17 11:07:25.341465 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:25.341073    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:25.342640 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:25.342615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps" event={"ID":"a91d0211-52a0-4dcf-81f1-50bd266ff108","Type":"ContainerStarted","Data":"787654b9449f6f735f2c7928976da3101936508947ffa1cdee95c276ca6b372d"}
Jul 17 11:07:25.342737 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:25.342701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:25.363282 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:25.363241    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh" podStartSLOduration=1.750176777 podStartE2EDuration="4.363229065s" totalImagesPullingTime="2.613052288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:07:25.361385494 +0000 UTC m=+600.119195914" watchObservedRunningTime="2026-07-17 11:07:25.363229065 +0000 UTC m=+600.121039479"
Jul 17 11:07:29.340300 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:29.340271    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7897454b47-t5xd9"
Jul 17 11:07:29.364354 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:29.364303    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps" podStartSLOduration=5.832209293 podStartE2EDuration="8.364287875s" totalImagesPullingTime="2.532078582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:07:25.382185755 +0000 UTC m=+600.139996174" watchObservedRunningTime="2026-07-17 11:07:29.364287875 +0000 UTC m=+604.122098295"
Jul 17 11:07:36.349436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:36.349404    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-9qkps"
Jul 17 11:07:36.349803 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:36.349490    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-kfwdh"
Jul 17 11:07:41.510705 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.510649    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"]
Jul 17 11:07:41.513983 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.513964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.517845 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.517827    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-db62k\""
Jul 17 11:07:41.518857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.518840    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 11:07:41.518928 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.518859    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 11:07:41.518928 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.518845    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 11:07:41.528579 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.528553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"]
Jul 17 11:07:41.593775 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.593750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.593901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.593778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2x9\" (UniqueName: \"kubernetes.io/projected/48bd96b7-9cca-4bf7-a4d6-0a4166925181-kube-api-access-qf2x9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.593901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.593807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.594029 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.593905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48bd96b7-9cca-4bf7-a4d6-0a4166925181-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.594029 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.593926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.594119 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.594032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695243 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48bd96b7-9cca-4bf7-a4d6-0a4166925181-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695243 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2x9\" (UniqueName: \"kubernetes.io/projected/48bd96b7-9cca-4bf7-a4d6-0a4166925181-kube-api-access-qf2x9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695775 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695846 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.695846 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.695797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.697520 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.697487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48bd96b7-9cca-4bf7-a4d6-0a4166925181-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.697639 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.697622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48bd96b7-9cca-4bf7-a4d6-0a4166925181-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.705830 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.705809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2x9\" (UniqueName: \"kubernetes.io/projected/48bd96b7-9cca-4bf7-a4d6-0a4166925181-kube-api-access-qf2x9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd\" (UID: \"48bd96b7-9cca-4bf7-a4d6-0a4166925181\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.826182 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.826107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:41.957551 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.957525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"]
Jul 17 11:07:41.959507 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:07:41.959483    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48bd96b7_9cca_4bf7_a4d6_0a4166925181.slice/crio-cd0cfdc2c61b5b65412587015714d13b3884fb6bd05822192afa1782cc584e21 WatchSource:0}: Error finding container cd0cfdc2c61b5b65412587015714d13b3884fb6bd05822192afa1782cc584e21: Status 404 returned error can't find the container with id cd0cfdc2c61b5b65412587015714d13b3884fb6bd05822192afa1782cc584e21
Jul 17 11:07:41.960902 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:41.960883    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:07:42.431129 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:42.431088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd" event={"ID":"48bd96b7-9cca-4bf7-a4d6-0a4166925181","Type":"ContainerStarted","Data":"cd0cfdc2c61b5b65412587015714d13b3884fb6bd05822192afa1782cc584e21"}
Jul 17 11:07:43.437522 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:43.437492    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd" event={"ID":"48bd96b7-9cca-4bf7-a4d6-0a4166925181","Type":"ContainerStarted","Data":"78a22e290ac36d007a12cbcdd6c2d60745405d9ca795cd5c9940db3ed5f1c4b3"}
Jul 17 11:07:43.462555 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:43.462506    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd" podStartSLOduration=1.331033142 podStartE2EDuration="2.462491211s" totalImagesPullingTime="1.131458069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:07:43.460835463 +0000 UTC m=+618.218645916" watchObservedRunningTime="2026-07-17 11:07:43.462491211 +0000 UTC m=+618.220301689"
Jul 17 11:07:50.190524 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.190437    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"]
Jul 17 11:07:50.194118 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.194096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.197131 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.197106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 17 11:07:50.204904 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.204881    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"]
Jul 17 11:07:50.272240 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.272202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.272429 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.272252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.272429 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.272317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqh8z\" (UniqueName: \"kubernetes.io/projected/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-kube-api-access-fqh8z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.272429 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.272379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.272429 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.272419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.272599 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.272483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.373685 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.373643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.373863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.373695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.373863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.373718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.373863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.373744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqh8z\" (UniqueName: \"kubernetes.io/projected/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-kube-api-access-fqh8z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.373863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.373766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.374142 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.373911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.374199 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.374178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.374199 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.374189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.374344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.374326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.375898 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.375876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.376349 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.376332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.382908 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.382886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqh8z\" (UniqueName: \"kubernetes.io/projected/9d2c4d54-0fcf-45c3-ae42-914c3b064fd5-kube-api-access-fqh8z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d6sws\" (UID: \"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.505497 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.505412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:07:50.641243 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:50.641218    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"]
Jul 17 11:07:50.643266 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:07:50.643239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2c4d54_0fcf_45c3_ae42_914c3b064fd5.slice/crio-7cf436d72b16daa95478b928ad828b5c27b5718022952a5085b580adcd04b9d4 WatchSource:0}: Error finding container 7cf436d72b16daa95478b928ad828b5c27b5718022952a5085b580adcd04b9d4: Status 404 returned error can't find the container with id 7cf436d72b16daa95478b928ad828b5c27b5718022952a5085b580adcd04b9d4
Jul 17 11:07:51.477732 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:51.477696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws" event={"ID":"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5","Type":"ContainerStarted","Data":"50ba437c9430fb6f0828b9e00d1507f87dd031d209c565f00eb6d052ed89e984"}
Jul 17 11:07:51.478092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:51.477751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws" event={"ID":"9d2c4d54-0fcf-45c3-ae42-914c3b064fd5","Type":"ContainerStarted","Data":"7cf436d72b16daa95478b928ad828b5c27b5718022952a5085b580adcd04b9d4"}
Jul 17 11:07:51.506766 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:51.506710    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws" podStartSLOduration=1.3062408460000001 podStartE2EDuration="1.506694285s" totalImagesPullingTime="200.453439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:07:51.50584159 +0000 UTC m=+626.263652007" watchObservedRunningTime="2026-07-17 11:07:51.506694285 +0000 UTC m=+626.264504703"
Jul 17 11:07:51.827252 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:51.827167    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:51.827499 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:51.827482    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:51.841531 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:51.841501    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:07:52.493676 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:07:52.493645    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd"
Jul 17 11:08:00.506106 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:08:00.506071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:08:00.506532 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:08:00.506132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:08:00.523379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:08:00.523348    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:08:00.537193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:08:00.537171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d6sws"
Jul 17 11:10:05.094460 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.094420    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7858c79586-v2hmp"]
Jul 17 11:10:05.094837 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.094680    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7858c79586-v2hmp" podUID="44c65566-0f49-47c3-8c59-0428a07897aa" containerName="manager" containerID="cri-o://bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b" gracePeriod=30
Jul 17 11:10:05.342724 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.342702    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:10:05.460683 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.460658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg2sc\" (UniqueName: \"kubernetes.io/projected/44c65566-0f49-47c3-8c59-0428a07897aa-kube-api-access-bg2sc\") pod \"44c65566-0f49-47c3-8c59-0428a07897aa\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") "
Jul 17 11:10:05.460840 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.460693    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44c65566-0f49-47c3-8c59-0428a07897aa-webhook-cert\") pod \"44c65566-0f49-47c3-8c59-0428a07897aa\" (UID: \"44c65566-0f49-47c3-8c59-0428a07897aa\") "
Jul 17 11:10:05.462550 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.462515    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44c65566-0f49-47c3-8c59-0428a07897aa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "44c65566-0f49-47c3-8c59-0428a07897aa" (UID: "44c65566-0f49-47c3-8c59-0428a07897aa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:10:05.462650 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.462628    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c65566-0f49-47c3-8c59-0428a07897aa-kube-api-access-bg2sc" (OuterVolumeSpecName: "kube-api-access-bg2sc") pod "44c65566-0f49-47c3-8c59-0428a07897aa" (UID: "44c65566-0f49-47c3-8c59-0428a07897aa"). InnerVolumeSpecName "kube-api-access-bg2sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:10:05.561741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.561712    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg2sc\" (UniqueName: \"kubernetes.io/projected/44c65566-0f49-47c3-8c59-0428a07897aa-kube-api-access-bg2sc\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:10:05.561741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:05.561739    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44c65566-0f49-47c3-8c59-0428a07897aa-webhook-cert\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:10:06.119329 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.119244    2564 generic.go:356] "Generic (PLEG): container finished" podID="44c65566-0f49-47c3-8c59-0428a07897aa" containerID="bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b" exitCode=0
Jul 17 11:10:06.119329 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.119289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-v2hmp"
Jul 17 11:10:06.119806 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.119325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-v2hmp" event={"ID":"44c65566-0f49-47c3-8c59-0428a07897aa","Type":"ContainerDied","Data":"bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b"}
Jul 17 11:10:06.119806 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.119374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-v2hmp" event={"ID":"44c65566-0f49-47c3-8c59-0428a07897aa","Type":"ContainerDied","Data":"df95965ac1d55624f634cdbf5f0da8f643e2171696b2a97ff5dba0053d482992"}
Jul 17 11:10:06.119806 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.119395    2564 scope.go:117] "RemoveContainer" containerID="bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b"
Jul 17 11:10:06.127539 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.127525    2564 scope.go:117] "RemoveContainer" containerID="bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b"
Jul 17 11:10:06.127756 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:10:06.127738    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b\": container with ID starting with bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b not found: ID does not exist" containerID="bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b"
Jul 17 11:10:06.127795 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.127764    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b"} err="failed to get container status \"bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b\": rpc error: code = NotFound desc = could not find container \"bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b\": container with ID starting with bf0907b525b20c37965dd057456b74fd949192fceaf5dcaca7eddc151f3e960b not found: ID does not exist"
Jul 17 11:10:06.139703 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.139685    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7858c79586-v2hmp"]
Jul 17 11:10:06.145449 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:06.145431    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7858c79586-v2hmp"]
Jul 17 11:10:07.715616 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:10:07.715573    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c65566-0f49-47c3-8c59-0428a07897aa" path="/var/lib/kubelet/pods/44c65566-0f49-47c3-8c59-0428a07897aa/volumes"
Jul 17 11:11:06.996732 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:06.996670    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7858c79586-gchpk"]
Jul 17 11:11:06.997197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:06.997095    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44c65566-0f49-47c3-8c59-0428a07897aa" containerName="manager"
Jul 17 11:11:06.997197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:06.997109    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c65566-0f49-47c3-8c59-0428a07897aa" containerName="manager"
Jul 17 11:11:06.997197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:06.997176    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44c65566-0f49-47c3-8c59-0428a07897aa" containerName="manager"
Jul 17 11:11:07.000077 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.000062    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.002993 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.002965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9s7h\""
Jul 17 11:11:07.004135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.004105    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:11:07.004265 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.004160    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:11:07.009361 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.009330    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7858c79586-gchpk"]
Jul 17 11:11:07.035226 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.035202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvt6z\" (UniqueName: \"kubernetes.io/projected/b051d1f7-5375-4f4c-b320-30f8d1f91bca-kube-api-access-bvt6z\") pod \"maas-controller-7858c79586-gchpk\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") " pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.035318 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.035235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b051d1f7-5375-4f4c-b320-30f8d1f91bca-webhook-cert\") pod \"maas-controller-7858c79586-gchpk\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") " pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.135528 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.135503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b051d1f7-5375-4f4c-b320-30f8d1f91bca-webhook-cert\") pod \"maas-controller-7858c79586-gchpk\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") " pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.135617 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.135595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvt6z\" (UniqueName: \"kubernetes.io/projected/b051d1f7-5375-4f4c-b320-30f8d1f91bca-kube-api-access-bvt6z\") pod \"maas-controller-7858c79586-gchpk\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") " pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.137827 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.137804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b051d1f7-5375-4f4c-b320-30f8d1f91bca-webhook-cert\") pod \"maas-controller-7858c79586-gchpk\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") " pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.145591 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.145574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvt6z\" (UniqueName: \"kubernetes.io/projected/b051d1f7-5375-4f4c-b320-30f8d1f91bca-kube-api-access-bvt6z\") pod \"maas-controller-7858c79586-gchpk\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") " pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.310617 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.310559    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:07.439277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:07.439254    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7858c79586-gchpk"]
Jul 17 11:11:07.440860 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:11:07.440834    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb051d1f7_5375_4f4c_b320_30f8d1f91bca.slice/crio-fa21add316ca013ddbeff29f960c88bd11d78b3d99125aa4259f1abc72bf7220 WatchSource:0}: Error finding container fa21add316ca013ddbeff29f960c88bd11d78b3d99125aa4259f1abc72bf7220: Status 404 returned error can't find the container with id fa21add316ca013ddbeff29f960c88bd11d78b3d99125aa4259f1abc72bf7220
Jul 17 11:11:08.414269 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:08.414234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-gchpk" event={"ID":"b051d1f7-5375-4f4c-b320-30f8d1f91bca","Type":"ContainerStarted","Data":"8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369"}
Jul 17 11:11:08.414834 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:08.414288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-gchpk" event={"ID":"b051d1f7-5375-4f4c-b320-30f8d1f91bca","Type":"ContainerStarted","Data":"fa21add316ca013ddbeff29f960c88bd11d78b3d99125aa4259f1abc72bf7220"}
Jul 17 11:11:08.414834 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:08.414380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:08.434008 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:08.433961    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7858c79586-gchpk" podStartSLOduration=2.017735391 podStartE2EDuration="2.433946965s" totalImagesPullingTime="416.211574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:11:08.431772228 +0000 UTC m=+823.189582661" watchObservedRunningTime="2026-07-17 11:11:08.433946965 +0000 UTC m=+823.191757374"
Jul 17 11:11:19.421463 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:19.421436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:24.147678 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.147635    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7858c79586-gchpk"]
Jul 17 11:11:24.148160 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.147874    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7858c79586-gchpk" podUID="b051d1f7-5375-4f4c-b320-30f8d1f91bca" containerName="manager" containerID="cri-o://8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369" gracePeriod=30
Jul 17 11:11:24.397822 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.397757    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:24.483855 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.483823    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvt6z\" (UniqueName: \"kubernetes.io/projected/b051d1f7-5375-4f4c-b320-30f8d1f91bca-kube-api-access-bvt6z\") pod \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") "
Jul 17 11:11:24.484055 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.483897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b051d1f7-5375-4f4c-b320-30f8d1f91bca-webhook-cert\") pod \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\" (UID: \"b051d1f7-5375-4f4c-b320-30f8d1f91bca\") "
Jul 17 11:11:24.485882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.485856    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b051d1f7-5375-4f4c-b320-30f8d1f91bca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b051d1f7-5375-4f4c-b320-30f8d1f91bca" (UID: "b051d1f7-5375-4f4c-b320-30f8d1f91bca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:11:24.485882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.485873    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b051d1f7-5375-4f4c-b320-30f8d1f91bca-kube-api-access-bvt6z" (OuterVolumeSpecName: "kube-api-access-bvt6z") pod "b051d1f7-5375-4f4c-b320-30f8d1f91bca" (UID: "b051d1f7-5375-4f4c-b320-30f8d1f91bca"). InnerVolumeSpecName "kube-api-access-bvt6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:11:24.494754 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.494726    2564 generic.go:356] "Generic (PLEG): container finished" podID="b051d1f7-5375-4f4c-b320-30f8d1f91bca" containerID="8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369" exitCode=0
Jul 17 11:11:24.494870 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.494777    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-gchpk"
Jul 17 11:11:24.494870 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.494779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-gchpk" event={"ID":"b051d1f7-5375-4f4c-b320-30f8d1f91bca","Type":"ContainerDied","Data":"8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369"}
Jul 17 11:11:24.494870 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.494836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-gchpk" event={"ID":"b051d1f7-5375-4f4c-b320-30f8d1f91bca","Type":"ContainerDied","Data":"fa21add316ca013ddbeff29f960c88bd11d78b3d99125aa4259f1abc72bf7220"}
Jul 17 11:11:24.494870 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.494859    2564 scope.go:117] "RemoveContainer" containerID="8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369"
Jul 17 11:11:24.505359 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.505341    2564 scope.go:117] "RemoveContainer" containerID="8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369"
Jul 17 11:11:24.505626 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:11:24.505609    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369\": container with ID starting with 8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369 not found: ID does not exist" containerID="8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369"
Jul 17 11:11:24.505666 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.505634    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369"} err="failed to get container status \"8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369\": rpc error: code = NotFound desc = could not find container \"8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369\": container with ID starting with 8f27466c67aae23843009616df9e0c35705aff7e075ead57a4cb3a79247d4369 not found: ID does not exist"
Jul 17 11:11:24.521067 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.521047    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7858c79586-gchpk"]
Jul 17 11:11:24.522725 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.522706    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7858c79586-gchpk"]
Jul 17 11:11:24.584890 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.584863    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b051d1f7-5375-4f4c-b320-30f8d1f91bca-webhook-cert\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:11:24.584995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:24.584891    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvt6z\" (UniqueName: \"kubernetes.io/projected/b051d1f7-5375-4f4c-b320-30f8d1f91bca-kube-api-access-bvt6z\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:11:25.419637 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.419604    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7858c79586-t7l9l"]
Jul 17 11:11:25.420030 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.420015    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b051d1f7-5375-4f4c-b320-30f8d1f91bca" containerName="manager"
Jul 17 11:11:25.420089 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.420033    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b051d1f7-5375-4f4c-b320-30f8d1f91bca" containerName="manager"
Jul 17 11:11:25.420124 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.420094    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b051d1f7-5375-4f4c-b320-30f8d1f91bca" containerName="manager"
Jul 17 11:11:25.424428 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.424411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.428026 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.428006    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:11:25.428144 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.428051    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:11:25.428144 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.428051    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9s7h\""
Jul 17 11:11:25.433910 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.433884    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7858c79586-t7l9l"]
Jul 17 11:11:25.492510 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.492479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5aed11-bc14-462c-b7fe-3d2cf2178353-webhook-cert\") pod \"maas-controller-7858c79586-t7l9l\" (UID: \"ea5aed11-bc14-462c-b7fe-3d2cf2178353\") " pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.492634 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.492570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvp4j\" (UniqueName: \"kubernetes.io/projected/ea5aed11-bc14-462c-b7fe-3d2cf2178353-kube-api-access-qvp4j\") pod \"maas-controller-7858c79586-t7l9l\" (UID: \"ea5aed11-bc14-462c-b7fe-3d2cf2178353\") " pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.593604 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.593575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvp4j\" (UniqueName: \"kubernetes.io/projected/ea5aed11-bc14-462c-b7fe-3d2cf2178353-kube-api-access-qvp4j\") pod \"maas-controller-7858c79586-t7l9l\" (UID: \"ea5aed11-bc14-462c-b7fe-3d2cf2178353\") " pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.593746 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.593635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5aed11-bc14-462c-b7fe-3d2cf2178353-webhook-cert\") pod \"maas-controller-7858c79586-t7l9l\" (UID: \"ea5aed11-bc14-462c-b7fe-3d2cf2178353\") " pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.596160 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.596141    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 11:11:25.603884 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.603856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvp4j\" (UniqueName: \"kubernetes.io/projected/ea5aed11-bc14-462c-b7fe-3d2cf2178353-kube-api-access-qvp4j\") pod \"maas-controller-7858c79586-t7l9l\" (UID: \"ea5aed11-bc14-462c-b7fe-3d2cf2178353\") " pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.605968 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.605931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5aed11-bc14-462c-b7fe-3d2cf2178353-webhook-cert\") pod \"maas-controller-7858c79586-t7l9l\" (UID: \"ea5aed11-bc14-462c-b7fe-3d2cf2178353\") " pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.716246 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.716169    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b051d1f7-5375-4f4c-b320-30f8d1f91bca" path="/var/lib/kubelet/pods/b051d1f7-5375-4f4c-b320-30f8d1f91bca/volumes"
Jul 17 11:11:25.737952 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.737910    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r9s7h\""
Jul 17 11:11:25.746008 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.745988    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:25.883361 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:25.883340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7858c79586-t7l9l"]
Jul 17 11:11:25.886069 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:11:25.886044    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5aed11_bc14_462c_b7fe_3d2cf2178353.slice/crio-ea0a4144c7a2bac528e7c4b84696b785582684c58c9917df0406694bf5e2559d WatchSource:0}: Error finding container ea0a4144c7a2bac528e7c4b84696b785582684c58c9917df0406694bf5e2559d: Status 404 returned error can't find the container with id ea0a4144c7a2bac528e7c4b84696b785582684c58c9917df0406694bf5e2559d
Jul 17 11:11:26.501184 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:26.501159    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 11:11:26.505870 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:26.505836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-t7l9l" event={"ID":"ea5aed11-bc14-462c-b7fe-3d2cf2178353","Type":"ContainerStarted","Data":"ea0a4144c7a2bac528e7c4b84696b785582684c58c9917df0406694bf5e2559d"}
Jul 17 11:11:27.512110 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:27.512075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7858c79586-t7l9l" event={"ID":"ea5aed11-bc14-462c-b7fe-3d2cf2178353","Type":"ContainerStarted","Data":"02ece18be80b6d9e64acca46fa3832ccb10ec621255e07bb4d017dcc3716fa55"}
Jul 17 11:11:27.512488 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:27.512170    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:11:27.557881 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:27.557834    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7858c79586-t7l9l" podStartSLOduration=1.946774765 podStartE2EDuration="2.557820471s" totalImagesPullingTime="611.045706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:11:27.557460468 +0000 UTC m=+842.315270887" watchObservedRunningTime="2026-07-17 11:11:27.557820471 +0000 UTC m=+842.315630889"
Jul 17 11:11:38.518722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:11:38.518688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7858c79586-t7l9l"
Jul 17 11:16:13.922644 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:13.922603    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"]
Jul 17 11:16:13.923260 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:13.922871    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p" podUID="aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" containerName="manager" containerID="cri-o://5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4" gracePeriod=10
Jul 17 11:16:17.170779 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.170758    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:16:17.318187 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.318111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-extensions-socket-volume\") pod \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") "
Jul 17 11:16:17.318187 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.318166    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4pmr\" (UniqueName: \"kubernetes.io/projected/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-kube-api-access-h4pmr\") pod \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\" (UID: \"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31\") "
Jul 17 11:16:17.318541 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.318517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" (UID: "aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:16:17.320194 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.320171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-kube-api-access-h4pmr" (OuterVolumeSpecName: "kube-api-access-h4pmr") pod "aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" (UID: "aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31"). InnerVolumeSpecName "kube-api-access-h4pmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:16:17.419624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.419593    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-extensions-socket-volume\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:16:17.419624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.419616    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4pmr\" (UniqueName: \"kubernetes.io/projected/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31-kube-api-access-h4pmr\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:16:17.875536 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.875499    2564 generic.go:356] "Generic (PLEG): container finished" podID="aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" containerID="5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4" exitCode=0
Jul 17 11:16:17.875717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.875545    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"
Jul 17 11:16:17.875717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.875582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p" event={"ID":"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31","Type":"ContainerDied","Data":"5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4"}
Jul 17 11:16:17.875717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.875637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p" event={"ID":"aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31","Type":"ContainerDied","Data":"20502a32edddf5ffbeb7349695727a8cbbd8357d41e1b89a424066bb1e5d14a7"}
Jul 17 11:16:17.875717 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.875661    2564 scope.go:117] "RemoveContainer" containerID="5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4"
Jul 17 11:16:17.885283 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.885264    2564 scope.go:117] "RemoveContainer" containerID="5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4"
Jul 17 11:16:17.885530 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:16:17.885511    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4\": container with ID starting with 5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4 not found: ID does not exist" containerID="5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4"
Jul 17 11:16:17.885593 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.885537    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4"} err="failed to get container status \"5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4\": rpc error: code = NotFound desc = could not find container \"5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4\": container with ID starting with 5bc4c83110febcbdcd04c1911e7f0e7e7c8be23153bd3bc3bf01c5f6dc65b1c4 not found: ID does not exist"
Jul 17 11:16:17.905503 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.905481    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"]
Jul 17 11:16:17.922732 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:17.922699    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g9v2p"]
Jul 17 11:16:19.715561 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:16:19.715528    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" path="/var/lib/kubelet/pods/aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31/volumes"
Jul 17 11:17:15.127264 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.127192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"]
Jul 17 11:17:15.127722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.127617    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" containerName="manager"
Jul 17 11:17:15.127722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.127635    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" containerName="manager"
Jul 17 11:17:15.127805 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.127734    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7ca52b-1520-44a1-8c2b-ebefd7c1cf31" containerName="manager"
Jul 17 11:17:15.130964 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.130926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.135624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.135604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zd2x4\""
Jul 17 11:17:15.144626 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.144604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"]
Jul 17 11:17:15.282240 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.282215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30c8b70c-5a70-4d01-9864-c32c3c0f5bec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qm52t\" (UID: \"30c8b70c-5a70-4d01-9864-c32c3c0f5bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.282361 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.282281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ph2\" (UniqueName: \"kubernetes.io/projected/30c8b70c-5a70-4d01-9864-c32c3c0f5bec-kube-api-access-s4ph2\") pod \"kuadrant-operator-controller-manager-86878c769f-qm52t\" (UID: \"30c8b70c-5a70-4d01-9864-c32c3c0f5bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.383632 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.383566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ph2\" (UniqueName: \"kubernetes.io/projected/30c8b70c-5a70-4d01-9864-c32c3c0f5bec-kube-api-access-s4ph2\") pod \"kuadrant-operator-controller-manager-86878c769f-qm52t\" (UID: \"30c8b70c-5a70-4d01-9864-c32c3c0f5bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.383632 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.383608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30c8b70c-5a70-4d01-9864-c32c3c0f5bec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qm52t\" (UID: \"30c8b70c-5a70-4d01-9864-c32c3c0f5bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.384022 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.384002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30c8b70c-5a70-4d01-9864-c32c3c0f5bec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qm52t\" (UID: \"30c8b70c-5a70-4d01-9864-c32c3c0f5bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.393137 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.393115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ph2\" (UniqueName: \"kubernetes.io/projected/30c8b70c-5a70-4d01-9864-c32c3c0f5bec-kube-api-access-s4ph2\") pod \"kuadrant-operator-controller-manager-86878c769f-qm52t\" (UID: \"30c8b70c-5a70-4d01-9864-c32c3c0f5bec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.441057 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.441027    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:15.573209 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:15.573184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"]
Jul 17 11:17:15.575451 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:17:15.575425    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c8b70c_5a70_4d01_9864_c32c3c0f5bec.slice/crio-37578f640db20c0cb769925d892d50cdd00acf092c86ce4b08377267aea53fab WatchSource:0}: Error finding container 37578f640db20c0cb769925d892d50cdd00acf092c86ce4b08377267aea53fab: Status 404 returned error can't find the container with id 37578f640db20c0cb769925d892d50cdd00acf092c86ce4b08377267aea53fab
Jul 17 11:17:16.149520 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:16.149480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t" event={"ID":"30c8b70c-5a70-4d01-9864-c32c3c0f5bec","Type":"ContainerStarted","Data":"45415e357df8fb003694e48d98efeea86215150872c59b9aea7ab747dc9e6d54"}
Jul 17 11:17:16.149891 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:16.149546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t" event={"ID":"30c8b70c-5a70-4d01-9864-c32c3c0f5bec","Type":"ContainerStarted","Data":"37578f640db20c0cb769925d892d50cdd00acf092c86ce4b08377267aea53fab"}
Jul 17 11:17:16.149891 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:16.149574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:17:16.170627 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:16.170580    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t" podStartSLOduration=1.170565339 podStartE2EDuration="1.170565339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:17:16.169500695 +0000 UTC m=+1190.927311145" watchObservedRunningTime="2026-07-17 11:17:16.170565339 +0000 UTC m=+1190.928375757"
Jul 17 11:17:27.157531 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:17:27.157497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qm52t"
Jul 17 11:23:22.554803 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.554762    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"]
Jul 17 11:23:22.558321 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.558301    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.560740 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.560713    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-829f05b9-serving-cert\""
Jul 17 11:23:22.568032 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.567900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"]
Jul 17 11:23:22.690077 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.690046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.690242 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.690087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x77mc\" (UniqueName: \"kubernetes.io/projected/536e8e9c-087a-4300-aa64-c76cc494f042-kube-api-access-x77mc\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.690242 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.690118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/536e8e9c-087a-4300-aa64-c76cc494f042-openshift-service-ca\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.790989 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.790924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.791157 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.791092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x77mc\" (UniqueName: \"kubernetes.io/projected/536e8e9c-087a-4300-aa64-c76cc494f042-kube-api-access-x77mc\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.791157 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.791131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/536e8e9c-087a-4300-aa64-c76cc494f042-openshift-service-ca\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.791277 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:22.791097    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-serving-cert: secret "maas-api-e2e-ait-829f05b9-serving-cert" not found
Jul 17 11:23:22.791277 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:22.791263    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls podName:536e8e9c-087a-4300-aa64-c76cc494f042 nodeName:}" failed. No retries permitted until 2026-07-17 11:23:23.291239912 +0000 UTC m=+1558.049050331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls") pod "maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" (UID: "536e8e9c-087a-4300-aa64-c76cc494f042") : secret "maas-api-e2e-ait-829f05b9-serving-cert" not found
Jul 17 11:23:22.791817 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.791798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/536e8e9c-087a-4300-aa64-c76cc494f042-openshift-service-ca\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:22.804164 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:22.804143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x77mc\" (UniqueName: \"kubernetes.io/projected/536e8e9c-087a-4300-aa64-c76cc494f042-kube-api-access-x77mc\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:23.295709 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:23.295666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:23.298327 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:23.298295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls\") pod \"maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:23.469623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:23.469591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:23.606893 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:23.606867    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"]
Jul 17 11:23:23.608959 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:23:23.608918    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536e8e9c_087a_4300_aa64_c76cc494f042.slice/crio-65536fbfebba62e221d368d68da745182208ce5b86f9e6e2443c8e3cd9526bd0 WatchSource:0}: Error finding container 65536fbfebba62e221d368d68da745182208ce5b86f9e6e2443c8e3cd9526bd0: Status 404 returned error can't find the container with id 65536fbfebba62e221d368d68da745182208ce5b86f9e6e2443c8e3cd9526bd0
Jul 17 11:23:23.610666 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:23.610646    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:23:23.881136 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:23.881057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerStarted","Data":"65536fbfebba62e221d368d68da745182208ce5b86f9e6e2443c8e3cd9526bd0"}
Jul 17 11:23:24.893991 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:24.893929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerStarted","Data":"d91da77c459b086b1da386c8252b28bab72fe08f2dba081ef76e955da22e1a65"}
Jul 17 11:23:24.894454 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:24.894059    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:24.913328 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:24.913290    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podStartSLOduration=1.9947799819999998 podStartE2EDuration="2.913276031s" totalImagesPullingTime="918.496049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:23:24.912612441 +0000 UTC m=+1559.670422858" watchObservedRunningTime="2026-07-17 11:23:24.913276031 +0000 UTC m=+1559.671086439"
Jul 17 11:23:25.900161 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:25.900125    2564 generic.go:356] "Generic (PLEG): container finished" podID="536e8e9c-087a-4300-aa64-c76cc494f042" containerID="d91da77c459b086b1da386c8252b28bab72fe08f2dba081ef76e955da22e1a65" exitCode=1
Jul 17 11:23:25.900500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:25.900161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"d91da77c459b086b1da386c8252b28bab72fe08f2dba081ef76e955da22e1a65"}
Jul 17 11:23:25.900500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:25.900359    2564 scope.go:117] "RemoveContainer" containerID="d91da77c459b086b1da386c8252b28bab72fe08f2dba081ef76e955da22e1a65"
Jul 17 11:23:26.906405 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:26.906375    2564 generic.go:356] "Generic (PLEG): container finished" podID="536e8e9c-087a-4300-aa64-c76cc494f042" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04" exitCode=1
Jul 17 11:23:26.906743 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:26.906455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"}
Jul 17 11:23:26.906743 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:26.906508    2564 scope.go:117] "RemoveContainer" containerID="d91da77c459b086b1da386c8252b28bab72fe08f2dba081ef76e955da22e1a65"
Jul 17 11:23:26.906743 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:26.906728    2564 scope.go:117] "RemoveContainer" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"
Jul 17 11:23:26.906929 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:26.906911    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:23:27.913115 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:27.913088    2564 scope.go:117] "RemoveContainer" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"
Jul 17 11:23:27.913459 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:27.913276    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:23:29.895108 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:29.895077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:29.895464 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:29.895384    2564 scope.go:117] "RemoveContainer" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"
Jul 17 11:23:29.895550 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:29.895532    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:23:33.469928 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:33.469895    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:33.470304 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:33.470266    2564 scope.go:117] "RemoveContainer" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"
Jul 17 11:23:33.470441 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:33.470420    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:23:44.710029 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:44.709997    2564 scope.go:117] "RemoveContainer" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"
Jul 17 11:23:46.001851 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:46.001820    2564 generic.go:356] "Generic (PLEG): container finished" podID="536e8e9c-087a-4300-aa64-c76cc494f042" containerID="e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6" exitCode=1
Jul 17 11:23:46.002280 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:46.001864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6"}
Jul 17 11:23:46.002280 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:46.001906    2564 scope.go:117] "RemoveContainer" containerID="85e1657c2ecf53daa637e37d0d986f45bbfdc6d4c0b03f099195e7e1a2818e04"
Jul 17 11:23:46.002280 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:46.002194    2564 scope.go:117] "RemoveContainer" containerID="e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6"
Jul 17 11:23:46.002394 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:46.002380    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:23:49.895010 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:49.894974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:49.895511 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:49.895355    2564 scope.go:117] "RemoveContainer" containerID="e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6"
Jul 17 11:23:49.895581 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:49.895556    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:23:53.470525 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:53.470494    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:23:53.471034 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:23:53.470840    2564 scope.go:117] "RemoveContainer" containerID="e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6"
Jul 17 11:23:53.471034 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:23:53.471017    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:05.714012 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:05.713972    2564 scope.go:117] "RemoveContainer" containerID="e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6"
Jul 17 11:24:07.104180 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:07.104146    2564 generic.go:356] "Generic (PLEG): container finished" podID="536e8e9c-087a-4300-aa64-c76cc494f042" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef" exitCode=1
Jul 17 11:24:07.104590 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:07.104219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"}
Jul 17 11:24:07.104590 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:07.104279    2564 scope.go:117] "RemoveContainer" containerID="e2a02a1f171911c0a66038d617f5f9315b51c94976bf8032db06527c1ef78fb6"
Jul 17 11:24:07.104693 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:07.104664    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:07.104868 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:07.104847    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:09.894886 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:09.894851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:24:09.895310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:09.895165    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:09.895352 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:09.895314    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:13.469998 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:13.469963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:24:13.470383 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:13.470299    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:13.470471 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:13.470451    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:25.712716 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:25.712684    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:25.713210 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:25.712897    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:38.710311 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:38.710280    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:38.710675 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:38.710438    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:49.710843 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:49.710811    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:50.310277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:50.310251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerStarted","Data":"50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"}
Jul 17 11:24:50.310463 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:50.310448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:24:51.317036 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:51.317004    2564 generic.go:356] "Generic (PLEG): container finished" podID="536e8e9c-087a-4300-aa64-c76cc494f042" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52" exitCode=1
Jul 17 11:24:51.317449 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:51.317092    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"}
Jul 17 11:24:51.317449 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:51.317151    2564 scope.go:117] "RemoveContainer" containerID="40116d02268735ea48f8255820bf2fa75b3ca73e728b2b00a12177fbf9a10eef"
Jul 17 11:24:51.317449 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:51.317346    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:24:51.317580 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:51.317519    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:52.324351 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:52.324325    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:24:52.324752 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:52.324495    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:24:53.469949 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:53.469900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:24:53.470312 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:24:53.470296    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:24:53.470476 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:24:53.470444    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:25:05.716405 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:25:05.716375    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:25:05.716862 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:25:05.716541    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:25:18.710631 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:25:18.710595    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:25:18.711025 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:25:18.710809    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:25:33.710442 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:25:33.710415    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:25:33.710802 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:25:33.710591    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:25:46.710410 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:25:46.710380    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:25:46.710856 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:25:46.710546    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:26:01.710773 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:01.710740    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:26:01.712968 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:01.710901    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:26:14.709858 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:14.709827    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:26:15.727994 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:15.727959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerStarted","Data":"9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3"}
Jul 17 11:26:15.728353 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:15.728165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:26:16.735307 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:16.735270    2564 generic.go:356] "Generic (PLEG): container finished" podID="536e8e9c-087a-4300-aa64-c76cc494f042" containerID="9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3" exitCode=1
Jul 17 11:26:16.735780 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:16.735355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3"}
Jul 17 11:26:16.735780 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:16.735417    2564 scope.go:117] "RemoveContainer" containerID="50fe4efc7fcfa5e1d338a25495d1ebaa372766f2109e6c458d743eec10d35b52"
Jul 17 11:26:16.735780 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:16.735589    2564 scope.go:117] "RemoveContainer" containerID="9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3"
Jul 17 11:26:16.735780 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:16.735755    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:26:17.741799 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:17.741772    2564 scope.go:117] "RemoveContainer" containerID="9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3"
Jul 17 11:26:17.742274 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:17.741968    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:26:23.470721 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:23.470684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:26:23.471142 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:23.471081    2564 scope.go:117] "RemoveContainer" containerID="9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3"
Jul 17 11:26:23.471274 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:23.471250    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j_odh-ai-gateway-infra(536e8e9c-087a-4300-aa64-c76cc494f042)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" podUID="536e8e9c-087a-4300-aa64-c76cc494f042"
Jul 17 11:26:34.459570 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.459536    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"]
Jul 17 11:26:34.596377 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.596348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:26:34.735905 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.735836    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x77mc\" (UniqueName: \"kubernetes.io/projected/536e8e9c-087a-4300-aa64-c76cc494f042-kube-api-access-x77mc\") pod \"536e8e9c-087a-4300-aa64-c76cc494f042\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") "
Jul 17 11:26:34.735905 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.735865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/536e8e9c-087a-4300-aa64-c76cc494f042-openshift-service-ca\") pod \"536e8e9c-087a-4300-aa64-c76cc494f042\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") "
Jul 17 11:26:34.735905 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.735895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls\") pod \"536e8e9c-087a-4300-aa64-c76cc494f042\" (UID: \"536e8e9c-087a-4300-aa64-c76cc494f042\") "
Jul 17 11:26:34.736208 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.736191    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/536e8e9c-087a-4300-aa64-c76cc494f042-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "536e8e9c-087a-4300-aa64-c76cc494f042" (UID: "536e8e9c-087a-4300-aa64-c76cc494f042"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:26:34.738058 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.738036    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536e8e9c-087a-4300-aa64-c76cc494f042-kube-api-access-x77mc" (OuterVolumeSpecName: "kube-api-access-x77mc") pod "536e8e9c-087a-4300-aa64-c76cc494f042" (UID: "536e8e9c-087a-4300-aa64-c76cc494f042"). InnerVolumeSpecName "kube-api-access-x77mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:26:34.738149 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.738127    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "536e8e9c-087a-4300-aa64-c76cc494f042" (UID: "536e8e9c-087a-4300-aa64-c76cc494f042"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:26:34.821272 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.821246    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"
Jul 17 11:26:34.821390 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.821279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j" event={"ID":"536e8e9c-087a-4300-aa64-c76cc494f042","Type":"ContainerDied","Data":"65536fbfebba62e221d368d68da745182208ce5b86f9e6e2443c8e3cd9526bd0"}
Jul 17 11:26:34.821390 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.821335    2564 scope.go:117] "RemoveContainer" containerID="9b9e04d2e2d7993860c92c183d0ca68dedb1e40285c98d3476683caf74863fd3"
Jul 17 11:26:34.836784 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.836763    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x77mc\" (UniqueName: \"kubernetes.io/projected/536e8e9c-087a-4300-aa64-c76cc494f042-kube-api-access-x77mc\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:26:34.836889 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.836786    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/536e8e9c-087a-4300-aa64-c76cc494f042-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:26:34.836889 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.836801    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/536e8e9c-087a-4300-aa64-c76cc494f042-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:26:34.858286 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.858263    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"]
Jul 17 11:26:34.862554 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:34.862536    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-829f05b9-57b45c56d7-k6d2j"]
Jul 17 11:26:35.716441 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:35.716399    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" path="/var/lib/kubelet/pods/536e8e9c-087a-4300-aa64-c76cc494f042/volumes"
Jul 17 11:26:43.285026 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.284994    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"]
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285542    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285577    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285597    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285606    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285618    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285627    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285646    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.285667 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285654    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.286112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285757    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.286112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285771    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.286112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285780    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.286112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285789    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.286112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.285796    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:26:43.290569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.290548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.293086 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.293064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-40b693f1-serving-cert\""
Jul 17 11:26:43.303418 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.303392    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"]
Jul 17 11:26:43.311890 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.311866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcrq\" (UniqueName: \"kubernetes.io/projected/3425cdba-aa75-4f90-a48d-006e8bb4d76b-kube-api-access-pxcrq\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.312001 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.311908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3425cdba-aa75-4f90-a48d-006e8bb4d76b-openshift-service-ca\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.312001 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.311954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.412972 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.412922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcrq\" (UniqueName: \"kubernetes.io/projected/3425cdba-aa75-4f90-a48d-006e8bb4d76b-kube-api-access-pxcrq\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.413069 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.412989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3425cdba-aa75-4f90-a48d-006e8bb4d76b-openshift-service-ca\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.413069 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.413016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.413148 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:43.413114    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-serving-cert: secret "maas-api-e2e-migrate-40b693f1-serving-cert" not found
Jul 17 11:26:43.413191 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:43.413171    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls podName:3425cdba-aa75-4f90-a48d-006e8bb4d76b nodeName:}" failed. No retries permitted until 2026-07-17 11:26:43.913156507 +0000 UTC m=+1758.670966903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls") pod "maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" (UID: "3425cdba-aa75-4f90-a48d-006e8bb4d76b") : secret "maas-api-e2e-migrate-40b693f1-serving-cert" not found
Jul 17 11:26:43.413601 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.413582    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3425cdba-aa75-4f90-a48d-006e8bb4d76b-openshift-service-ca\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.426749 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.426722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcrq\" (UniqueName: \"kubernetes.io/projected/3425cdba-aa75-4f90-a48d-006e8bb4d76b-kube-api-access-pxcrq\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.916051 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.916020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:43.918197 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:43.918178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls\") pod \"maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:44.203741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:44.203659    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:44.341413 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:44.341227    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"]
Jul 17 11:26:44.343726 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:26:44.343701    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3425cdba_aa75_4f90_a48d_006e8bb4d76b.slice/crio-5fddc49ad8341923c3ff125ade9bed8ac91b07904a1832945890fe05b7ef2312 WatchSource:0}: Error finding container 5fddc49ad8341923c3ff125ade9bed8ac91b07904a1832945890fe05b7ef2312: Status 404 returned error can't find the container with id 5fddc49ad8341923c3ff125ade9bed8ac91b07904a1832945890fe05b7ef2312
Jul 17 11:26:44.870973 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:44.870921    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerStarted","Data":"5fddc49ad8341923c3ff125ade9bed8ac91b07904a1832945890fe05b7ef2312"}
Jul 17 11:26:45.877537 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:45.877458    2564 generic.go:356] "Generic (PLEG): container finished" podID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerID="ee1378abec79905ab9858e6c7620330081b601d3d18ed96464c48f25972e9556" exitCode=1
Jul 17 11:26:45.877537 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:45.877505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerDied","Data":"ee1378abec79905ab9858e6c7620330081b601d3d18ed96464c48f25972e9556"}
Jul 17 11:26:45.877888 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:45.877768    2564 scope.go:117] "RemoveContainer" containerID="ee1378abec79905ab9858e6c7620330081b601d3d18ed96464c48f25972e9556"
Jul 17 11:26:46.885639 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:46.885594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerStarted","Data":"02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"}
Jul 17 11:26:46.886043 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:46.885798    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:46.907231 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:46.907145    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podStartSLOduration=2.388088846 podStartE2EDuration="3.907132643s" totalImagesPullingTime="1.519043797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:26:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:26:46.90626052 +0000 UTC m=+1761.664070948" watchObservedRunningTime="2026-07-17 11:26:46.907132643 +0000 UTC m=+1761.664943062"
Jul 17 11:26:47.893443 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:47.893410    2564 generic.go:356] "Generic (PLEG): container finished" podID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerID="02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57" exitCode=1
Jul 17 11:26:47.893901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:47.893504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerDied","Data":"02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"}
Jul 17 11:26:47.893901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:47.893565    2564 scope.go:117] "RemoveContainer" containerID="ee1378abec79905ab9858e6c7620330081b601d3d18ed96464c48f25972e9556"
Jul 17 11:26:47.893901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:47.893803    2564 scope.go:117] "RemoveContainer" containerID="02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"
Jul 17 11:26:47.894090 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:47.894045    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:26:48.899650 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:48.899619    2564 scope.go:117] "RemoveContainer" containerID="02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"
Jul 17 11:26:48.900107 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:48.899786    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:26:54.204287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:54.204253    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:26:54.204692 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:26:54.204606    2564 scope.go:117] "RemoveContainer" containerID="02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"
Jul 17 11:26:54.204813 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:26:54.204793    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:06.710412 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:06.710379    2564 scope.go:117] "RemoveContainer" containerID="02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"
Jul 17 11:27:07.997721 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:07.997683    2564 generic.go:356] "Generic (PLEG): container finished" podID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerID="0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9" exitCode=1
Jul 17 11:27:07.998215 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:07.997751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerDied","Data":"0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9"}
Jul 17 11:27:07.998215 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:07.997808    2564 scope.go:117] "RemoveContainer" containerID="02d1ea420b43a92805c5d48df6216e30f5e3524574b8e0b7cca22812f1185a57"
Jul 17 11:27:07.998215 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:07.998175    2564 scope.go:117] "RemoveContainer" containerID="0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9"
Jul 17 11:27:07.998412 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:07.998393    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:11.886237 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:11.886206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:27:11.886601 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:11.886510    2564 scope.go:117] "RemoveContainer" containerID="0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9"
Jul 17 11:27:11.886674 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:11.886653    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:14.204586 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:14.204553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:27:14.204977 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:14.204919    2564 scope.go:117] "RemoveContainer" containerID="0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9"
Jul 17 11:27:14.205150 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:14.205128    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:27.710367 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:27.710336    2564 scope.go:117] "RemoveContainer" containerID="0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9"
Jul 17 11:27:29.109373 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:29.109337    2564 generic.go:356] "Generic (PLEG): container finished" podID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerID="c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5" exitCode=1
Jul 17 11:27:29.109779 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:29.109387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerDied","Data":"c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5"}
Jul 17 11:27:29.109779 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:29.109433    2564 scope.go:117] "RemoveContainer" containerID="0f775d7b28a1afc5e7df5857f7ce2eb29b3a0b33206f0cf37d3ce7a6cfd1a9d9"
Jul 17 11:27:29.109779 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:29.109705    2564 scope.go:117] "RemoveContainer" containerID="c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5"
Jul 17 11:27:29.109969 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:29.109891    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:31.886196 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:31.886163    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:27:31.886671 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:31.886532    2564 scope.go:117] "RemoveContainer" containerID="c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5"
Jul 17 11:27:31.886748 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:31.886717    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:34.203787 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:34.203756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:27:34.204164 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:34.204110    2564 scope.go:117] "RemoveContainer" containerID="c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5"
Jul 17 11:27:34.204295 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:34.204273    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:47.710261 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:47.710221    2564 scope.go:117] "RemoveContainer" containerID="c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5"
Jul 17 11:27:47.710723 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:27:47.710404    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465_odh-ai-gateway-infra(3425cdba-aa75-4f90-a48d-006e8bb4d76b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b"
Jul 17 11:27:53.984694 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:53.984660    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"]
Jul 17 11:27:54.119642 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.119618    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:27:54.195912 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.195890    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3425cdba-aa75-4f90-a48d-006e8bb4d76b-openshift-service-ca\") pod \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") "
Jul 17 11:27:54.196064 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.195958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxcrq\" (UniqueName: \"kubernetes.io/projected/3425cdba-aa75-4f90-a48d-006e8bb4d76b-kube-api-access-pxcrq\") pod \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") "
Jul 17 11:27:54.196064 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.196012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls\") pod \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\" (UID: \"3425cdba-aa75-4f90-a48d-006e8bb4d76b\") "
Jul 17 11:27:54.196287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.196259    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3425cdba-aa75-4f90-a48d-006e8bb4d76b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3425cdba-aa75-4f90-a48d-006e8bb4d76b" (UID: "3425cdba-aa75-4f90-a48d-006e8bb4d76b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:27:54.197998 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.197974    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3425cdba-aa75-4f90-a48d-006e8bb4d76b-kube-api-access-pxcrq" (OuterVolumeSpecName: "kube-api-access-pxcrq") pod "3425cdba-aa75-4f90-a48d-006e8bb4d76b" (UID: "3425cdba-aa75-4f90-a48d-006e8bb4d76b"). InnerVolumeSpecName "kube-api-access-pxcrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:27:54.198069 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.198003    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3425cdba-aa75-4f90-a48d-006e8bb4d76b" (UID: "3425cdba-aa75-4f90-a48d-006e8bb4d76b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:27:54.229286 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.229263    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"
Jul 17 11:27:54.229286 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.229271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465" event={"ID":"3425cdba-aa75-4f90-a48d-006e8bb4d76b","Type":"ContainerDied","Data":"5fddc49ad8341923c3ff125ade9bed8ac91b07904a1832945890fe05b7ef2312"}
Jul 17 11:27:54.229399 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.229324    2564 scope.go:117] "RemoveContainer" containerID="c0d0fa029b7482e28df269db88e08597080a1005540e9a4086c8b2614c129ec5"
Jul 17 11:27:54.256662 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.256607    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"]
Jul 17 11:27:54.259145 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.259126    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-40b693f1-685bf49b9d-r7465"]
Jul 17 11:27:54.296722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.296699    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3425cdba-aa75-4f90-a48d-006e8bb4d76b-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:27:54.296866 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.296726    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3425cdba-aa75-4f90-a48d-006e8bb4d76b-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:27:54.296866 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:54.296739    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxcrq\" (UniqueName: \"kubernetes.io/projected/3425cdba-aa75-4f90-a48d-006e8bb4d76b-kube-api-access-pxcrq\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:27:55.716053 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:27:55.716022    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" path="/var/lib/kubelet/pods/3425cdba-aa75-4f90-a48d-006e8bb4d76b/volumes"
Jul 17 11:28:01.641698 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.641661    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"]
Jul 17 11:28:01.642084 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642068    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642087    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642099    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642104    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642110    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642116    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642125    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:28:01.642134 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642131    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642142    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642148    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642162    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642169    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642221    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642228    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642236    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:28:01.642344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.642260    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="536e8e9c-087a-4300-aa64-c76cc494f042" containerName="maas-api"
Jul 17 11:28:01.645550 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.645529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.648238 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.648216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-45989be5-serving-cert\""
Jul 17 11:28:01.658357 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.658331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"]
Jul 17 11:28:01.755327 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.755294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.755500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.755332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7660a04e-5c92-4625-b963-67c04f1e14bb-openshift-service-ca\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.755500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.755400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5gt\" (UniqueName: \"kubernetes.io/projected/7660a04e-5c92-4625-b963-67c04f1e14bb-kube-api-access-wm5gt\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.856454 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.856424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5gt\" (UniqueName: \"kubernetes.io/projected/7660a04e-5c92-4625-b963-67c04f1e14bb-kube-api-access-wm5gt\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.856696 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.856502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.856696 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.856527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7660a04e-5c92-4625-b963-67c04f1e14bb-openshift-service-ca\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.856696 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:01.856645    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-serving-cert: secret "maas-api-e2e-ait-45989be5-serving-cert" not found
Jul 17 11:28:01.856853 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:01.856724    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls podName:7660a04e-5c92-4625-b963-67c04f1e14bb nodeName:}" failed. No retries permitted until 2026-07-17 11:28:02.356709962 +0000 UTC m=+1837.114520358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls") pod "maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" (UID: "7660a04e-5c92-4625-b963-67c04f1e14bb") : secret "maas-api-e2e-ait-45989be5-serving-cert" not found
Jul 17 11:28:01.857102 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.857085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7660a04e-5c92-4625-b963-67c04f1e14bb-openshift-service-ca\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:01.867378 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:01.867351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5gt\" (UniqueName: \"kubernetes.io/projected/7660a04e-5c92-4625-b963-67c04f1e14bb-kube-api-access-wm5gt\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:02.361014 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:02.360978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:02.363379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:02.363350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls\") pod \"maas-api-e2e-ait-45989be5-766655b6d7-vp2pp\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:02.555524 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:02.555490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:02.696645 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:02.696616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"]
Jul 17 11:28:02.701240 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:28:02.701211    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7660a04e_5c92_4625_b963_67c04f1e14bb.slice/crio-350929ccbb97c37d88ac41ce4e6c45439f6adbae47b8a645b1fb42aae766fd3d WatchSource:0}: Error finding container 350929ccbb97c37d88ac41ce4e6c45439f6adbae47b8a645b1fb42aae766fd3d: Status 404 returned error can't find the container with id 350929ccbb97c37d88ac41ce4e6c45439f6adbae47b8a645b1fb42aae766fd3d
Jul 17 11:28:03.272144 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:03.272100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerStarted","Data":"4efadeed570a7f193f0a526933e4175c9e127d70add2c6ef008b237c2ec16540"}
Jul 17 11:28:03.272338 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:03.272192    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerStarted","Data":"350929ccbb97c37d88ac41ce4e6c45439f6adbae47b8a645b1fb42aae766fd3d"}
Jul 17 11:28:03.272338 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:03.272215    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:03.297879 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:03.297818    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podStartSLOduration=1.947923179 podStartE2EDuration="2.297798129s" totalImagesPullingTime="349.87495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:28:03.295767034 +0000 UTC m=+1838.053577483" watchObservedRunningTime="2026-07-17 11:28:03.297798129 +0000 UTC m=+1838.055608547"
Jul 17 11:28:04.278926 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:04.278893    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="4efadeed570a7f193f0a526933e4175c9e127d70add2c6ef008b237c2ec16540" exitCode=1
Jul 17 11:28:04.279310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:04.278959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"4efadeed570a7f193f0a526933e4175c9e127d70add2c6ef008b237c2ec16540"}
Jul 17 11:28:04.279310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:04.279212    2564 scope.go:117] "RemoveContainer" containerID="4efadeed570a7f193f0a526933e4175c9e127d70add2c6ef008b237c2ec16540"
Jul 17 11:28:05.285815 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:05.285717    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99" exitCode=1
Jul 17 11:28:05.285815 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:05.285799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"}
Jul 17 11:28:05.286351 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:05.285860    2564 scope.go:117] "RemoveContainer" containerID="4efadeed570a7f193f0a526933e4175c9e127d70add2c6ef008b237c2ec16540"
Jul 17 11:28:05.286351 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:05.286095    2564 scope.go:117] "RemoveContainer" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"
Jul 17 11:28:05.286452 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:05.286331    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:06.292823 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:06.292788    2564 scope.go:117] "RemoveContainer" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"
Jul 17 11:28:06.293332 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:06.293086    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:08.272703 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:08.272663    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:08.273109 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:08.273062    2564 scope.go:117] "RemoveContainer" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"
Jul 17 11:28:08.273256 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:08.273235    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:12.555623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:12.555584    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:12.556044 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:12.555991    2564 scope.go:117] "RemoveContainer" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"
Jul 17 11:28:12.556176 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:12.556155    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:23.710562 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:23.710531    2564 scope.go:117] "RemoveContainer" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"
Jul 17 11:28:23.710992 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:23.710974    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:28:24.386240 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:24.386161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerStarted","Data":"fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"}
Jul 17 11:28:24.386375 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:24.386358    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:25.392862 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:25.392826    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4" exitCode=1
Jul 17 11:28:25.393364 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:25.392869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"}
Jul 17 11:28:25.393364 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:25.392920    2564 scope.go:117] "RemoveContainer" containerID="33dd463590bd6e22be6e9ef4fe8b1fcd7d0f200b1b7a6ec60ca387b2a9d16a99"
Jul 17 11:28:25.393364 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:25.393115    2564 scope.go:117] "RemoveContainer" containerID="fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"
Jul 17 11:28:25.393364 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:25.393324    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:26.399265 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:26.399238    2564 scope.go:117] "RemoveContainer" containerID="fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"
Jul 17 11:28:26.399730 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:26.399461    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:32.556209 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:32.556176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:32.556598 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:32.556542    2564 scope.go:117] "RemoveContainer" containerID="fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"
Jul 17 11:28:32.556729 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:32.556707    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:45.712500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:45.712471    2564 scope.go:117] "RemoveContainer" containerID="fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"
Jul 17 11:28:47.496329 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:47.496295    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110" exitCode=1
Jul 17 11:28:47.496719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:47.496368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"}
Jul 17 11:28:47.496719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:47.496438    2564 scope.go:117] "RemoveContainer" containerID="fa23560f2e1ed16b49cb2459542d2c731d30d2a6db064d6add06dc48c68cefb4"
Jul 17 11:28:47.496820 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:47.496792    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:28:47.497007 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:47.496988    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:49.386558 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:49.386517    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:49.387025 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:49.386980    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:28:49.387241 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:49.387215    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:28:52.555988 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:52.555932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:28:52.556373 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:28:52.556290    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:28:52.556474 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:28:52.556451    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:29:04.710745 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:04.710710    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:29:04.711299 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:29:04.710968    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:29:19.710553 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:19.710519    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:29:19.710920 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:29:19.710705    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:29:32.710022 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:32.709991    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:29:33.727814 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:33.727789    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b" exitCode=1
Jul 17 11:29:33.728135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:33.727841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"}
Jul 17 11:29:33.728135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:33.727885    2564 scope.go:117] "RemoveContainer" containerID="ea7fb5d960532ef760e344d6ad68b1908f6b263a2d3c0472f36470a53ab9c110"
Jul 17 11:29:33.728233 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:33.728203    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:29:33.728453 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:29:33.728429    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:29:34.387441 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:34.387408    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:29:34.733582 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:34.733556    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:29:34.734007 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:29:34.733738    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:29:42.556491 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:42.556454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:29:42.556978 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:42.556832    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:29:42.557032 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:29:42.557014    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:29:55.717777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:29:55.714802    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:29:55.717777 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:29:55.715168    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:30:10.710523 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:30:10.710491    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:30:10.710883 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:30:10.710725    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:30:23.710782 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:30:23.710700    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:30:23.711329 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:30:23.710903    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:30:35.713215 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:30:35.713187    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:30:35.713681 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:30:35.713363    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:30:47.710322 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:30:47.710288    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:30:47.710781 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:30:47.710543    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:30:59.710671 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:30:59.710644    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:31:01.136374 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:01.136343    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8" exitCode=1
Jul 17 11:31:01.136822 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:01.136400    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"}
Jul 17 11:31:01.136822 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:01.136449    2564 scope.go:117] "RemoveContainer" containerID="bebf3d9181441797770573684e2e268fe4b6c77c3bc960ae86af37a442ca361b"
Jul 17 11:31:01.136822 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:01.136746    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:01.136983 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:01.136916    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:31:02.556436 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:02.556399    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:31:02.558711 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:02.556751    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:02.558711 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:02.556915    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:31:04.387469 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:04.387436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:31:04.387831 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:04.387773    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:04.387995 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:04.387973    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:31:15.713142 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:15.713109    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:15.713600 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:15.713276    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:31:27.710387 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:27.710356    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:27.710774 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:27.710556    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:31:39.710730 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:39.710693    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:39.711196 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:39.710982    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:31:51.710374 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:31:51.710303    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:31:51.710802 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:31:51.710509    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:32:06.709870 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:32:06.709835    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:32:06.710345 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:32:06.710039    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:32:21.710712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:32:21.710678    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:32:21.711209 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:32:21.710839    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:32:35.712664 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:32:35.712635    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:32:35.713105 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:32:35.712808    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:32:47.710691 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:32:47.710663    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:32:47.711161 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:32:47.710824    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:33:02.710161 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:02.710126    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:33:02.710725 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:33:02.710362    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:33:14.710061 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:14.710011    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:33:14.710512 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:33:14.710163    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:33:28.710101 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:28.710071    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:33:28.710567 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:33:28.710245    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:33:43.710980 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:43.710921    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:33:43.711702 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:43.711678    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:33:44.901404 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:44.901371    2564 generic.go:356] "Generic (PLEG): container finished" podID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerID="45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e" exitCode=1
Jul 17 11:33:44.901790 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:44.901439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e"}
Jul 17 11:33:44.901790 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:44.901496    2564 scope.go:117] "RemoveContainer" containerID="b9a6e4221910bb5ccb98ab71c5fc55c228f05d404923d6a8d328eb9f89a398d8"
Jul 17 11:33:44.901903 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:44.901835    2564 scope.go:117] "RemoveContainer" containerID="45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e"
Jul 17 11:33:44.902138 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:33:44.902102    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:33:49.387036 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:49.387001    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:33:49.387486 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:49.387399    2564 scope.go:117] "RemoveContainer" containerID="45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e"
Jul 17 11:33:49.387591 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:33:49.387571    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:33:52.556035 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:52.555997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:33:52.556523 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:33:52.556469    2564 scope.go:117] "RemoveContainer" containerID="45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e"
Jul 17 11:33:52.556710 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:33:52.556683    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:34:03.710751 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:03.710715    2564 scope.go:117] "RemoveContainer" containerID="45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e"
Jul 17 11:34:03.711280 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:03.710931    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-45989be5-766655b6d7-vp2pp_odh-ai-gateway-infra(7660a04e-5c92-4625-b963-67c04f1e14bb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb"
Jul 17 11:34:12.306979 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.306931    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"]
Jul 17 11:34:12.444951 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.444912    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:34:12.479499 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.479475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm5gt\" (UniqueName: \"kubernetes.io/projected/7660a04e-5c92-4625-b963-67c04f1e14bb-kube-api-access-wm5gt\") pod \"7660a04e-5c92-4625-b963-67c04f1e14bb\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") "
Jul 17 11:34:12.479641 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.479524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls\") pod \"7660a04e-5c92-4625-b963-67c04f1e14bb\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") "
Jul 17 11:34:12.479641 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.479591    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7660a04e-5c92-4625-b963-67c04f1e14bb-openshift-service-ca\") pod \"7660a04e-5c92-4625-b963-67c04f1e14bb\" (UID: \"7660a04e-5c92-4625-b963-67c04f1e14bb\") "
Jul 17 11:34:12.479970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.479921    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7660a04e-5c92-4625-b963-67c04f1e14bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7660a04e-5c92-4625-b963-67c04f1e14bb" (UID: "7660a04e-5c92-4625-b963-67c04f1e14bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:34:12.481527 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.481498    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7660a04e-5c92-4625-b963-67c04f1e14bb-kube-api-access-wm5gt" (OuterVolumeSpecName: "kube-api-access-wm5gt") pod "7660a04e-5c92-4625-b963-67c04f1e14bb" (UID: "7660a04e-5c92-4625-b963-67c04f1e14bb"). InnerVolumeSpecName "kube-api-access-wm5gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:34:12.482108 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.482063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7660a04e-5c92-4625-b963-67c04f1e14bb" (UID: "7660a04e-5c92-4625-b963-67c04f1e14bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:34:12.581083 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.581018    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm5gt\" (UniqueName: \"kubernetes.io/projected/7660a04e-5c92-4625-b963-67c04f1e14bb-kube-api-access-wm5gt\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:34:12.581083 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.581040    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7660a04e-5c92-4625-b963-67c04f1e14bb-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:34:12.581083 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:12.581049    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7660a04e-5c92-4625-b963-67c04f1e14bb-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:34:13.036736 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:13.036691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp" event={"ID":"7660a04e-5c92-4625-b963-67c04f1e14bb","Type":"ContainerDied","Data":"350929ccbb97c37d88ac41ce4e6c45439f6adbae47b8a645b1fb42aae766fd3d"}
Jul 17 11:34:13.036736 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:13.036713    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"
Jul 17 11:34:13.036999 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:13.036760    2564 scope.go:117] "RemoveContainer" containerID="45062555a944acc4a312be335453b65fa9af954edac7a828a84c674006863a7e"
Jul 17 11:34:13.061738 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:13.061717    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"]
Jul 17 11:34:13.066698 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:13.066679    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-45989be5-766655b6d7-vp2pp"]
Jul 17 11:34:13.716376 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:13.716347    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" path="/var/lib/kubelet/pods/7660a04e-5c92-4625-b963-67c04f1e14bb/volumes"
Jul 17 11:34:20.674275 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.674243    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"]
Jul 17 11:34:20.675426 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675395    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675609 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675588    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675628    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675638    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675659    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675668    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675691    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.675741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675708    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.676123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675986    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.676123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.675999    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.676123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.676017    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3425cdba-aa75-4f90-a48d-006e8bb4d76b" containerName="maas-api"
Jul 17 11:34:20.676123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.676027    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.676123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.676047    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.676123 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.676056    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:34:20.687289 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.687266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.688663 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.688614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"]
Jul 17 11:34:20.690241 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.690155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-57741a73-serving-cert\""
Jul 17 11:34:20.752880 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.752850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738839e9-b628-43a2-bc76-835a5e65ccbb-openshift-service-ca\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.752880 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.752881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmtlw\" (UniqueName: \"kubernetes.io/projected/738839e9-b628-43a2-bc76-835a5e65ccbb-kube-api-access-qmtlw\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.753074 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.752982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.853853 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.853830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.854014 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.853890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738839e9-b628-43a2-bc76-835a5e65ccbb-openshift-service-ca\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.854014 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.853912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmtlw\" (UniqueName: \"kubernetes.io/projected/738839e9-b628-43a2-bc76-835a5e65ccbb-kube-api-access-qmtlw\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.854014 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:20.853987    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-serving-cert: secret "maas-api-e2e-derive-57741a73-serving-cert" not found
Jul 17 11:34:20.854204 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:20.854058    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls podName:738839e9-b628-43a2-bc76-835a5e65ccbb nodeName:}" failed. No retries permitted until 2026-07-17 11:34:21.354038007 +0000 UTC m=+2216.111848416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls") pod "maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" (UID: "738839e9-b628-43a2-bc76-835a5e65ccbb") : secret "maas-api-e2e-derive-57741a73-serving-cert" not found
Jul 17 11:34:20.854577 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.854552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738839e9-b628-43a2-bc76-835a5e65ccbb-openshift-service-ca\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:20.863438 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:20.863413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmtlw\" (UniqueName: \"kubernetes.io/projected/738839e9-b628-43a2-bc76-835a5e65ccbb-kube-api-access-qmtlw\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:21.358496 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:21.358461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:21.360952 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:21.360901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls\") pod \"maas-api-e2e-derive-57741a73-559b74cd78-qrvnt\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:21.601017 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:21.600981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:21.740751 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:21.740727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"]
Jul 17 11:34:21.742893 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:34:21.742858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738839e9_b628_43a2_bc76_835a5e65ccbb.slice/crio-0c40780ecddf6e26e8ad550e9ca46728430d2c191470ce51c01935a9afd04ce4 WatchSource:0}: Error finding container 0c40780ecddf6e26e8ad550e9ca46728430d2c191470ce51c01935a9afd04ce4: Status 404 returned error can't find the container with id 0c40780ecddf6e26e8ad550e9ca46728430d2c191470ce51c01935a9afd04ce4
Jul 17 11:34:22.081531 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:22.081507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerStarted","Data":"0c40780ecddf6e26e8ad550e9ca46728430d2c191470ce51c01935a9afd04ce4"}
Jul 17 11:34:23.087335 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:23.087298    2564 generic.go:356] "Generic (PLEG): container finished" podID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerID="6c3a08c0fc2e77b1bb9ee35b527bd70dd6b07802fa6a06fc7a474774a4d1d1d7" exitCode=1
Jul 17 11:34:23.087796 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:23.087362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"6c3a08c0fc2e77b1bb9ee35b527bd70dd6b07802fa6a06fc7a474774a4d1d1d7"}
Jul 17 11:34:23.087796 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:23.087618    2564 scope.go:117] "RemoveContainer" containerID="6c3a08c0fc2e77b1bb9ee35b527bd70dd6b07802fa6a06fc7a474774a4d1d1d7"
Jul 17 11:34:24.094737 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:24.094651    2564 generic.go:356] "Generic (PLEG): container finished" podID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc" exitCode=1
Jul 17 11:34:24.095169 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:24.094729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"}
Jul 17 11:34:24.095169 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:24.094785    2564 scope.go:117] "RemoveContainer" containerID="6c3a08c0fc2e77b1bb9ee35b527bd70dd6b07802fa6a06fc7a474774a4d1d1d7"
Jul 17 11:34:24.095169 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:24.094925    2564 scope.go:117] "RemoveContainer" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"
Jul 17 11:34:24.095169 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:24.095116    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:34:25.101345 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:25.101322    2564 scope.go:117] "RemoveContainer" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"
Jul 17 11:34:25.101733 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:25.101496    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:34:26.601271 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:26.601238    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:26.601643 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:26.601628    2564 scope.go:117] "RemoveContainer" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"
Jul 17 11:34:26.601836 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:26.601810    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:34:31.601637 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:31.601587    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:31.602070 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:31.602052    2564 scope.go:117] "RemoveContainer" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"
Jul 17 11:34:31.602259 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:31.602235    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:34:42.710624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:42.710593    2564 scope.go:117] "RemoveContainer" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"
Jul 17 11:34:43.194268 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:43.194234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerStarted","Data":"7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"}
Jul 17 11:34:43.194461 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:43.194440    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:43.212571 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:43.212525    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podStartSLOduration=22.307905543 podStartE2EDuration="23.212511771s" totalImagesPullingTime="904.606228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:34:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:34:43.211810056 +0000 UTC m=+2237.969620475" watchObservedRunningTime="2026-07-17 11:34:43.212511771 +0000 UTC m=+2237.970322189"
Jul 17 11:34:44.200423 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:44.200385    2564 generic.go:356] "Generic (PLEG): container finished" podID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce" exitCode=1
Jul 17 11:34:44.200838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:44.200474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"}
Jul 17 11:34:44.200838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:44.200536    2564 scope.go:117] "RemoveContainer" containerID="eb044d1357798f7e1a3c4e84fef6be4eefceb3080750e54466edcc0c1fc9c1bc"
Jul 17 11:34:44.200838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:44.200785    2564 scope.go:117] "RemoveContainer" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"
Jul 17 11:34:44.201022 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:44.200997    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:34:45.209684 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:45.209659    2564 scope.go:117] "RemoveContainer" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"
Jul 17 11:34:45.210080 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:45.209827    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:34:51.601432 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:51.601355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:34:51.601786 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:34:51.601771    2564 scope.go:117] "RemoveContainer" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"
Jul 17 11:34:51.601988 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:34:51.601967    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:02.710857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:02.710828    2564 scope.go:117] "RemoveContainer" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"
Jul 17 11:35:02.711255 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:35:02.711009    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:13.710595 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:13.710557    2564 scope.go:117] "RemoveContainer" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"
Jul 17 11:35:14.348054 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:14.347978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerStarted","Data":"955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"}
Jul 17 11:35:14.348195 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:14.348178    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:35:15.357505 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:15.357470    2564 generic.go:356] "Generic (PLEG): container finished" podID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4" exitCode=1
Jul 17 11:35:15.357970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:15.357562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"}
Jul 17 11:35:15.357970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:15.357637    2564 scope.go:117] "RemoveContainer" containerID="7a310d0b6444ce45346fbe683a042f43b26b45824504047b75ddddba1d191fce"
Jul 17 11:35:15.357970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:15.357814    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:35:15.358157 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:35:15.358008    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:16.364597 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:16.364569    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:35:16.364966 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:35:16.364736    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:21.601838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:21.601804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:35:21.602247 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:21.602234    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:35:21.602443 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:35:21.602419    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:33.710675 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:33.710642    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:35:33.711182 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:35:33.710814    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:46.709901 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:46.709873    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:35:46.710388 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:35:46.710063    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:35:59.710233 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:35:59.710194    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:36:00.575039 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:00.575005    2564 generic.go:356] "Generic (PLEG): container finished" podID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19" exitCode=1
Jul 17 11:36:00.575216 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:00.575063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"}
Jul 17 11:36:00.575974 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:00.575122    2564 scope.go:117] "RemoveContainer" containerID="955e11af1c9ca327dd54049f3bd44c475774f3e2b6f73ceb6ef1e89a20293ca4"
Jul 17 11:36:00.576074 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:00.576057    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:00.576318 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:00.576290    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:36:01.601760 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:01.601729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:36:01.602152 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:01.602065    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:01.602242 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:01.602222    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:36:04.348415 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:04.348377    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:36:04.350673 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:04.348735    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:04.350673 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:04.348886    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:36:15.713074 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:15.713034    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:15.713543 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:15.713228    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:36:29.710356 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:29.710326    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:29.710846 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:29.710485    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:36:44.710593 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:44.710568    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:44.711072 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:44.710729    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:36:59.710203 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:36:59.710167    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:36:59.710657 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:36:59.710380    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:37:10.710094 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:10.710064    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:37:10.710539 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:37:10.710311    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:37:23.710379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:23.710347    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:37:24.986354 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:24.986324    2564 generic.go:356] "Generic (PLEG): container finished" podID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerID="566066e2402236c541a7570d515887ee36b902b2e5f381094936209202cc8b26" exitCode=1
Jul 17 11:37:24.986743 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:24.986374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"566066e2402236c541a7570d515887ee36b902b2e5f381094936209202cc8b26"}
Jul 17 11:37:24.986743 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:24.986420    2564 scope.go:117] "RemoveContainer" containerID="8509e0209b447fd27cd2bba93a7f88616bc06c57af1130efa95317735f5c7e19"
Jul 17 11:37:24.987311 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:24.987282    2564 scope.go:117] "RemoveContainer" containerID="566066e2402236c541a7570d515887ee36b902b2e5f381094936209202cc8b26"
Jul 17 11:37:24.995064 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:37:24.995028    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:37:29.348995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:29.348962    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:37:29.349380 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:29.349300    2564 scope.go:117] "RemoveContainer" containerID="566066e2402236c541a7570d515887ee36b902b2e5f381094936209202cc8b26"
Jul 17 11:37:29.349502 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:37:29.349479    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:37:31.601864 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:31.601826    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:37:31.602291 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:31.602212    2564 scope.go:117] "RemoveContainer" containerID="566066e2402236c541a7570d515887ee36b902b2e5f381094936209202cc8b26"
Jul 17 11:37:31.602397 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:37:31.602376    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-57741a73-559b74cd78-qrvnt_odh-ai-gateway-infra(738839e9-b628-43a2-bc76-835a5e65ccbb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb"
Jul 17 11:37:32.434430 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.434389    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"]
Jul 17 11:37:32.568759 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.568736    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:37:32.730541 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.730460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmtlw\" (UniqueName: \"kubernetes.io/projected/738839e9-b628-43a2-bc76-835a5e65ccbb-kube-api-access-qmtlw\") pod \"738839e9-b628-43a2-bc76-835a5e65ccbb\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") "
Jul 17 11:37:32.730992 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.730548    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls\") pod \"738839e9-b628-43a2-bc76-835a5e65ccbb\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") "
Jul 17 11:37:32.730992 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.730595    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738839e9-b628-43a2-bc76-835a5e65ccbb-openshift-service-ca\") pod \"738839e9-b628-43a2-bc76-835a5e65ccbb\" (UID: \"738839e9-b628-43a2-bc76-835a5e65ccbb\") "
Jul 17 11:37:32.730992 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.730859    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738839e9-b628-43a2-bc76-835a5e65ccbb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "738839e9-b628-43a2-bc76-835a5e65ccbb" (UID: "738839e9-b628-43a2-bc76-835a5e65ccbb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:37:32.732641 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.732615    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "738839e9-b628-43a2-bc76-835a5e65ccbb" (UID: "738839e9-b628-43a2-bc76-835a5e65ccbb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:37:32.732746 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.732701    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738839e9-b628-43a2-bc76-835a5e65ccbb-kube-api-access-qmtlw" (OuterVolumeSpecName: "kube-api-access-qmtlw") pod "738839e9-b628-43a2-bc76-835a5e65ccbb" (UID: "738839e9-b628-43a2-bc76-835a5e65ccbb"). InnerVolumeSpecName "kube-api-access-qmtlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:37:32.831397 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.831369    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmtlw\" (UniqueName: \"kubernetes.io/projected/738839e9-b628-43a2-bc76-835a5e65ccbb-kube-api-access-qmtlw\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:37:32.831397 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.831393    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738839e9-b628-43a2-bc76-835a5e65ccbb-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:37:32.831543 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:32.831403    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738839e9-b628-43a2-bc76-835a5e65ccbb-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:37:33.029028 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:33.028927    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"
Jul 17 11:37:33.029179 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:33.028948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt" event={"ID":"738839e9-b628-43a2-bc76-835a5e65ccbb","Type":"ContainerDied","Data":"0c40780ecddf6e26e8ad550e9ca46728430d2c191470ce51c01935a9afd04ce4"}
Jul 17 11:37:33.029179 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:33.029096    2564 scope.go:117] "RemoveContainer" containerID="566066e2402236c541a7570d515887ee36b902b2e5f381094936209202cc8b26"
Jul 17 11:37:33.075809 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:33.075778    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"]
Jul 17 11:37:33.086174 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:33.086149    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57741a73-559b74cd78-qrvnt"]
Jul 17 11:37:33.716263 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:37:33.716230    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" path="/var/lib/kubelet/pods/738839e9-b628-43a2-bc76-835a5e65ccbb/volumes"
Jul 17 11:39:34.251847 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.251811    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"]
Jul 17 11:39:34.252416 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252395    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252420    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252441    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252449    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252463    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252471    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252482    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252490    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252520    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252529    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252545    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252554    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252573    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252581    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252684    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252696    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252710    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252722    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.252857 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.252730    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7660a04e-5c92-4625-b963-67c04f1e14bb" containerName="maas-api"
Jul 17 11:39:34.256228 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.256204    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.258711 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.258687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5a6d7b05-serving-cert\""
Jul 17 11:39:34.269023 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.268999    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"]
Jul 17 11:39:34.423514 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.423479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd78535-34ca-46df-9625-7f29a507ede6-openshift-service-ca\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.423514 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.423516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg77p\" (UniqueName: \"kubernetes.io/projected/3bd78535-34ca-46df-9625-7f29a507ede6-kube-api-access-qg77p\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.423697 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.423592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd78535-34ca-46df-9625-7f29a507ede6-maas-api-tls\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.524369 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.524295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd78535-34ca-46df-9625-7f29a507ede6-maas-api-tls\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.524515 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.524386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd78535-34ca-46df-9625-7f29a507ede6-openshift-service-ca\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.524515 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.524414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg77p\" (UniqueName: \"kubernetes.io/projected/3bd78535-34ca-46df-9625-7f29a507ede6-kube-api-access-qg77p\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.525087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.525067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd78535-34ca-46df-9625-7f29a507ede6-openshift-service-ca\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.526671 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.526654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd78535-34ca-46df-9625-7f29a507ede6-maas-api-tls\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.537713 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.537690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg77p\" (UniqueName: \"kubernetes.io/projected/3bd78535-34ca-46df-9625-7f29a507ede6-kube-api-access-qg77p\") pod \"maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.568299 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.568275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:34.917922 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.917898    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"]
Jul 17 11:39:34.919993 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:39:34.919965    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd78535_34ca_46df_9625_7f29a507ede6.slice/crio-82b369fb23728a3b474ceb1afbd1462dd2ba07e4b1b5a3494125e893d74c2b6b WatchSource:0}: Error finding container 82b369fb23728a3b474ceb1afbd1462dd2ba07e4b1b5a3494125e893d74c2b6b: Status 404 returned error can't find the container with id 82b369fb23728a3b474ceb1afbd1462dd2ba07e4b1b5a3494125e893d74c2b6b
Jul 17 11:39:34.921421 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:34.921403    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:39:35.621365 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:35.621331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8" event={"ID":"3bd78535-34ca-46df-9625-7f29a507ede6","Type":"ContainerStarted","Data":"410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b"}
Jul 17 11:39:35.621703 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:35.621381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8" event={"ID":"3bd78535-34ca-46df-9625-7f29a507ede6","Type":"ContainerStarted","Data":"82b369fb23728a3b474ceb1afbd1462dd2ba07e4b1b5a3494125e893d74c2b6b"}
Jul 17 11:39:35.621703 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:35.621462    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:35.642785 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:35.642742    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8" podStartSLOduration=1.119949942 podStartE2EDuration="1.642728777s" totalImagesPullingTime="522.778835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:39:35.641083632 +0000 UTC m=+2530.398894051" watchObservedRunningTime="2026-07-17 11:39:35.642728777 +0000 UTC m=+2530.400539195"
Jul 17 11:39:41.631746 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:41.631718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:56.917672 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:56.917641    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"]
Jul 17 11:39:56.918112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:56.917870    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8" podUID="3bd78535-34ca-46df-9625-7f29a507ede6" containerName="maas-api" containerID="cri-o://410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b" gracePeriod=30
Jul 17 11:39:57.170430 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.170377    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:57.197026 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.196996    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd78535-34ca-46df-9625-7f29a507ede6-maas-api-tls\") pod \"3bd78535-34ca-46df-9625-7f29a507ede6\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") "
Jul 17 11:39:57.197139 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.197104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd78535-34ca-46df-9625-7f29a507ede6-openshift-service-ca\") pod \"3bd78535-34ca-46df-9625-7f29a507ede6\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") "
Jul 17 11:39:57.197204 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.197137    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg77p\" (UniqueName: \"kubernetes.io/projected/3bd78535-34ca-46df-9625-7f29a507ede6-kube-api-access-qg77p\") pod \"3bd78535-34ca-46df-9625-7f29a507ede6\" (UID: \"3bd78535-34ca-46df-9625-7f29a507ede6\") "
Jul 17 11:39:57.197444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.197422    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bd78535-34ca-46df-9625-7f29a507ede6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3bd78535-34ca-46df-9625-7f29a507ede6" (UID: "3bd78535-34ca-46df-9625-7f29a507ede6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:39:57.199006 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.198978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bd78535-34ca-46df-9625-7f29a507ede6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3bd78535-34ca-46df-9625-7f29a507ede6" (UID: "3bd78535-34ca-46df-9625-7f29a507ede6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:39:57.199234 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.199209    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd78535-34ca-46df-9625-7f29a507ede6-kube-api-access-qg77p" (OuterVolumeSpecName: "kube-api-access-qg77p") pod "3bd78535-34ca-46df-9625-7f29a507ede6" (UID: "3bd78535-34ca-46df-9625-7f29a507ede6"). InnerVolumeSpecName "kube-api-access-qg77p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:39:57.298390 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.298360    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd78535-34ca-46df-9625-7f29a507ede6-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:39:57.298390 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.298384    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg77p\" (UniqueName: \"kubernetes.io/projected/3bd78535-34ca-46df-9625-7f29a507ede6-kube-api-access-qg77p\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:39:57.298390 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.298393    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd78535-34ca-46df-9625-7f29a507ede6-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:39:57.728181 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.728148    2564 generic.go:356] "Generic (PLEG): container finished" podID="3bd78535-34ca-46df-9625-7f29a507ede6" containerID="410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b" exitCode=0
Jul 17 11:39:57.728310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.728190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8" event={"ID":"3bd78535-34ca-46df-9625-7f29a507ede6","Type":"ContainerDied","Data":"410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b"}
Jul 17 11:39:57.728310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.728205    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"
Jul 17 11:39:57.728310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.728240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8" event={"ID":"3bd78535-34ca-46df-9625-7f29a507ede6","Type":"ContainerDied","Data":"82b369fb23728a3b474ceb1afbd1462dd2ba07e4b1b5a3494125e893d74c2b6b"}
Jul 17 11:39:57.728310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.728269    2564 scope.go:117] "RemoveContainer" containerID="410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b"
Jul 17 11:39:57.736543 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.736525    2564 scope.go:117] "RemoveContainer" containerID="410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b"
Jul 17 11:39:57.736790 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:39:57.736770    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b\": container with ID starting with 410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b not found: ID does not exist" containerID="410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b"
Jul 17 11:39:57.736872 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.736798    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b"} err="failed to get container status \"410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b\": rpc error: code = NotFound desc = could not find container \"410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b\": container with ID starting with 410ff2a5d9db4de313f5f5ed1ee067c1eaadc0d5093bb20d12a21f7d6a7e7e6b not found: ID does not exist"
Jul 17 11:39:57.746975 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.746951    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"]
Jul 17 11:39:57.751600 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:57.751579    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a6d7b05-b686789c-fwdp8"]
Jul 17 11:39:59.716689 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:39:59.716654    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bd78535-34ca-46df-9625-7f29a507ede6" path="/var/lib/kubelet/pods/3bd78535-34ca-46df-9625-7f29a507ede6/volumes"
Jul 17 11:40:36.328670 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.328636    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"]
Jul 17 11:40:36.329193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329132    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:36.329193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329151    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:36.329193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329169    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd78535-34ca-46df-9625-7f29a507ede6" containerName="maas-api"
Jul 17 11:40:36.329193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329174    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd78535-34ca-46df-9625-7f29a507ede6" containerName="maas-api"
Jul 17 11:40:36.329193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329185    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:36.329193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329191    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:36.329523 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329290    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:36.329523 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329337    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:36.329523 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.329365    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bd78535-34ca-46df-9625-7f29a507ede6" containerName="maas-api"
Jul 17 11:40:36.332543 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.332527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.335609 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.335589    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-63359af2-serving-cert\""
Jul 17 11:40:36.343319 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.343296    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"]
Jul 17 11:40:36.428805 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.428774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9170951-58ed-4612-b77a-1bcc823438b8-openshift-service-ca\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.428989 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.428813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9170951-58ed-4612-b77a-1bcc823438b8-maas-api-tls\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.428989 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.428892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkk7d\" (UniqueName: \"kubernetes.io/projected/a9170951-58ed-4612-b77a-1bcc823438b8-kube-api-access-pkk7d\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.529751 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.529719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9170951-58ed-4612-b77a-1bcc823438b8-openshift-service-ca\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.529864 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.529755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9170951-58ed-4612-b77a-1bcc823438b8-maas-api-tls\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.529864 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.529808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkk7d\" (UniqueName: \"kubernetes.io/projected/a9170951-58ed-4612-b77a-1bcc823438b8-kube-api-access-pkk7d\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.530498 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.530477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9170951-58ed-4612-b77a-1bcc823438b8-openshift-service-ca\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.532189 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.532168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9170951-58ed-4612-b77a-1bcc823438b8-maas-api-tls\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.542551 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.542527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkk7d\" (UniqueName: \"kubernetes.io/projected/a9170951-58ed-4612-b77a-1bcc823438b8-kube-api-access-pkk7d\") pod \"maas-api-e2e-mt-63359af2-65bc44f494-vbbxn\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.643877 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.643852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:36.801879 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.801836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"]
Jul 17 11:40:36.804190 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:40:36.804166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9170951_58ed_4612_b77a_1bcc823438b8.slice/crio-bb3569eb53b9db76eaa159f48b0fcb23d37705efc29b7ed60f8a1d486a70e82c WatchSource:0}: Error finding container bb3569eb53b9db76eaa159f48b0fcb23d37705efc29b7ed60f8a1d486a70e82c: Status 404 returned error can't find the container with id bb3569eb53b9db76eaa159f48b0fcb23d37705efc29b7ed60f8a1d486a70e82c
Jul 17 11:40:36.920278 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:36.920199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn" event={"ID":"a9170951-58ed-4612-b77a-1bcc823438b8","Type":"ContainerStarted","Data":"bb3569eb53b9db76eaa159f48b0fcb23d37705efc29b7ed60f8a1d486a70e82c"}
Jul 17 11:40:37.927624 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:37.927591    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn" event={"ID":"a9170951-58ed-4612-b77a-1bcc823438b8","Type":"ContainerStarted","Data":"7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897"}
Jul 17 11:40:37.927995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:37.927718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:37.951327 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:37.951280    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn" podStartSLOduration=1.568902502 podStartE2EDuration="1.951267776s" totalImagesPullingTime="382.365274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:40:37.949305809 +0000 UTC m=+2592.707116244" watchObservedRunningTime="2026-07-17 11:40:37.951267776 +0000 UTC m=+2592.709078226"
Jul 17 11:40:43.937500 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:43.937470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:40:54.301230 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.301152    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"]
Jul 17 11:40:54.301783 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.301762    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="738839e9-b628-43a2-bc76-835a5e65ccbb" containerName="maas-api"
Jul 17 11:40:54.305125 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.305104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.308895 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.308874    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-63359af2\"/\"default-dockercfg-7wvwc\""
Jul 17 11:40:54.309026 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.308949    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-63359af2\"/\"kube-root-ca.crt\""
Jul 17 11:40:54.309026 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.308967    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-63359af2\"/\"e2e-lifecycle-model-63359af2-kserve-self-signed-certs\""
Jul 17 11:40:54.309026 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.309011    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-63359af2\"/\"openshift-service-ca.crt\""
Jul 17 11:40:54.316760 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.316735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"]
Jul 17 11:40:54.378282 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.378254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tls-certs\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.378428 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.378304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-model-cache\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.378428 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.378358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmxnx\" (UniqueName: \"kubernetes.io/projected/71f9d40c-c2a4-4dd1-9ef2-476d33470435-kube-api-access-tmxnx\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.378534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.378445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-home\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.378534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.378487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-dshm\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.378534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.378524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tmp-dir\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479421 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-home\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479597 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-dshm\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479597 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tmp-dir\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479597 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tls-certs\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479597 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-model-cache\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479597 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmxnx\" (UniqueName: \"kubernetes.io/projected/71f9d40c-c2a4-4dd1-9ef2-476d33470435-kube-api-access-tmxnx\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479868 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-home\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.479868 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tmp-dir\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.480014 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.479922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-model-cache\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.481805 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.481782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-dshm\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.482008 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.481991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tls-certs\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.489165 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.489135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmxnx\" (UniqueName: \"kubernetes.io/projected/71f9d40c-c2a4-4dd1-9ef2-476d33470435-kube-api-access-tmxnx\") pod \"e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") " pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.616722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.616643    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:40:54.753460 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:54.753433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"]
Jul 17 11:40:54.755385 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:40:54.755363    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71f9d40c_c2a4_4dd1_9ef2_476d33470435.slice/crio-274a345939a0be01c9f8dd1dcfd67a8fdec6af9b93fba042c70a77a514b44d26 WatchSource:0}: Error finding container 274a345939a0be01c9f8dd1dcfd67a8fdec6af9b93fba042c70a77a514b44d26: Status 404 returned error can't find the container with id 274a345939a0be01c9f8dd1dcfd67a8fdec6af9b93fba042c70a77a514b44d26
Jul 17 11:40:55.004611 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:55.004576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx" event={"ID":"71f9d40c-c2a4-4dd1-9ef2-476d33470435","Type":"ContainerStarted","Data":"4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c"}
Jul 17 11:40:55.004801 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:55.004619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx" event={"ID":"71f9d40c-c2a4-4dd1-9ef2-476d33470435","Type":"ContainerStarted","Data":"274a345939a0be01c9f8dd1dcfd67a8fdec6af9b93fba042c70a77a514b44d26"}
Jul 17 11:40:55.026245 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:40:55.026201    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx" podStartSLOduration=1.026184707 podStartE2EDuration="1.026184707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:40:55.025832659 +0000 UTC m=+2609.783643078" watchObservedRunningTime="2026-07-17 11:40:55.026184707 +0000 UTC m=+2609.783995124"
Jul 17 11:41:04.616921 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:04.616882    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:41:04.619335 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:04.616932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:41:04.629201 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:04.629176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:41:05.067149 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:05.067120    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:41:29.868741 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:29.868705    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"]
Jul 17 11:41:29.869310 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:29.868909    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn" podUID="a9170951-58ed-4612-b77a-1bcc823438b8" containerName="maas-api" containerID="cri-o://7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897" gracePeriod=30
Jul 17 11:41:30.125284 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.125215    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:41:30.179337 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.179298    2564 generic.go:356] "Generic (PLEG): container finished" podID="a9170951-58ed-4612-b77a-1bcc823438b8" containerID="7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897" exitCode=0
Jul 17 11:41:30.179520 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.179345    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"
Jul 17 11:41:30.179520 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.179385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn" event={"ID":"a9170951-58ed-4612-b77a-1bcc823438b8","Type":"ContainerDied","Data":"7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897"}
Jul 17 11:41:30.179520 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.179444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn" event={"ID":"a9170951-58ed-4612-b77a-1bcc823438b8","Type":"ContainerDied","Data":"bb3569eb53b9db76eaa159f48b0fcb23d37705efc29b7ed60f8a1d486a70e82c"}
Jul 17 11:41:30.179520 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.179474    2564 scope.go:117] "RemoveContainer" containerID="7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897"
Jul 17 11:41:30.188441 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.188412    2564 scope.go:117] "RemoveContainer" containerID="7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897"
Jul 17 11:41:30.188740 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:41:30.188717    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897\": container with ID starting with 7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897 not found: ID does not exist" containerID="7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897"
Jul 17 11:41:30.188813 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.188748    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897"} err="failed to get container status \"7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897\": rpc error: code = NotFound desc = could not find container \"7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897\": container with ID starting with 7ba354cfa9a40fd3aaa3d1ecbabb8d90a25832d6ac105872383108e66b2c1897 not found: ID does not exist"
Jul 17 11:41:30.190018 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.189990    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9170951-58ed-4612-b77a-1bcc823438b8-maas-api-tls\") pod \"a9170951-58ed-4612-b77a-1bcc823438b8\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") "
Jul 17 11:41:30.190137 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.190070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9170951-58ed-4612-b77a-1bcc823438b8-openshift-service-ca\") pod \"a9170951-58ed-4612-b77a-1bcc823438b8\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") "
Jul 17 11:41:30.190188 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.190170    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkk7d\" (UniqueName: \"kubernetes.io/projected/a9170951-58ed-4612-b77a-1bcc823438b8-kube-api-access-pkk7d\") pod \"a9170951-58ed-4612-b77a-1bcc823438b8\" (UID: \"a9170951-58ed-4612-b77a-1bcc823438b8\") "
Jul 17 11:41:30.190410 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.190385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9170951-58ed-4612-b77a-1bcc823438b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9170951-58ed-4612-b77a-1bcc823438b8" (UID: "a9170951-58ed-4612-b77a-1bcc823438b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:41:30.192094 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.192061    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9170951-58ed-4612-b77a-1bcc823438b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9170951-58ed-4612-b77a-1bcc823438b8" (UID: "a9170951-58ed-4612-b77a-1bcc823438b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:41:30.192186 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.192157    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9170951-58ed-4612-b77a-1bcc823438b8-kube-api-access-pkk7d" (OuterVolumeSpecName: "kube-api-access-pkk7d") pod "a9170951-58ed-4612-b77a-1bcc823438b8" (UID: "a9170951-58ed-4612-b77a-1bcc823438b8"). InnerVolumeSpecName "kube-api-access-pkk7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:41:30.291544 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.291501    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkk7d\" (UniqueName: \"kubernetes.io/projected/a9170951-58ed-4612-b77a-1bcc823438b8-kube-api-access-pkk7d\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:30.291544 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.291536    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9170951-58ed-4612-b77a-1bcc823438b8-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:30.291544 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.291548    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9170951-58ed-4612-b77a-1bcc823438b8-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:30.504995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.504955    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"]
Jul 17 11:41:30.512223 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:30.512183    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-63359af2-65bc44f494-vbbxn"]
Jul 17 11:41:31.716761 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:31.716722    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9170951-58ed-4612-b77a-1bcc823438b8" path="/var/lib/kubelet/pods/a9170951-58ed-4612-b77a-1bcc823438b8/volumes"
Jul 17 11:41:39.322777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:39.322740    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"]
Jul 17 11:41:54.343498 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.343429    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx" podUID="71f9d40c-c2a4-4dd1-9ef2-476d33470435" containerName="main" containerID="cri-o://4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c" gracePeriod=45
Jul 17 11:41:54.605662 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.605583    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:41:54.720790 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.720743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-model-cache\") pod \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") "
Jul 17 11:41:54.721027 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.720822    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-dshm\") pod \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") "
Jul 17 11:41:54.721027 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.720848    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-home\") pod \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") "
Jul 17 11:41:54.721027 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.720918    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tls-certs\") pod \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") "
Jul 17 11:41:54.721027 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.720978    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmxnx\" (UniqueName: \"kubernetes.io/projected/71f9d40c-c2a4-4dd1-9ef2-476d33470435-kube-api-access-tmxnx\") pod \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") "
Jul 17 11:41:54.721027 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.721020    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tmp-dir\") pod \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\" (UID: \"71f9d40c-c2a4-4dd1-9ef2-476d33470435\") "
Jul 17 11:41:54.721277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.721050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-model-cache" (OuterVolumeSpecName: "model-cache") pod "71f9d40c-c2a4-4dd1-9ef2-476d33470435" (UID: "71f9d40c-c2a4-4dd1-9ef2-476d33470435"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:54.721277 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.721193    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-home" (OuterVolumeSpecName: "home") pod "71f9d40c-c2a4-4dd1-9ef2-476d33470435" (UID: "71f9d40c-c2a4-4dd1-9ef2-476d33470435"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:54.721379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.721313    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-model-cache\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:54.721379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.721332    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-home\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:54.721379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.721320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "71f9d40c-c2a4-4dd1-9ef2-476d33470435" (UID: "71f9d40c-c2a4-4dd1-9ef2-476d33470435"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:54.723192 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.723154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f9d40c-c2a4-4dd1-9ef2-476d33470435-kube-api-access-tmxnx" (OuterVolumeSpecName: "kube-api-access-tmxnx") pod "71f9d40c-c2a4-4dd1-9ef2-476d33470435" (UID: "71f9d40c-c2a4-4dd1-9ef2-476d33470435"). InnerVolumeSpecName "kube-api-access-tmxnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:41:54.723302 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.723182    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "71f9d40c-c2a4-4dd1-9ef2-476d33470435" (UID: "71f9d40c-c2a4-4dd1-9ef2-476d33470435"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:41:54.723302 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.723222    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-dshm" (OuterVolumeSpecName: "dshm") pod "71f9d40c-c2a4-4dd1-9ef2-476d33470435" (UID: "71f9d40c-c2a4-4dd1-9ef2-476d33470435"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:54.821872 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.821826    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-dshm\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:54.821872 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.821862    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tls-certs\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:54.821872 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.821875    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmxnx\" (UniqueName: \"kubernetes.io/projected/71f9d40c-c2a4-4dd1-9ef2-476d33470435-kube-api-access-tmxnx\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:54.822154 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:54.821888    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d40c-c2a4-4dd1-9ef2-476d33470435-tmp-dir\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:41:55.305578 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.305540    2564 generic.go:356] "Generic (PLEG): container finished" podID="71f9d40c-c2a4-4dd1-9ef2-476d33470435" containerID="4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c" exitCode=0
Jul 17 11:41:55.305777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.305604    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"
Jul 17 11:41:55.305777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.305621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx" event={"ID":"71f9d40c-c2a4-4dd1-9ef2-476d33470435","Type":"ContainerDied","Data":"4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c"}
Jul 17 11:41:55.305777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.305673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx" event={"ID":"71f9d40c-c2a4-4dd1-9ef2-476d33470435","Type":"ContainerDied","Data":"274a345939a0be01c9f8dd1dcfd67a8fdec6af9b93fba042c70a77a514b44d26"}
Jul 17 11:41:55.305777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.305693    2564 scope.go:117] "RemoveContainer" containerID="4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c"
Jul 17 11:41:55.315304 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.315282    2564 scope.go:117] "RemoveContainer" containerID="4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c"
Jul 17 11:41:55.315624 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:41:55.315606    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c\": container with ID starting with 4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c not found: ID does not exist" containerID="4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c"
Jul 17 11:41:55.315680 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.315633    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c"} err="failed to get container status \"4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c\": rpc error: code = NotFound desc = could not find container \"4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c\": container with ID starting with 4db77e35fdd90b0998b154e240ef707255ba42f80341631c766f89bb8a7f686c not found: ID does not exist"
Jul 17 11:41:55.329512 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.329451    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"]
Jul 17 11:41:55.331506 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.331474    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-63359af2/e2e-lifecycle-model-63359af2-kserve-7f4574b75-mjckx"]
Jul 17 11:41:55.716338 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:41:55.716293    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f9d40c-c2a4-4dd1-9ef2-476d33470435" path="/var/lib/kubelet/pods/71f9d40c-c2a4-4dd1-9ef2-476d33470435/volumes"
Jul 17 11:43:37.504065 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504024    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"]
Jul 17 11:43:37.504709 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504684    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9170951-58ed-4612-b77a-1bcc823438b8" containerName="maas-api"
Jul 17 11:43:37.504758 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504714    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9170951-58ed-4612-b77a-1bcc823438b8" containerName="maas-api"
Jul 17 11:43:37.504758 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504728    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f9d40c-c2a4-4dd1-9ef2-476d33470435" containerName="main"
Jul 17 11:43:37.504758 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504737    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f9d40c-c2a4-4dd1-9ef2-476d33470435" containerName="main"
Jul 17 11:43:37.504851 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504843    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9170951-58ed-4612-b77a-1bcc823438b8" containerName="maas-api"
Jul 17 11:43:37.504890 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.504858    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f9d40c-c2a4-4dd1-9ef2-476d33470435" containerName="main"
Jul 17 11:43:37.508556 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.508530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.513921 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.513891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-fc3287-serving-cert\""
Jul 17 11:43:37.522471 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.522433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"]
Jul 17 11:43:37.600234 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.600168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2a7012-26a8-4731-885a-15a87c2c35ee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.600234 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.600234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2dt\" (UniqueName: \"kubernetes.io/projected/bb2a7012-26a8-4731-885a-15a87c2c35ee-kube-api-access-jp2dt\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.600489 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.600265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.701203 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.701156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2a7012-26a8-4731-885a-15a87c2c35ee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.701203 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.701204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2dt\" (UniqueName: \"kubernetes.io/projected/bb2a7012-26a8-4731-885a-15a87c2c35ee-kube-api-access-jp2dt\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.701476 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.701316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.701531 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:43:37.701473    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-serving-cert: secret "maas-api-e2e-inf-a-fc3287-serving-cert" not found
Jul 17 11:43:37.701571 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:43:37.701548    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls podName:bb2a7012-26a8-4731-885a-15a87c2c35ee nodeName:}" failed. No retries permitted until 2026-07-17 11:43:38.201531113 +0000 UTC m=+2772.959341513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls") pod "maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" (UID: "bb2a7012-26a8-4731-885a-15a87c2c35ee") : secret "maas-api-e2e-inf-a-fc3287-serving-cert" not found
Jul 17 11:43:37.702007 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.701986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2a7012-26a8-4731-885a-15a87c2c35ee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:37.720903 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:37.720860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2dt\" (UniqueName: \"kubernetes.io/projected/bb2a7012-26a8-4731-885a-15a87c2c35ee-kube-api-access-jp2dt\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:38.206719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:38.206685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:38.209311 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:38.209280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls\") pod \"maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:38.421259 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:38.421211    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:38.577882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:38.577856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"]
Jul 17 11:43:38.580355 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:43:38.580325    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2a7012_26a8_4731_885a_15a87c2c35ee.slice/crio-9a891e2a18dec354fb7ca70c778045b84503e9803f9abf1043c38b2088f40365 WatchSource:0}: Error finding container 9a891e2a18dec354fb7ca70c778045b84503e9803f9abf1043c38b2088f40365: Status 404 returned error can't find the container with id 9a891e2a18dec354fb7ca70c778045b84503e9803f9abf1043c38b2088f40365
Jul 17 11:43:38.833284 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:38.833176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" event={"ID":"bb2a7012-26a8-4731-885a-15a87c2c35ee","Type":"ContainerStarted","Data":"9a891e2a18dec354fb7ca70c778045b84503e9803f9abf1043c38b2088f40365"}
Jul 17 11:43:39.840541 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:39.840503    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" event={"ID":"bb2a7012-26a8-4731-885a-15a87c2c35ee","Type":"ContainerStarted","Data":"ee379a73be5ef9cc609b135aa4c0bad3f1f8602df1aca6739f0494f8f960c195"}
Jul 17 11:43:39.841059 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:39.840636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:39.875037 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:39.874981    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" podStartSLOduration=2.390823958 podStartE2EDuration="2.874961933s" totalImagesPullingTime="484.137975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:43:39.873024342 +0000 UTC m=+2774.630834784" watchObservedRunningTime="2026-07-17 11:43:39.874961933 +0000 UTC m=+2774.632772347"
Jul 17 11:43:45.725138 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.725090    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"]
Jul 17 11:43:45.733438 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.733396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.736058 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.736031    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7c5b42-serving-cert\""
Jul 17 11:43:45.744981 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.744929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"]
Jul 17 11:43:45.782819 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.782778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaba0a33-0a21-4d5d-b61e-34d768f26be9-maas-api-tls\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.783070 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.783034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaba0a33-0a21-4d5d-b61e-34d768f26be9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.783143 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.783087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9xt\" (UniqueName: \"kubernetes.io/projected/eaba0a33-0a21-4d5d-b61e-34d768f26be9-kube-api-access-xx9xt\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.851320 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.851292    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:43:45.883685 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.883632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaba0a33-0a21-4d5d-b61e-34d768f26be9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.883685 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.883679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9xt\" (UniqueName: \"kubernetes.io/projected/eaba0a33-0a21-4d5d-b61e-34d768f26be9-kube-api-access-xx9xt\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.883987 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.883732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaba0a33-0a21-4d5d-b61e-34d768f26be9-maas-api-tls\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.884454 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.884427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaba0a33-0a21-4d5d-b61e-34d768f26be9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.886361 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.886334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaba0a33-0a21-4d5d-b61e-34d768f26be9-maas-api-tls\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:45.902015 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:45.901977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9xt\" (UniqueName: \"kubernetes.io/projected/eaba0a33-0a21-4d5d-b61e-34d768f26be9-kube-api-access-xx9xt\") pod \"maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:46.047172 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:46.047058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:46.213876 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:46.213840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"]
Jul 17 11:43:46.215968 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:43:46.215910    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaba0a33_0a21_4d5d_b61e_34d768f26be9.slice/crio-f893315dfbe96c17255ac7bbfd16402e133dd014118344eb557b9ab84eb8fcce WatchSource:0}: Error finding container f893315dfbe96c17255ac7bbfd16402e133dd014118344eb557b9ab84eb8fcce: Status 404 returned error can't find the container with id f893315dfbe96c17255ac7bbfd16402e133dd014118344eb557b9ab84eb8fcce
Jul 17 11:43:46.877780 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:46.877739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5" event={"ID":"eaba0a33-0a21-4d5d-b61e-34d768f26be9","Type":"ContainerStarted","Data":"5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458"}
Jul 17 11:43:46.878326 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:46.877794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5" event={"ID":"eaba0a33-0a21-4d5d-b61e-34d768f26be9","Type":"ContainerStarted","Data":"f893315dfbe96c17255ac7bbfd16402e133dd014118344eb557b9ab84eb8fcce"}
Jul 17 11:43:46.878326 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:46.877883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:43:46.906433 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:46.906368    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5" podStartSLOduration=1.425113653 podStartE2EDuration="1.906348951s" totalImagesPullingTime="481.235298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:43:46.904092317 +0000 UTC m=+2781.661902762" watchObservedRunningTime="2026-07-17 11:43:46.906348951 +0000 UTC m=+2781.664159369"
Jul 17 11:43:52.891273 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:43:52.891174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:44:24.400553 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.400504    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"]
Jul 17 11:44:24.404582 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.404556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.408553 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.408517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7c5b42\"/\"default-dockercfg-h24fr\""
Jul 17 11:44:24.408790 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.408517    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7c5b42\"/\"kube-root-ca.crt\""
Jul 17 11:44:24.408869 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.408517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7c5b42\"/\"test-model-7c5b42-kserve-self-signed-certs\""
Jul 17 11:44:24.408869 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.408579    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7c5b42\"/\"openshift-service-ca.crt\""
Jul 17 11:44:24.414860 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.414824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"]
Jul 17 11:44:24.452527 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.452488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-model-cache\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.452760 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.452599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjdt\" (UniqueName: \"kubernetes.io/projected/aac924db-ec0e-4a2b-b63a-2143ab1890f1-kube-api-access-5jjdt\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.452760 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.452670    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-home\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.452760 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.452721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-dshm\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.452760 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.452743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tmp-dir\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.452967 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.452765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tls-certs\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554307 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjdt\" (UniqueName: \"kubernetes.io/projected/aac924db-ec0e-4a2b-b63a-2143ab1890f1-kube-api-access-5jjdt\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554557 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-home\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554557 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554362    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-dshm\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554557 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tmp-dir\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554557 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tls-certs\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554557 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-model-cache\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.554905 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tmp-dir\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.555029 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-home\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.555029 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.554994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-model-cache\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.556995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.556969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-dshm\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.557265 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.557246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tls-certs\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.567040 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.567006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjdt\" (UniqueName: \"kubernetes.io/projected/aac924db-ec0e-4a2b-b63a-2143ab1890f1-kube-api-access-5jjdt\") pod \"test-model-7c5b42-kserve-7f88db687-mp2c4\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") " pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.717880 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.717779    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:24.881746 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:24.881713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"]
Jul 17 11:44:24.884322 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:44:24.884291    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaac924db_ec0e_4a2b_b63a_2143ab1890f1.slice/crio-a07561057f12fa1d669f0a1baacbc43d80ac9c340b5562fc543630c79f0dd531 WatchSource:0}: Error finding container a07561057f12fa1d669f0a1baacbc43d80ac9c340b5562fc543630c79f0dd531: Status 404 returned error can't find the container with id a07561057f12fa1d669f0a1baacbc43d80ac9c340b5562fc543630c79f0dd531
Jul 17 11:44:25.075373 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:25.075271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4" event={"ID":"aac924db-ec0e-4a2b-b63a-2143ab1890f1","Type":"ContainerStarted","Data":"0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08"}
Jul 17 11:44:25.075373 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:25.075323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4" event={"ID":"aac924db-ec0e-4a2b-b63a-2143ab1890f1","Type":"ContainerStarted","Data":"a07561057f12fa1d669f0a1baacbc43d80ac9c340b5562fc543630c79f0dd531"}
Jul 17 11:44:25.100997 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:25.100844    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4" podStartSLOduration=1.100813964 podStartE2EDuration="1.100813964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:44:25.093747706 +0000 UTC m=+2819.851558166" watchObservedRunningTime="2026-07-17 11:44:25.100813964 +0000 UTC m=+2819.858624383"
Jul 17 11:44:34.718541 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:34.718498    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:34.719045 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:34.718563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:34.731630 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:34.731594    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:44:35.141594 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:44:35.141566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:45:00.409680 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:00.409637    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"]
Jul 17 11:45:11.110577 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.110524    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"]
Jul 17 11:45:11.111138 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.110778    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" podUID="bb2a7012-26a8-4731-885a-15a87c2c35ee" containerName="maas-api" containerID="cri-o://ee379a73be5ef9cc609b135aa4c0bad3f1f8602df1aca6739f0494f8f960c195" gracePeriod=30
Jul 17 11:45:11.326507 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.326467    2564 generic.go:356] "Generic (PLEG): container finished" podID="bb2a7012-26a8-4731-885a-15a87c2c35ee" containerID="ee379a73be5ef9cc609b135aa4c0bad3f1f8602df1aca6739f0494f8f960c195" exitCode=0
Jul 17 11:45:11.326724 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.326542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" event={"ID":"bb2a7012-26a8-4731-885a-15a87c2c35ee","Type":"ContainerDied","Data":"ee379a73be5ef9cc609b135aa4c0bad3f1f8602df1aca6739f0494f8f960c195"}
Jul 17 11:45:11.380191 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.380154    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:45:11.519478 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.519433    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2a7012-26a8-4731-885a-15a87c2c35ee-openshift-service-ca\") pod \"bb2a7012-26a8-4731-885a-15a87c2c35ee\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") "
Jul 17 11:45:11.519698 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.519492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls\") pod \"bb2a7012-26a8-4731-885a-15a87c2c35ee\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") "
Jul 17 11:45:11.519698 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.519580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp2dt\" (UniqueName: \"kubernetes.io/projected/bb2a7012-26a8-4731-885a-15a87c2c35ee-kube-api-access-jp2dt\") pod \"bb2a7012-26a8-4731-885a-15a87c2c35ee\" (UID: \"bb2a7012-26a8-4731-885a-15a87c2c35ee\") "
Jul 17 11:45:11.519876 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.519847    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb2a7012-26a8-4731-885a-15a87c2c35ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb2a7012-26a8-4731-885a-15a87c2c35ee" (UID: "bb2a7012-26a8-4731-885a-15a87c2c35ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:45:11.521767 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.521722    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb2a7012-26a8-4731-885a-15a87c2c35ee" (UID: "bb2a7012-26a8-4731-885a-15a87c2c35ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:45:11.521910 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.521833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2a7012-26a8-4731-885a-15a87c2c35ee-kube-api-access-jp2dt" (OuterVolumeSpecName: "kube-api-access-jp2dt") pod "bb2a7012-26a8-4731-885a-15a87c2c35ee" (UID: "bb2a7012-26a8-4731-885a-15a87c2c35ee"). InnerVolumeSpecName "kube-api-access-jp2dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:45:11.620817 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.620717    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp2dt\" (UniqueName: \"kubernetes.io/projected/bb2a7012-26a8-4731-885a-15a87c2c35ee-kube-api-access-jp2dt\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:11.620817 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.620752    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb2a7012-26a8-4731-885a-15a87c2c35ee-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:11.620817 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:11.620764    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb2a7012-26a8-4731-885a-15a87c2c35ee-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:12.332707 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:12.332673    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"
Jul 17 11:45:12.333164 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:12.332709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz" event={"ID":"bb2a7012-26a8-4731-885a-15a87c2c35ee","Type":"ContainerDied","Data":"9a891e2a18dec354fb7ca70c778045b84503e9803f9abf1043c38b2088f40365"}
Jul 17 11:45:12.333164 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:12.332778    2564 scope.go:117] "RemoveContainer" containerID="ee379a73be5ef9cc609b135aa4c0bad3f1f8602df1aca6739f0494f8f960c195"
Jul 17 11:45:12.353140 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:12.353098    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"]
Jul 17 11:45:12.358601 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:12.358559    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fc3287-c979859c8-5f6cz"]
Jul 17 11:45:13.716837 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:13.716794    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2a7012-26a8-4731-885a-15a87c2c35ee" path="/var/lib/kubelet/pods/bb2a7012-26a8-4731-885a-15a87c2c35ee/volumes"
Jul 17 11:45:15.430840 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.430789    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4" podUID="aac924db-ec0e-4a2b-b63a-2143ab1890f1" containerName="main" containerID="cri-o://0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08" gracePeriod=45
Jul 17 11:45:15.707392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.707347    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:45:15.857311 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857272    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tmp-dir\") pod \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") "
Jul 17 11:45:15.857534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-model-cache\") pod \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") "
Jul 17 11:45:15.857534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857356    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-dshm\") pod \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") "
Jul 17 11:45:15.857534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jjdt\" (UniqueName: \"kubernetes.io/projected/aac924db-ec0e-4a2b-b63a-2143ab1890f1-kube-api-access-5jjdt\") pod \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") "
Jul 17 11:45:15.857534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-home\") pod \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") "
Jul 17 11:45:15.857534 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857476    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tls-certs\") pod \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\" (UID: \"aac924db-ec0e-4a2b-b63a-2143ab1890f1\") "
Jul 17 11:45:15.857824 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aac924db-ec0e-4a2b-b63a-2143ab1890f1" (UID: "aac924db-ec0e-4a2b-b63a-2143ab1890f1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:45:15.857824 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857657    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-model-cache" (OuterVolumeSpecName: "model-cache") pod "aac924db-ec0e-4a2b-b63a-2143ab1890f1" (UID: "aac924db-ec0e-4a2b-b63a-2143ab1890f1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:45:15.857824 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.857797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-home" (OuterVolumeSpecName: "home") pod "aac924db-ec0e-4a2b-b63a-2143ab1890f1" (UID: "aac924db-ec0e-4a2b-b63a-2143ab1890f1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:45:15.858097 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.858073    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tmp-dir\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:15.858176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.858102    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-model-cache\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:15.858176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.858116    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-home\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:15.860024 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.859991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aac924db-ec0e-4a2b-b63a-2143ab1890f1" (UID: "aac924db-ec0e-4a2b-b63a-2143ab1890f1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:45:15.860024 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.860012    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac924db-ec0e-4a2b-b63a-2143ab1890f1-kube-api-access-5jjdt" (OuterVolumeSpecName: "kube-api-access-5jjdt") pod "aac924db-ec0e-4a2b-b63a-2143ab1890f1" (UID: "aac924db-ec0e-4a2b-b63a-2143ab1890f1"). InnerVolumeSpecName "kube-api-access-5jjdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:45:15.860211 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.860071    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-dshm" (OuterVolumeSpecName: "dshm") pod "aac924db-ec0e-4a2b-b63a-2143ab1890f1" (UID: "aac924db-ec0e-4a2b-b63a-2143ab1890f1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:45:15.958871 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.958764    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac924db-ec0e-4a2b-b63a-2143ab1890f1-tls-certs\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:15.958871 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.958799    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac924db-ec0e-4a2b-b63a-2143ab1890f1-dshm\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:15.958871 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:15.958813    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jjdt\" (UniqueName: \"kubernetes.io/projected/aac924db-ec0e-4a2b-b63a-2143ab1890f1-kube-api-access-5jjdt\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:16.356126 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.356020    2564 generic.go:356] "Generic (PLEG): container finished" podID="aac924db-ec0e-4a2b-b63a-2143ab1890f1" containerID="0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08" exitCode=0
Jul 17 11:45:16.356126 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.356070    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"
Jul 17 11:45:16.356126 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.356104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4" event={"ID":"aac924db-ec0e-4a2b-b63a-2143ab1890f1","Type":"ContainerDied","Data":"0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08"}
Jul 17 11:45:16.356373 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.356158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4" event={"ID":"aac924db-ec0e-4a2b-b63a-2143ab1890f1","Type":"ContainerDied","Data":"a07561057f12fa1d669f0a1baacbc43d80ac9c340b5562fc543630c79f0dd531"}
Jul 17 11:45:16.356373 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.356177    2564 scope.go:117] "RemoveContainer" containerID="0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08"
Jul 17 11:45:16.366200 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.366179    2564 scope.go:117] "RemoveContainer" containerID="0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08"
Jul 17 11:45:16.366532 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:45:16.366511    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08\": container with ID starting with 0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08 not found: ID does not exist" containerID="0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08"
Jul 17 11:45:16.366588 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.366542    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08"} err="failed to get container status \"0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08\": rpc error: code = NotFound desc = could not find container \"0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08\": container with ID starting with 0addc32d00bbeac48d2032976daec6933abe60dca6846dc68804212d98d25d08 not found: ID does not exist"
Jul 17 11:45:16.388355 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.388314    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"]
Jul 17 11:45:16.393562 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:16.393524    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7c5b42/test-model-7c5b42-kserve-7f88db687-mp2c4"]
Jul 17 11:45:17.716925 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:17.716832    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac924db-ec0e-4a2b-b63a-2143ab1890f1" path="/var/lib/kubelet/pods/aac924db-ec0e-4a2b-b63a-2143ab1890f1/volumes"
Jul 17 11:45:37.434640 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.434592    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"]
Jul 17 11:45:37.435160 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.434820    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5" podUID="eaba0a33-0a21-4d5d-b61e-34d768f26be9" containerName="maas-api" containerID="cri-o://5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458" gracePeriod=30
Jul 17 11:45:37.690592 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.690509    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:45:37.759644 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.759599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaba0a33-0a21-4d5d-b61e-34d768f26be9-openshift-service-ca\") pod \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") "
Jul 17 11:45:37.759644 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.759651    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaba0a33-0a21-4d5d-b61e-34d768f26be9-maas-api-tls\") pod \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") "
Jul 17 11:45:37.759884 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.759710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx9xt\" (UniqueName: \"kubernetes.io/projected/eaba0a33-0a21-4d5d-b61e-34d768f26be9-kube-api-access-xx9xt\") pod \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\" (UID: \"eaba0a33-0a21-4d5d-b61e-34d768f26be9\") "
Jul 17 11:45:37.760137 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.760106    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaba0a33-0a21-4d5d-b61e-34d768f26be9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eaba0a33-0a21-4d5d-b61e-34d768f26be9" (UID: "eaba0a33-0a21-4d5d-b61e-34d768f26be9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:45:37.762087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.762050    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaba0a33-0a21-4d5d-b61e-34d768f26be9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eaba0a33-0a21-4d5d-b61e-34d768f26be9" (UID: "eaba0a33-0a21-4d5d-b61e-34d768f26be9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:45:37.762087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.762076    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaba0a33-0a21-4d5d-b61e-34d768f26be9-kube-api-access-xx9xt" (OuterVolumeSpecName: "kube-api-access-xx9xt") pod "eaba0a33-0a21-4d5d-b61e-34d768f26be9" (UID: "eaba0a33-0a21-4d5d-b61e-34d768f26be9"). InnerVolumeSpecName "kube-api-access-xx9xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:45:37.860866 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.860813    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaba0a33-0a21-4d5d-b61e-34d768f26be9-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:37.860866 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.860856    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaba0a33-0a21-4d5d-b61e-34d768f26be9-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:37.860866 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:37.860867    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx9xt\" (UniqueName: \"kubernetes.io/projected/eaba0a33-0a21-4d5d-b61e-34d768f26be9-kube-api-access-xx9xt\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:45:38.478968 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.478899    2564 generic.go:356] "Generic (PLEG): container finished" podID="eaba0a33-0a21-4d5d-b61e-34d768f26be9" containerID="5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458" exitCode=0
Jul 17 11:45:38.479479 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.478980    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"
Jul 17 11:45:38.479479 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.478993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5" event={"ID":"eaba0a33-0a21-4d5d-b61e-34d768f26be9","Type":"ContainerDied","Data":"5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458"}
Jul 17 11:45:38.479479 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.479055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5" event={"ID":"eaba0a33-0a21-4d5d-b61e-34d768f26be9","Type":"ContainerDied","Data":"f893315dfbe96c17255ac7bbfd16402e133dd014118344eb557b9ab84eb8fcce"}
Jul 17 11:45:38.479479 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.479080    2564 scope.go:117] "RemoveContainer" containerID="5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458"
Jul 17 11:45:38.489082 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.489053    2564 scope.go:117] "RemoveContainer" containerID="5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458"
Jul 17 11:45:38.489447 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:45:38.489420    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458\": container with ID starting with 5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458 not found: ID does not exist" containerID="5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458"
Jul 17 11:45:38.489536 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.489455    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458"} err="failed to get container status \"5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458\": rpc error: code = NotFound desc = could not find container \"5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458\": container with ID starting with 5ad57c79f161d9a69ee33a57b5374d27130c5b84c8884f0a187c3e437467b458 not found: ID does not exist"
Jul 17 11:45:38.506374 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.506337    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"]
Jul 17 11:45:38.514159 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:38.514113    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7c5b42-77b48cb98f-ds6c5"]
Jul 17 11:45:39.717080 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:39.717040    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaba0a33-0a21-4d5d-b61e-34d768f26be9" path="/var/lib/kubelet/pods/eaba0a33-0a21-4d5d-b61e-34d768f26be9/volumes"
Jul 17 11:45:56.347589 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.347542    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"]
Jul 17 11:45:56.348092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348005    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2a7012-26a8-4731-885a-15a87c2c35ee" containerName="maas-api"
Jul 17 11:45:56.348092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348023    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2a7012-26a8-4731-885a-15a87c2c35ee" containerName="maas-api"
Jul 17 11:45:56.348092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348044    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaba0a33-0a21-4d5d-b61e-34d768f26be9" containerName="maas-api"
Jul 17 11:45:56.348092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348050    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaba0a33-0a21-4d5d-b61e-34d768f26be9" containerName="maas-api"
Jul 17 11:45:56.348092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348058    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac924db-ec0e-4a2b-b63a-2143ab1890f1" containerName="main"
Jul 17 11:45:56.348092 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348063    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac924db-ec0e-4a2b-b63a-2143ab1890f1" containerName="main"
Jul 17 11:45:56.348291 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348131    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaba0a33-0a21-4d5d-b61e-34d768f26be9" containerName="maas-api"
Jul 17 11:45:56.348291 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348143    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2a7012-26a8-4731-885a-15a87c2c35ee" containerName="maas-api"
Jul 17 11:45:56.348291 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.348149    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac924db-ec0e-4a2b-b63a-2143ab1890f1" containerName="main"
Jul 17 11:45:56.352705 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.352677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.359033 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.359000    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c0bf60-serving-cert\""
Jul 17 11:45:56.366733 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.366697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"]
Jul 17 11:45:56.435949 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.435887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/946f9842-f781-49ec-9eb5-122d57e2df4c-maas-api-tls\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.436444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.435983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs6fb\" (UniqueName: \"kubernetes.io/projected/946f9842-f781-49ec-9eb5-122d57e2df4c-kube-api-access-cs6fb\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.436444 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.436033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/946f9842-f781-49ec-9eb5-122d57e2df4c-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.536975 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.536922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/946f9842-f781-49ec-9eb5-122d57e2df4c-maas-api-tls\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.537179 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.537003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs6fb\" (UniqueName: \"kubernetes.io/projected/946f9842-f781-49ec-9eb5-122d57e2df4c-kube-api-access-cs6fb\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.537179 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.537056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/946f9842-f781-49ec-9eb5-122d57e2df4c-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.537692 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.537672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/946f9842-f781-49ec-9eb5-122d57e2df4c-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.539560 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.539539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/946f9842-f781-49ec-9eb5-122d57e2df4c-maas-api-tls\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.547675 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.547645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs6fb\" (UniqueName: \"kubernetes.io/projected/946f9842-f781-49ec-9eb5-122d57e2df4c-kube-api-access-cs6fb\") pod \"maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.663707 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.663673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:56.826070 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.826030    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"]
Jul 17 11:45:56.830130 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:45:56.830101    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946f9842_f781_49ec_9eb5_122d57e2df4c.slice/crio-ab290dc3423323db842ae39f23236c91131c258b09a8ab64cb5a6d7046d97209 WatchSource:0}: Error finding container ab290dc3423323db842ae39f23236c91131c258b09a8ab64cb5a6d7046d97209: Status 404 returned error can't find the container with id ab290dc3423323db842ae39f23236c91131c258b09a8ab64cb5a6d7046d97209
Jul 17 11:45:56.831499 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:56.831479    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:45:57.582853 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:57.582754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77" event={"ID":"946f9842-f781-49ec-9eb5-122d57e2df4c","Type":"ContainerStarted","Data":"beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310"}
Jul 17 11:45:57.582853 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:57.582823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77" event={"ID":"946f9842-f781-49ec-9eb5-122d57e2df4c","Type":"ContainerStarted","Data":"ab290dc3423323db842ae39f23236c91131c258b09a8ab64cb5a6d7046d97209"}
Jul 17 11:45:57.582853 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:57.582853    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:45:57.601479 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:45:57.601414    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77" podStartSLOduration=1.161227893 podStartE2EDuration="1.601394797s" totalImagesPullingTime="440.166904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:45:57.5998979 +0000 UTC m=+2912.357708321" watchObservedRunningTime="2026-07-17 11:45:57.601394797 +0000 UTC m=+2912.359205219"
Jul 17 11:46:03.594181 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:03.594143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:46:04.354007 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.353963    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"]
Jul 17 11:46:04.358349 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.358304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.363447 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.363412    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a50d5b-serving-cert\""
Jul 17 11:46:04.370091 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.370051    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"]
Jul 17 11:46:04.514921 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.514887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815a2021-6526-4f54-b036-10637a32510a-maas-api-tls\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.514921 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.514925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tkxq\" (UniqueName: \"kubernetes.io/projected/815a2021-6526-4f54-b036-10637a32510a-kube-api-access-5tkxq\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.515180 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.515107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815a2021-6526-4f54-b036-10637a32510a-openshift-service-ca\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.616274 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.616186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815a2021-6526-4f54-b036-10637a32510a-openshift-service-ca\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.616274 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.616248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815a2021-6526-4f54-b036-10637a32510a-maas-api-tls\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.616744 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.616358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tkxq\" (UniqueName: \"kubernetes.io/projected/815a2021-6526-4f54-b036-10637a32510a-kube-api-access-5tkxq\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.617109 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.617031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815a2021-6526-4f54-b036-10637a32510a-openshift-service-ca\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.628863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.618980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815a2021-6526-4f54-b036-10637a32510a-maas-api-tls\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.628863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.626091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tkxq\" (UniqueName: \"kubernetes.io/projected/815a2021-6526-4f54-b036-10637a32510a-kube-api-access-5tkxq\") pod \"maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.672089 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.672050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:04.833852 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:04.833824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"]
Jul 17 11:46:04.836022 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:46:04.835992    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815a2021_6526_4f54_b036_10637a32510a.slice/crio-bab1c9e74d5dc6da2d3cdb1b169509a06014302259059d6a925c92aa5fc345df WatchSource:0}: Error finding container bab1c9e74d5dc6da2d3cdb1b169509a06014302259059d6a925c92aa5fc345df: Status 404 returned error can't find the container with id bab1c9e74d5dc6da2d3cdb1b169509a06014302259059d6a925c92aa5fc345df
Jul 17 11:46:05.628578 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:05.628528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6" event={"ID":"815a2021-6526-4f54-b036-10637a32510a","Type":"ContainerStarted","Data":"6d0b406e649ac816ee1d8ea053c1c2b3d55e012f774cf658d5c256521ce5e0b7"}
Jul 17 11:46:05.629050 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:05.628641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6" event={"ID":"815a2021-6526-4f54-b036-10637a32510a","Type":"ContainerStarted","Data":"bab1c9e74d5dc6da2d3cdb1b169509a06014302259059d6a925c92aa5fc345df"}
Jul 17 11:46:05.629050 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:05.628766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:05.647275 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:05.647208    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6" podStartSLOduration=1.052492686 podStartE2EDuration="1.647189675s" totalImagesPullingTime="594.696989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:46:05.646282452 +0000 UTC m=+2920.404092891" watchObservedRunningTime="2026-07-17 11:46:05.647189675 +0000 UTC m=+2920.405000130"
Jul 17 11:46:11.640112 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:11.640082    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:27.901470 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:27.901424    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"]
Jul 17 11:46:27.902006 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:27.901699    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77" podUID="946f9842-f781-49ec-9eb5-122d57e2df4c" containerName="maas-api" containerID="cri-o://beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310" gracePeriod=30
Jul 17 11:46:28.170533 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.170499    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:46:28.241358 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.241321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/946f9842-f781-49ec-9eb5-122d57e2df4c-maas-api-tls\") pod \"946f9842-f781-49ec-9eb5-122d57e2df4c\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") "
Jul 17 11:46:28.241551 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.241394    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/946f9842-f781-49ec-9eb5-122d57e2df4c-openshift-service-ca\") pod \"946f9842-f781-49ec-9eb5-122d57e2df4c\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") "
Jul 17 11:46:28.241551 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.241422    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs6fb\" (UniqueName: \"kubernetes.io/projected/946f9842-f781-49ec-9eb5-122d57e2df4c-kube-api-access-cs6fb\") pod \"946f9842-f781-49ec-9eb5-122d57e2df4c\" (UID: \"946f9842-f781-49ec-9eb5-122d57e2df4c\") "
Jul 17 11:46:28.241841 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.241807    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946f9842-f781-49ec-9eb5-122d57e2df4c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "946f9842-f781-49ec-9eb5-122d57e2df4c" (UID: "946f9842-f781-49ec-9eb5-122d57e2df4c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:46:28.243569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.243539    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946f9842-f781-49ec-9eb5-122d57e2df4c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "946f9842-f781-49ec-9eb5-122d57e2df4c" (UID: "946f9842-f781-49ec-9eb5-122d57e2df4c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:46:28.243569 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.243564    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946f9842-f781-49ec-9eb5-122d57e2df4c-kube-api-access-cs6fb" (OuterVolumeSpecName: "kube-api-access-cs6fb") pod "946f9842-f781-49ec-9eb5-122d57e2df4c" (UID: "946f9842-f781-49ec-9eb5-122d57e2df4c"). InnerVolumeSpecName "kube-api-access-cs6fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:46:28.342660 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.342615    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/946f9842-f781-49ec-9eb5-122d57e2df4c-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:46:28.342660 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.342659    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/946f9842-f781-49ec-9eb5-122d57e2df4c-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:46:28.342910 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.342676    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs6fb\" (UniqueName: \"kubernetes.io/projected/946f9842-f781-49ec-9eb5-122d57e2df4c-kube-api-access-cs6fb\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:46:28.755105 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.755062    2564 generic.go:356] "Generic (PLEG): container finished" podID="946f9842-f781-49ec-9eb5-122d57e2df4c" containerID="beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310" exitCode=0
Jul 17 11:46:28.755299 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.755128    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"
Jul 17 11:46:28.755299 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.755144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77" event={"ID":"946f9842-f781-49ec-9eb5-122d57e2df4c","Type":"ContainerDied","Data":"beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310"}
Jul 17 11:46:28.755299 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.755197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77" event={"ID":"946f9842-f781-49ec-9eb5-122d57e2df4c","Type":"ContainerDied","Data":"ab290dc3423323db842ae39f23236c91131c258b09a8ab64cb5a6d7046d97209"}
Jul 17 11:46:28.755299 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.755218    2564 scope.go:117] "RemoveContainer" containerID="beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310"
Jul 17 11:46:28.765081 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.765053    2564 scope.go:117] "RemoveContainer" containerID="beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310"
Jul 17 11:46:28.765393 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:46:28.765372    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310\": container with ID starting with beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310 not found: ID does not exist" containerID="beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310"
Jul 17 11:46:28.765445 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.765406    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310"} err="failed to get container status \"beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310\": rpc error: code = NotFound desc = could not find container \"beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310\": container with ID starting with beb8a41345805e251777c7d355394b305e338bc964cfe5fa73470afd625b1310 not found: ID does not exist"
Jul 17 11:46:28.780093 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.780060    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"]
Jul 17 11:46:28.783170 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:28.783131    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0bf60-54fcf667bf-jtr77"]
Jul 17 11:46:29.717287 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:29.717245    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946f9842-f781-49ec-9eb5-122d57e2df4c" path="/var/lib/kubelet/pods/946f9842-f781-49ec-9eb5-122d57e2df4c/volumes"
Jul 17 11:46:53.640970 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.640842    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"]
Jul 17 11:46:53.641566 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.641097    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6" podUID="815a2021-6526-4f54-b036-10637a32510a" containerName="maas-api" containerID="cri-o://6d0b406e649ac816ee1d8ea053c1c2b3d55e012f774cf658d5c256521ce5e0b7" gracePeriod=30
Jul 17 11:46:53.884381 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.884342    2564 generic.go:356] "Generic (PLEG): container finished" podID="815a2021-6526-4f54-b036-10637a32510a" containerID="6d0b406e649ac816ee1d8ea053c1c2b3d55e012f774cf658d5c256521ce5e0b7" exitCode=0
Jul 17 11:46:53.884568 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.884439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6" event={"ID":"815a2021-6526-4f54-b036-10637a32510a","Type":"ContainerDied","Data":"6d0b406e649ac816ee1d8ea053c1c2b3d55e012f774cf658d5c256521ce5e0b7"}
Jul 17 11:46:53.884568 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.884510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6" event={"ID":"815a2021-6526-4f54-b036-10637a32510a","Type":"ContainerDied","Data":"bab1c9e74d5dc6da2d3cdb1b169509a06014302259059d6a925c92aa5fc345df"}
Jul 17 11:46:53.884568 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.884528    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bab1c9e74d5dc6da2d3cdb1b169509a06014302259059d6a925c92aa5fc345df"
Jul 17 11:46:53.900468 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.900382    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:53.983863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.983824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815a2021-6526-4f54-b036-10637a32510a-maas-api-tls\") pod \"815a2021-6526-4f54-b036-10637a32510a\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") "
Jul 17 11:46:53.983863 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.983868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tkxq\" (UniqueName: \"kubernetes.io/projected/815a2021-6526-4f54-b036-10637a32510a-kube-api-access-5tkxq\") pod \"815a2021-6526-4f54-b036-10637a32510a\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") "
Jul 17 11:46:53.984150 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.983925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815a2021-6526-4f54-b036-10637a32510a-openshift-service-ca\") pod \"815a2021-6526-4f54-b036-10637a32510a\" (UID: \"815a2021-6526-4f54-b036-10637a32510a\") "
Jul 17 11:46:53.984360 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.984333    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/815a2021-6526-4f54-b036-10637a32510a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "815a2021-6526-4f54-b036-10637a32510a" (UID: "815a2021-6526-4f54-b036-10637a32510a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:46:53.986144 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.986109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/815a2021-6526-4f54-b036-10637a32510a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "815a2021-6526-4f54-b036-10637a32510a" (UID: "815a2021-6526-4f54-b036-10637a32510a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:46:53.986256 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:53.986185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/815a2021-6526-4f54-b036-10637a32510a-kube-api-access-5tkxq" (OuterVolumeSpecName: "kube-api-access-5tkxq") pod "815a2021-6526-4f54-b036-10637a32510a" (UID: "815a2021-6526-4f54-b036-10637a32510a"). InnerVolumeSpecName "kube-api-access-5tkxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:46:54.085135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:54.085090    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/815a2021-6526-4f54-b036-10637a32510a-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:46:54.085135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:54.085128    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tkxq\" (UniqueName: \"kubernetes.io/projected/815a2021-6526-4f54-b036-10637a32510a-kube-api-access-5tkxq\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:46:54.085135 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:54.085138    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/815a2021-6526-4f54-b036-10637a32510a-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:46:54.893200 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:54.891385    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"
Jul 17 11:46:54.918810 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:54.918769    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"]
Jul 17 11:46:54.923412 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:54.923366    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a50d5b-c97fd457d-rghb6"]
Jul 17 11:46:55.716972 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:46:55.716917    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="815a2021-6526-4f54-b036-10637a32510a" path="/var/lib/kubelet/pods/815a2021-6526-4f54-b036-10637a32510a/volumes"
Jul 17 11:47:12.899738 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.899699    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"]
Jul 17 11:47:12.900226 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.900136    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946f9842-f781-49ec-9eb5-122d57e2df4c" containerName="maas-api"
Jul 17 11:47:12.900226 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.900153    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="946f9842-f781-49ec-9eb5-122d57e2df4c" containerName="maas-api"
Jul 17 11:47:12.900226 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.900167    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="815a2021-6526-4f54-b036-10637a32510a" containerName="maas-api"
Jul 17 11:47:12.900226 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.900173    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="815a2021-6526-4f54-b036-10637a32510a" containerName="maas-api"
Jul 17 11:47:12.900427 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.900246    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="815a2021-6526-4f54-b036-10637a32510a" containerName="maas-api"
Jul 17 11:47:12.900427 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.900265    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="946f9842-f781-49ec-9eb5-122d57e2df4c" containerName="maas-api"
Jul 17 11:47:12.903527 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.903504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:12.906987 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.906914    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-ad4893-serving-cert\""
Jul 17 11:47:12.915229 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.915197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"]
Jul 17 11:47:12.961048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.961012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqx7\" (UniqueName: \"kubernetes.io/projected/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-kube-api-access-zdqx7\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:12.961232 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.961133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:12.961232 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:12.961167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.062697 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.062648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.062697 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.062699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.062969 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.062764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqx7\" (UniqueName: \"kubernetes.io/projected/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-kube-api-access-zdqx7\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.062969 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:47:13.062814    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-serving-cert: secret "maas-api-e2e-shared-a-ad4893-serving-cert" not found
Jul 17 11:47:13.062969 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:47:13.062894    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls podName:856425a6-dd58-488c-b31f-e8e3ea2f5bf7 nodeName:}" failed. No retries permitted until 2026-07-17 11:47:13.562878036 +0000 UTC m=+2988.320688432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls") pod "maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" (UID: "856425a6-dd58-488c-b31f-e8e3ea2f5bf7") : secret "maas-api-e2e-shared-a-ad4893-serving-cert" not found
Jul 17 11:47:13.063435 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.063412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.073555 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.073523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqx7\" (UniqueName: \"kubernetes.io/projected/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-kube-api-access-zdqx7\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.568528 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.568486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.571050 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.571022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls\") pod \"maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:13.815963 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:13.815901    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:14.002784 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:14.002752    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"]
Jul 17 11:47:14.006082 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:47:14.006045    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856425a6_dd58_488c_b31f_e8e3ea2f5bf7.slice/crio-a21d3a31ea1528d17ce91ba5d36250e3eda5dff8c3c189fe921a449939bd7943 WatchSource:0}: Error finding container a21d3a31ea1528d17ce91ba5d36250e3eda5dff8c3c189fe921a449939bd7943: Status 404 returned error can't find the container with id a21d3a31ea1528d17ce91ba5d36250e3eda5dff8c3c189fe921a449939bd7943
Jul 17 11:47:15.000190 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:15.000151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" event={"ID":"856425a6-dd58-488c-b31f-e8e3ea2f5bf7","Type":"ContainerStarted","Data":"91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5"}
Jul 17 11:47:15.000433 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:15.000235    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" event={"ID":"856425a6-dd58-488c-b31f-e8e3ea2f5bf7","Type":"ContainerStarted","Data":"a21d3a31ea1528d17ce91ba5d36250e3eda5dff8c3c189fe921a449939bd7943"}
Jul 17 11:47:15.000433 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:15.000315    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:15.027693 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:15.027632    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" podStartSLOduration=2.567276035 podStartE2EDuration="3.027613762s" totalImagesPullingTime="460.337727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:47:15.026454717 +0000 UTC m=+2989.784265134" watchObservedRunningTime="2026-07-17 11:47:15.027613762 +0000 UTC m=+2989.785424180"
Jul 17 11:47:20.854099 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.854057    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"]
Jul 17 11:47:20.858565 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.858537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:20.861098 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.861071    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9d836f-serving-cert\""
Jul 17 11:47:20.861977 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.861735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"]
Jul 17 11:47:20.951366 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.951319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28zkf\" (UniqueName: \"kubernetes.io/projected/d5198821-caa9-4395-9c47-0b6822490d36-kube-api-access-28zkf\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:20.951598 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.951481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5198821-caa9-4395-9c47-0b6822490d36-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:20.951598 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:20.951563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.011399 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.011364    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:47:21.052186 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.052150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5198821-caa9-4395-9c47-0b6822490d36-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.052392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.052210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.052392 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.052236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28zkf\" (UniqueName: \"kubernetes.io/projected/d5198821-caa9-4395-9c47-0b6822490d36-kube-api-access-28zkf\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.052392 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:47:21.052360    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-serving-cert: secret "maas-api-e2e-shared-b-9d836f-serving-cert" not found
Jul 17 11:47:21.052601 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:47:21.052438    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls podName:d5198821-caa9-4395-9c47-0b6822490d36 nodeName:}" failed. No retries permitted until 2026-07-17 11:47:21.552411032 +0000 UTC m=+2996.310221429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls") pod "maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" (UID: "d5198821-caa9-4395-9c47-0b6822490d36") : secret "maas-api-e2e-shared-b-9d836f-serving-cert" not found
Jul 17 11:47:21.052905 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.052879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5198821-caa9-4395-9c47-0b6822490d36-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.063393 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.063361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28zkf\" (UniqueName: \"kubernetes.io/projected/d5198821-caa9-4395-9c47-0b6822490d36-kube-api-access-28zkf\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.558225 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.558179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.560982 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.560895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls\") pod \"maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.771557 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.771510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:21.921912 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:21.921876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"]
Jul 17 11:47:21.924881 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:47:21.924845    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5198821_caa9_4395_9c47_0b6822490d36.slice/crio-bc9bb50e8d7cb4d444a0b96976aab59e76abf61c7cc5c964529e3d69ddca4742 WatchSource:0}: Error finding container bc9bb50e8d7cb4d444a0b96976aab59e76abf61c7cc5c964529e3d69ddca4742: Status 404 returned error can't find the container with id bc9bb50e8d7cb4d444a0b96976aab59e76abf61c7cc5c964529e3d69ddca4742
Jul 17 11:47:22.037584 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:22.037537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" event={"ID":"d5198821-caa9-4395-9c47-0b6822490d36","Type":"ContainerStarted","Data":"bc9bb50e8d7cb4d444a0b96976aab59e76abf61c7cc5c964529e3d69ddca4742"}
Jul 17 11:47:23.044291 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:23.044248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" event={"ID":"d5198821-caa9-4395-9c47-0b6822490d36","Type":"ContainerStarted","Data":"2595b4db0d90b26a0e11f44fac0b97b530850d71e0f6e841163b5a18e6928d2a"}
Jul 17 11:47:23.044698 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:23.044334    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:47:23.065046 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:23.064981    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" podStartSLOduration=2.648087694 podStartE2EDuration="3.064957001s" totalImagesPullingTime="416.869307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:47:23.064509977 +0000 UTC m=+2997.822320397" watchObservedRunningTime="2026-07-17 11:47:23.064957001 +0000 UTC m=+2997.822767411"
Jul 17 11:47:29.054986 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:47:29.054955    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:49:09.762828 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:09.762780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xjv44"]
Jul 17 11:49:09.766807 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:09.766777    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:09.775681 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:09.775644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xjv44"]
Jul 17 11:49:09.858339 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:09.858294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx5g2\" (UniqueName: \"kubernetes.io/projected/2905b936-413c-4910-af05-8a6c90da0744-kube-api-access-mx5g2\") pod \"kuadrant-operator-catalog-xjv44\" (UID: \"2905b936-413c-4910-af05-8a6c90da0744\") " pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:09.958920 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:09.958873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx5g2\" (UniqueName: \"kubernetes.io/projected/2905b936-413c-4910-af05-8a6c90da0744-kube-api-access-mx5g2\") pod \"kuadrant-operator-catalog-xjv44\" (UID: \"2905b936-413c-4910-af05-8a6c90da0744\") " pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:09.968897 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:09.968860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx5g2\" (UniqueName: \"kubernetes.io/projected/2905b936-413c-4910-af05-8a6c90da0744-kube-api-access-mx5g2\") pod \"kuadrant-operator-catalog-xjv44\" (UID: \"2905b936-413c-4910-af05-8a6c90da0744\") " pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:10.079356 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:10.079264    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:10.224727 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:10.224697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xjv44"]
Jul 17 11:49:10.227473 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:49:10.227433    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2905b936_413c_4910_af05_8a6c90da0744.slice/crio-29cedc1c6840e7963ebc43e56a2a108bcf359d62061f0d1d06299d7d36e15794 WatchSource:0}: Error finding container 29cedc1c6840e7963ebc43e56a2a108bcf359d62061f0d1d06299d7d36e15794: Status 404 returned error can't find the container with id 29cedc1c6840e7963ebc43e56a2a108bcf359d62061f0d1d06299d7d36e15794
Jul 17 11:49:10.595641 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:10.595602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xjv44" event={"ID":"2905b936-413c-4910-af05-8a6c90da0744","Type":"ContainerStarted","Data":"29cedc1c6840e7963ebc43e56a2a108bcf359d62061f0d1d06299d7d36e15794"}
Jul 17 11:49:11.603404 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:11.603360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xjv44" event={"ID":"2905b936-413c-4910-af05-8a6c90da0744","Type":"ContainerStarted","Data":"535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965"}
Jul 17 11:49:11.622414 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:11.622361    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xjv44" podStartSLOduration=2.102103144 podStartE2EDuration="2.622340726s" totalImagesPullingTime="520.237582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:49:11.620593421 +0000 UTC m=+3106.378403860" watchObservedRunningTime="2026-07-17 11:49:11.622340726 +0000 UTC m=+3106.380151144"
Jul 17 11:49:20.079744 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:20.079700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:20.080347 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:20.079780    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:20.104130 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:20.104096    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:20.681909 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:20.681877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:20.726466 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:20.726419    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xjv44"]
Jul 17 11:49:22.668207 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:22.668157    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xjv44" podUID="2905b936-413c-4910-af05-8a6c90da0744" containerName="registry-server" containerID="cri-o://535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965" gracePeriod=2
Jul 17 11:49:22.930547 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:22.930471    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:23.083493 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.083443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx5g2\" (UniqueName: \"kubernetes.io/projected/2905b936-413c-4910-af05-8a6c90da0744-kube-api-access-mx5g2\") pod \"2905b936-413c-4910-af05-8a6c90da0744\" (UID: \"2905b936-413c-4910-af05-8a6c90da0744\") "
Jul 17 11:49:23.085719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.085681    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2905b936-413c-4910-af05-8a6c90da0744-kube-api-access-mx5g2" (OuterVolumeSpecName: "kube-api-access-mx5g2") pod "2905b936-413c-4910-af05-8a6c90da0744" (UID: "2905b936-413c-4910-af05-8a6c90da0744"). InnerVolumeSpecName "kube-api-access-mx5g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:49:23.185084 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.184992    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx5g2\" (UniqueName: \"kubernetes.io/projected/2905b936-413c-4910-af05-8a6c90da0744-kube-api-access-mx5g2\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:49:23.674427 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.674384    2564 generic.go:356] "Generic (PLEG): container finished" podID="2905b936-413c-4910-af05-8a6c90da0744" containerID="535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965" exitCode=0
Jul 17 11:49:23.674851 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.674436    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xjv44"
Jul 17 11:49:23.674851 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.674482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xjv44" event={"ID":"2905b936-413c-4910-af05-8a6c90da0744","Type":"ContainerDied","Data":"535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965"}
Jul 17 11:49:23.674851 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.674526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xjv44" event={"ID":"2905b936-413c-4910-af05-8a6c90da0744","Type":"ContainerDied","Data":"29cedc1c6840e7963ebc43e56a2a108bcf359d62061f0d1d06299d7d36e15794"}
Jul 17 11:49:23.674851 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.674550    2564 scope.go:117] "RemoveContainer" containerID="535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965"
Jul 17 11:49:23.685435 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.685404    2564 scope.go:117] "RemoveContainer" containerID="535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965"
Jul 17 11:49:23.685856 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:49:23.685834    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965\": container with ID starting with 535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965 not found: ID does not exist" containerID="535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965"
Jul 17 11:49:23.685911 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.685866    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965"} err="failed to get container status \"535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965\": rpc error: code = NotFound desc = could not find container \"535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965\": container with ID starting with 535d36fca61a29fc76bc7bdc4bcbf21c29ec80680687466fc0e82ee37807d965 not found: ID does not exist"
Jul 17 11:49:23.707722 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.707649    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xjv44"]
Jul 17 11:49:23.716808 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:23.716778    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xjv44"]
Jul 17 11:49:25.717623 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:49:25.717577    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2905b936-413c-4910-af05-8a6c90da0744" path="/var/lib/kubelet/pods/2905b936-413c-4910-af05-8a6c90da0744/volumes"
Jul 17 11:51:45.392154 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.392108    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"]
Jul 17 11:51:45.392812 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.392775    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2905b936-413c-4910-af05-8a6c90da0744" containerName="registry-server"
Jul 17 11:51:45.392812 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.392796    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2905b936-413c-4910-af05-8a6c90da0744" containerName="registry-server"
Jul 17 11:51:45.392976 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.392877    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2905b936-413c-4910-af05-8a6c90da0744" containerName="registry-server"
Jul 17 11:51:45.396139 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.396115    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.398817 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.398772    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ad4893\"/\"kube-root-ca.crt\""
Jul 17 11:51:45.399833 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.399809    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ad4893\"/\"openshift-service-ca.crt\""
Jul 17 11:51:45.400023 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.399830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ad4893\"/\"default-dockercfg-9dnx7\""
Jul 17 11:51:45.400252 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.399888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ad4893\"/\"rate-test-model-ad4893-kserve-self-signed-certs\""
Jul 17 11:51:45.405516 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.405473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"]
Jul 17 11:51:45.460372 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.460329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-home\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.460372 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.460368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tmp-dir\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.460632 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.460393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpls\" (UniqueName: \"kubernetes.io/projected/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-kube-api-access-4cpls\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.460632 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.460491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-model-cache\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.460632 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.460514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-dshm\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.460632 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.460534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tls-certs\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.561616 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.561567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-model-cache\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.561616 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.561616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-dshm\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.561896 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.561639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tls-certs\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.561896 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.561688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-home\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.561896 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.561705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tmp-dir\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.561896 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.561727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpls\" (UniqueName: \"kubernetes.io/projected/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-kube-api-access-4cpls\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.562165 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.562112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-model-cache\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.562215 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.562171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-home\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.562305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.562276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tmp-dir\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.564013 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.563987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-dshm\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.564385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.564364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tls-certs\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.571995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.571961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpls\" (UniqueName: \"kubernetes.io/projected/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-kube-api-access-4cpls\") pod \"rate-test-model-ad4893-kserve-775f75d96c-rb2tq\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") " pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.710241 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.710138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:45.865764 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:45.865711    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"]
Jul 17 11:51:45.868126 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:51:45.868091    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00cfc62b_640f_4053_bc6b_2b4da1a04a5a.slice/crio-864bcb67c3b9a74b3b03aadb188c97b7c4adc3df3a87511dd844a64b34dbfa0e WatchSource:0}: Error finding container 864bcb67c3b9a74b3b03aadb188c97b7c4adc3df3a87511dd844a64b34dbfa0e: Status 404 returned error can't find the container with id 864bcb67c3b9a74b3b03aadb188c97b7c4adc3df3a87511dd844a64b34dbfa0e
Jul 17 11:51:46.430862 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:46.430823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq" event={"ID":"00cfc62b-640f-4053-bc6b-2b4da1a04a5a","Type":"ContainerStarted","Data":"a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c"}
Jul 17 11:51:46.431288 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:46.430873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq" event={"ID":"00cfc62b-640f-4053-bc6b-2b4da1a04a5a","Type":"ContainerStarted","Data":"864bcb67c3b9a74b3b03aadb188c97b7c4adc3df3a87511dd844a64b34dbfa0e"}
Jul 17 11:51:46.449141 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:46.449082    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq" podStartSLOduration=1.449062412 podStartE2EDuration="1.449062412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:51:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:51:46.448368766 +0000 UTC m=+3261.206179184" watchObservedRunningTime="2026-07-17 11:51:46.449062412 +0000 UTC m=+3261.206872852"
Jul 17 11:51:55.716893 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:55.716856    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:55.717305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:55.716905    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:55.726000 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:55.725970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:51:56.496077 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:51:56.496042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:52:28.447819 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:52:28.447783    2564 scope.go:117] "RemoveContainer" containerID="6d0b406e649ac816ee1d8ea053c1c2b3d55e012f774cf658d5c256521ce5e0b7"
Jul 17 11:52:58.113388 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:52:58.113305    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"]
Jul 17 11:53:13.134517 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.134453    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq" podUID="00cfc62b-640f-4053-bc6b-2b4da1a04a5a" containerName="main" containerID="cri-o://a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c" gracePeriod=45
Jul 17 11:53:13.410638 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.410606    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:53:13.476207 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476163    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-home\") pod \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") "
Jul 17 11:53:13.476207 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476205    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-dshm\") pod \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") "
Jul 17 11:53:13.476447 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476260    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-model-cache\") pod \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") "
Jul 17 11:53:13.476447 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476361    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cpls\" (UniqueName: \"kubernetes.io/projected/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-kube-api-access-4cpls\") pod \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") "
Jul 17 11:53:13.476447 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476382    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tmp-dir\") pod \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") "
Jul 17 11:53:13.476447 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476404    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tls-certs\") pod \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\" (UID: \"00cfc62b-640f-4053-bc6b-2b4da1a04a5a\") "
Jul 17 11:53:13.476654 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-home" (OuterVolumeSpecName: "home") pod "00cfc62b-640f-4053-bc6b-2b4da1a04a5a" (UID: "00cfc62b-640f-4053-bc6b-2b4da1a04a5a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:53:13.476712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476681    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-home\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:13.476712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476682    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "00cfc62b-640f-4053-bc6b-2b4da1a04a5a" (UID: "00cfc62b-640f-4053-bc6b-2b4da1a04a5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:53:13.476712 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.476691    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00cfc62b-640f-4053-bc6b-2b4da1a04a5a" (UID: "00cfc62b-640f-4053-bc6b-2b4da1a04a5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:53:13.478577 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.478544    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-dshm" (OuterVolumeSpecName: "dshm") pod "00cfc62b-640f-4053-bc6b-2b4da1a04a5a" (UID: "00cfc62b-640f-4053-bc6b-2b4da1a04a5a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:53:13.478719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.478590    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-kube-api-access-4cpls" (OuterVolumeSpecName: "kube-api-access-4cpls") pod "00cfc62b-640f-4053-bc6b-2b4da1a04a5a" (UID: "00cfc62b-640f-4053-bc6b-2b4da1a04a5a"). InnerVolumeSpecName "kube-api-access-4cpls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:53:13.478719 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.478654    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00cfc62b-640f-4053-bc6b-2b4da1a04a5a" (UID: "00cfc62b-640f-4053-bc6b-2b4da1a04a5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:53:13.577808 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.577763    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-dshm\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:13.577808 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.577796    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-model-cache\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:13.577808 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.577808    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cpls\" (UniqueName: \"kubernetes.io/projected/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-kube-api-access-4cpls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:13.577808 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.577818    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tmp-dir\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:13.578117 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.577828    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00cfc62b-640f-4053-bc6b-2b4da1a04a5a-tls-certs\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:13.882244 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.882196    2564 generic.go:356] "Generic (PLEG): container finished" podID="00cfc62b-640f-4053-bc6b-2b4da1a04a5a" containerID="a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c" exitCode=0
Jul 17 11:53:13.882244 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.882239    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"
Jul 17 11:53:13.882482 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.882264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq" event={"ID":"00cfc62b-640f-4053-bc6b-2b4da1a04a5a","Type":"ContainerDied","Data":"a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c"}
Jul 17 11:53:13.882482 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.882309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq" event={"ID":"00cfc62b-640f-4053-bc6b-2b4da1a04a5a","Type":"ContainerDied","Data":"864bcb67c3b9a74b3b03aadb188c97b7c4adc3df3a87511dd844a64b34dbfa0e"}
Jul 17 11:53:13.882482 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.882334    2564 scope.go:117] "RemoveContainer" containerID="a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c"
Jul 17 11:53:13.892023 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.891993    2564 scope.go:117] "RemoveContainer" containerID="a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c"
Jul 17 11:53:13.892409 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:53:13.892378    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c\": container with ID starting with a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c not found: ID does not exist" containerID="a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c"
Jul 17 11:53:13.892563 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.892418    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c"} err="failed to get container status \"a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c\": rpc error: code = NotFound desc = could not find container \"a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c\": container with ID starting with a4292e0099e60cada6907027e91e369206f08f1f95682126a2d37a30d866c44c not found: ID does not exist"
Jul 17 11:53:13.901629 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.901590    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"]
Jul 17 11:53:13.905997 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:13.905962    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ad4893/rate-test-model-ad4893-kserve-775f75d96c-rb2tq"]
Jul 17 11:53:15.716439 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:15.716400    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00cfc62b-640f-4053-bc6b-2b4da1a04a5a" path="/var/lib/kubelet/pods/00cfc62b-640f-4053-bc6b-2b4da1a04a5a/volumes"
Jul 17 11:53:28.599650 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.599601    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"]
Jul 17 11:53:28.600274 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.599929    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" podUID="856425a6-dd58-488c-b31f-e8e3ea2f5bf7" containerName="maas-api" containerID="cri-o://91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5" gracePeriod=30
Jul 17 11:53:28.859379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.859349    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:53:28.926931 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.926894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdqx7\" (UniqueName: \"kubernetes.io/projected/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-kube-api-access-zdqx7\") pod \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") "
Jul 17 11:53:28.926931 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.926974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-openshift-service-ca\") pod \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") "
Jul 17 11:53:28.927233 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.927071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls\") pod \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\" (UID: \"856425a6-dd58-488c-b31f-e8e3ea2f5bf7\") "
Jul 17 11:53:28.927427 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.927387    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "856425a6-dd58-488c-b31f-e8e3ea2f5bf7" (UID: "856425a6-dd58-488c-b31f-e8e3ea2f5bf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:53:28.929217 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.929192    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "856425a6-dd58-488c-b31f-e8e3ea2f5bf7" (UID: "856425a6-dd58-488c-b31f-e8e3ea2f5bf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:53:28.929217 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.929207    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-kube-api-access-zdqx7" (OuterVolumeSpecName: "kube-api-access-zdqx7") pod "856425a6-dd58-488c-b31f-e8e3ea2f5bf7" (UID: "856425a6-dd58-488c-b31f-e8e3ea2f5bf7"). InnerVolumeSpecName "kube-api-access-zdqx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:53:28.963846 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.963803    2564 generic.go:356] "Generic (PLEG): container finished" podID="856425a6-dd58-488c-b31f-e8e3ea2f5bf7" containerID="91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5" exitCode=0
Jul 17 11:53:28.963846 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.963851    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"
Jul 17 11:53:28.964087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.963884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" event={"ID":"856425a6-dd58-488c-b31f-e8e3ea2f5bf7","Type":"ContainerDied","Data":"91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5"}
Jul 17 11:53:28.964087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.963955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9" event={"ID":"856425a6-dd58-488c-b31f-e8e3ea2f5bf7","Type":"ContainerDied","Data":"a21d3a31ea1528d17ce91ba5d36250e3eda5dff8c3c189fe921a449939bd7943"}
Jul 17 11:53:28.964087 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.963984    2564 scope.go:117] "RemoveContainer" containerID="91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5"
Jul 17 11:53:28.973490 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.973471    2564 scope.go:117] "RemoveContainer" containerID="91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5"
Jul 17 11:53:28.973767 ip-10-0-131-118 kubenswrapper[2564]: E0717 11:53:28.973743    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5\": container with ID starting with 91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5 not found: ID does not exist" containerID="91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5"
Jul 17 11:53:28.973837 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.973778    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5"} err="failed to get container status \"91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5\": rpc error: code = NotFound desc = could not find container \"91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5\": container with ID starting with 91545a8965e673a83bbe492f59c951c7ab0556825564ae49fe65fc949a5ab2b5 not found: ID does not exist"
Jul 17 11:53:28.987969 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.987920    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"]
Jul 17 11:53:28.994328 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:28.994291    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ad4893-56fcbc7cb8-jn8n9"]
Jul 17 11:53:29.027799 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:29.027719    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:29.027799 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:29.027751    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdqx7\" (UniqueName: \"kubernetes.io/projected/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-kube-api-access-zdqx7\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:29.027799 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:29.027774    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/856425a6-dd58-488c-b31f-e8e3ea2f5bf7-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:29.716986 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:29.716926    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="856425a6-dd58-488c-b31f-e8e3ea2f5bf7" path="/var/lib/kubelet/pods/856425a6-dd58-488c-b31f-e8e3ea2f5bf7/volumes"
Jul 17 11:53:54.885900 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:54.885852    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"]
Jul 17 11:53:54.886432 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:54.886092    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" podUID="d5198821-caa9-4395-9c47-0b6822490d36" containerName="maas-api" containerID="cri-o://2595b4db0d90b26a0e11f44fac0b97b530850d71e0f6e841163b5a18e6928d2a" gracePeriod=30
Jul 17 11:53:55.102508 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.102472    2564 generic.go:356] "Generic (PLEG): container finished" podID="d5198821-caa9-4395-9c47-0b6822490d36" containerID="2595b4db0d90b26a0e11f44fac0b97b530850d71e0f6e841163b5a18e6928d2a" exitCode=0
Jul 17 11:53:55.102695 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.102549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" event={"ID":"d5198821-caa9-4395-9c47-0b6822490d36","Type":"ContainerDied","Data":"2595b4db0d90b26a0e11f44fac0b97b530850d71e0f6e841163b5a18e6928d2a"}
Jul 17 11:53:55.152064 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.152033    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:53:55.179156 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.179125    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5198821-caa9-4395-9c47-0b6822490d36-openshift-service-ca\") pod \"d5198821-caa9-4395-9c47-0b6822490d36\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") "
Jul 17 11:53:55.179355 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.179226    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls\") pod \"d5198821-caa9-4395-9c47-0b6822490d36\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") "
Jul 17 11:53:55.179355 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.179295    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28zkf\" (UniqueName: \"kubernetes.io/projected/d5198821-caa9-4395-9c47-0b6822490d36-kube-api-access-28zkf\") pod \"d5198821-caa9-4395-9c47-0b6822490d36\" (UID: \"d5198821-caa9-4395-9c47-0b6822490d36\") "
Jul 17 11:53:55.179578 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.179552    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5198821-caa9-4395-9c47-0b6822490d36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5198821-caa9-4395-9c47-0b6822490d36" (UID: "d5198821-caa9-4395-9c47-0b6822490d36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:53:55.181381 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.181353    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5198821-caa9-4395-9c47-0b6822490d36-kube-api-access-28zkf" (OuterVolumeSpecName: "kube-api-access-28zkf") pod "d5198821-caa9-4395-9c47-0b6822490d36" (UID: "d5198821-caa9-4395-9c47-0b6822490d36"). InnerVolumeSpecName "kube-api-access-28zkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:53:55.181513 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.181361    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5198821-caa9-4395-9c47-0b6822490d36" (UID: "d5198821-caa9-4395-9c47-0b6822490d36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:53:55.280116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.280070    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5198821-caa9-4395-9c47-0b6822490d36-maas-api-tls\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:55.280116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.280109    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28zkf\" (UniqueName: \"kubernetes.io/projected/d5198821-caa9-4395-9c47-0b6822490d36-kube-api-access-28zkf\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:55.280116 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:55.280118    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5198821-caa9-4395-9c47-0b6822490d36-openshift-service-ca\") on node \"ip-10-0-131-118.ec2.internal\" DevicePath \"\""
Jul 17 11:53:56.108691 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:56.108594    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"
Jul 17 11:53:56.108691 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:56.108607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97" event={"ID":"d5198821-caa9-4395-9c47-0b6822490d36","Type":"ContainerDied","Data":"bc9bb50e8d7cb4d444a0b96976aab59e76abf61c7cc5c964529e3d69ddca4742"}
Jul 17 11:53:56.109250 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:56.108705    2564 scope.go:117] "RemoveContainer" containerID="2595b4db0d90b26a0e11f44fac0b97b530850d71e0f6e841163b5a18e6928d2a"
Jul 17 11:53:56.133981 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:56.133930    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"]
Jul 17 11:53:56.138225 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:56.138190    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9d836f-5dfbc85d6-rrc97"]
Jul 17 11:53:57.717074 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:53:57.717034    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5198821-caa9-4395-9c47-0b6822490d36" path="/var/lib/kubelet/pods/d5198821-caa9-4395-9c47-0b6822490d36/volumes"
Jul 17 11:54:16.836598 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:16.836560    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7858c79586-t7l9l_ea5aed11-bc14-462c-b7fe-3d2cf2178353/manager/0.log"
Jul 17 11:54:17.482000 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:17.481963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd97f7fc7-htl45_fb09e448-18d1-42fc-9d77-84f98476317e/copy-manifests/0.log"
Jul 17 11:54:17.490099 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:17.490053    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd97f7fc7-htl45_fb09e448-18d1-42fc-9d77-84f98476317e/manager/0.log"
Jul 17 11:54:17.861352 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:17.861238    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7897454b47-t5xd9_8a17ffe5-491e-4ceb-bc41-3d805b78fe62/maas-api/0.log"
Jul 17 11:54:19.377276 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:19.377236    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-h58qc_ea0c3e36-07fb-49ff-997b-6e097b4bf2b7/postgres/0.log"
Jul 17 11:54:20.858333 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:20.858294    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zpmjk_e25f291c-cf65-4048-a5b6-16d382d7302d/manager/0.log"
Jul 17 11:54:20.978408 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:20.978382    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2k78k_ed4344e7-bd71-41b1-b2d6-3193b87b22c8/manager/0.log"
Jul 17 11:54:21.095501 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:21.095471    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vkt9x_44dba105-c86b-4260-818e-1694924367e2/kuadrant-console-plugin/0.log"
Jul 17 11:54:21.216881 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:21.216853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tfpl6_3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3/registry-server/0.log"
Jul 17 11:54:21.341393 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:21.341340    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qm52t_30c8b70c-5a70-4d01-9864-c32c3c0f5bec/manager/0.log"
Jul 17 11:54:22.560189 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:22.560152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9qkps_a91d0211-52a0-4dcf-81f1-50bd266ff108/payload-pre-processing/0.log"
Jul 17 11:54:22.682068 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:22.682033    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kfwdh_a20854fc-0992-41c4-8912-3b4672f95e02/payload-processing/0.log"
Jul 17 11:54:22.804303 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:22.804273    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6876c6d6d4-dqdzq_a68c3e38-b162-4249-b041-07bfad19e101/router/0.log"
Jul 17 11:54:23.172379 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:23.172347    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kmhhd_48bd96b7-9cca-4bf7-a4d6-0a4166925181/main/0.log"
Jul 17 11:54:23.295495 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:23.295462    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-d6sws_9d2c4d54-0fcf-45c3-ae42-914c3b064fd5/main/0.log"
Jul 17 11:54:29.988691 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.988649    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lgfmw/must-gather-hnf5l"]
Jul 17 11:54:29.989249 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989229    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cfc62b-640f-4053-bc6b-2b4da1a04a5a" containerName="main"
Jul 17 11:54:29.989344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989252    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cfc62b-640f-4053-bc6b-2b4da1a04a5a" containerName="main"
Jul 17 11:54:29.989344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989294    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5198821-caa9-4395-9c47-0b6822490d36" containerName="maas-api"
Jul 17 11:54:29.989344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989304    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5198821-caa9-4395-9c47-0b6822490d36" containerName="maas-api"
Jul 17 11:54:29.989344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989329    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856425a6-dd58-488c-b31f-e8e3ea2f5bf7" containerName="maas-api"
Jul 17 11:54:29.989344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989338    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="856425a6-dd58-488c-b31f-e8e3ea2f5bf7" containerName="maas-api"
Jul 17 11:54:29.989602 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989435    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5198821-caa9-4395-9c47-0b6822490d36" containerName="maas-api"
Jul 17 11:54:29.989602 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989448    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="856425a6-dd58-488c-b31f-e8e3ea2f5bf7" containerName="maas-api"
Jul 17 11:54:29.989602 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.989457    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="00cfc62b-640f-4053-bc6b-2b4da1a04a5a" containerName="main"
Jul 17 11:54:29.994264 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.994232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:29.996788 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.996763    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lgfmw\"/\"kube-root-ca.crt\""
Jul 17 11:54:29.996788 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.996783    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lgfmw\"/\"openshift-service-ca.crt\""
Jul 17 11:54:29.999995 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:29.999965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgfmw/must-gather-hnf5l"]
Jul 17 11:54:30.114685 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.114640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x2l8\" (UniqueName: \"kubernetes.io/projected/8332d8e5-a05b-49d6-b081-afe7d95b6115-kube-api-access-4x2l8\") pod \"must-gather-hnf5l\" (UID: \"8332d8e5-a05b-49d6-b081-afe7d95b6115\") " pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.114889 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.114804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8332d8e5-a05b-49d6-b081-afe7d95b6115-must-gather-output\") pod \"must-gather-hnf5l\" (UID: \"8332d8e5-a05b-49d6-b081-afe7d95b6115\") " pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.215832 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.215790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8332d8e5-a05b-49d6-b081-afe7d95b6115-must-gather-output\") pod \"must-gather-hnf5l\" (UID: \"8332d8e5-a05b-49d6-b081-afe7d95b6115\") " pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.216078 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.215856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x2l8\" (UniqueName: \"kubernetes.io/projected/8332d8e5-a05b-49d6-b081-afe7d95b6115-kube-api-access-4x2l8\") pod \"must-gather-hnf5l\" (UID: \"8332d8e5-a05b-49d6-b081-afe7d95b6115\") " pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.216163 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.216148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8332d8e5-a05b-49d6-b081-afe7d95b6115-must-gather-output\") pod \"must-gather-hnf5l\" (UID: \"8332d8e5-a05b-49d6-b081-afe7d95b6115\") " pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.225387 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.225346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x2l8\" (UniqueName: \"kubernetes.io/projected/8332d8e5-a05b-49d6-b081-afe7d95b6115-kube-api-access-4x2l8\") pod \"must-gather-hnf5l\" (UID: \"8332d8e5-a05b-49d6-b081-afe7d95b6115\") " pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.305503 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.305391    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgfmw/must-gather-hnf5l"
Jul 17 11:54:30.450615 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.450562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgfmw/must-gather-hnf5l"]
Jul 17 11:54:30.452969 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:54:30.452919    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8332d8e5_a05b_49d6_b081_afe7d95b6115.slice/crio-946d711aeaf01bb784306ca5e543cba6b14fec7c8a9ff1d1956379ce7cffce39 WatchSource:0}: Error finding container 946d711aeaf01bb784306ca5e543cba6b14fec7c8a9ff1d1956379ce7cffce39: Status 404 returned error can't find the container with id 946d711aeaf01bb784306ca5e543cba6b14fec7c8a9ff1d1956379ce7cffce39
Jul 17 11:54:30.454744 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:30.454720    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:54:31.290497 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:31.290463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgfmw/must-gather-hnf5l" event={"ID":"8332d8e5-a05b-49d6-b081-afe7d95b6115","Type":"ContainerStarted","Data":"946d711aeaf01bb784306ca5e543cba6b14fec7c8a9ff1d1956379ce7cffce39"}
Jul 17 11:54:32.298767 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:32.298730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgfmw/must-gather-hnf5l" event={"ID":"8332d8e5-a05b-49d6-b081-afe7d95b6115","Type":"ContainerStarted","Data":"69ff8d71423b8a2129e60e7c230d4a341abfc661ab67f641962899eec25fefd7"}
Jul 17 11:54:32.299430 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:32.299360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgfmw/must-gather-hnf5l" event={"ID":"8332d8e5-a05b-49d6-b081-afe7d95b6115","Type":"ContainerStarted","Data":"493dc928c9ca1d80a5418084028f049c5b108d54840b888ed5bc1fbba481e713"}
Jul 17 11:54:32.318825 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:32.318742    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lgfmw/must-gather-hnf5l" podStartSLOduration=2.537176964 podStartE2EDuration="3.318719951s" totalImagesPullingTime="781.542987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:54:32.31517487 +0000 UTC m=+3427.072985306" watchObservedRunningTime="2026-07-17 11:54:32.318719951 +0000 UTC m=+3427.076530370"
Jul 17 11:54:33.000675 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:33.000634    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9kgz7_08fc6b70-ad90-4d8d-b032-9a4ccb0328d3/global-pull-secret-syncer/0.log"
Jul 17 11:54:33.188816 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:33.188770    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x8b5k_5bedb6e8-b0d3-49d5-ae05-170c5bc0929e/konnectivity-agent/0.log"
Jul 17 11:54:33.217723 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:33.217689    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-118.ec2.internal_2fdd423a4ac1939d0a7793cd663fa352/haproxy/0.log"
Jul 17 11:54:38.276795 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:38.276756    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zpmjk_e25f291c-cf65-4048-a5b6-16d382d7302d/manager/0.log"
Jul 17 11:54:38.322193 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:38.322125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2k78k_ed4344e7-bd71-41b1-b2d6-3193b87b22c8/manager/0.log"
Jul 17 11:54:38.346346 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:38.346316    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vkt9x_44dba105-c86b-4260-818e-1694924367e2/kuadrant-console-plugin/0.log"
Jul 17 11:54:38.402424 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:38.402383    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tfpl6_3cce6f2b-5c5e-4cfd-a142-bd00fec7f0d3/registry-server/0.log"
Jul 17 11:54:38.529010 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:38.528363    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qm52t_30c8b70c-5a70-4d01-9864-c32c3c0f5bec/manager/0.log"
Jul 17 11:54:40.687205 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:40.684798    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-bdc5k_94b21743-f1df-45b4-b93b-aaf800c4f379/kube-state-metrics/0.log"
Jul 17 11:54:40.723885 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:40.723799    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-bdc5k_94b21743-f1df-45b4-b93b-aaf800c4f379/kube-rbac-proxy-main/0.log"
Jul 17 11:54:40.755917 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:40.755880    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-bdc5k_94b21743-f1df-45b4-b93b-aaf800c4f379/kube-rbac-proxy-self/0.log"
Jul 17 11:54:41.075312 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.075221    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hmpj2_ebdb5308-a8dd-42d4-859b-70d9df607b53/node-exporter/0.log"
Jul 17 11:54:41.101897 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.101827    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hmpj2_ebdb5308-a8dd-42d4-859b-70d9df607b53/kube-rbac-proxy/0.log"
Jul 17 11:54:41.133725 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.133697    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hmpj2_ebdb5308-a8dd-42d4-859b-70d9df607b53/init-textfile/0.log"
Jul 17 11:54:41.270226 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.270181    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/prometheus/0.log"
Jul 17 11:54:41.296996 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.296964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/config-reloader/0.log"
Jul 17 11:54:41.323652 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.323620    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/thanos-sidecar/0.log"
Jul 17 11:54:41.351720 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.351643    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/kube-rbac-proxy-web/0.log"
Jul 17 11:54:41.379596 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.379557    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/kube-rbac-proxy/0.log"
Jul 17 11:54:41.405701 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.405669    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/kube-rbac-proxy-thanos/0.log"
Jul 17 11:54:41.433961 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.431912    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5981c9b4-646d-41ff-a139-18e2d1dc5da9/init-config-reloader/0.log"
Jul 17 11:54:41.472777 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.472733    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-jtpvw_040d7e1f-e49e-4029-bb9a-0195400b9af8/prometheus-operator/0.log"
Jul 17 11:54:41.497229 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.497196    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-jtpvw_040d7e1f-e49e-4029-bb9a-0195400b9af8/kube-rbac-proxy/0.log"
Jul 17 11:54:41.524555 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:41.524517    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-vbqp8_7da3a782-c728-4735-aac5-2ae4cc1cc31c/prometheus-operator-admission-webhook/0.log"
Jul 17 11:54:43.451699 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.451649    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"]
Jul 17 11:54:43.458176 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.458135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.460882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.460854    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lgfmw\"/\"default-dockercfg-tk7jl\""
Jul 17 11:54:43.463538 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.463507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"]
Jul 17 11:54:43.474563 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.474525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-lib-modules\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.474832 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.474809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-proc\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.475022 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.475004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-sys\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.475172 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.475156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-podres\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.475318 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.475301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96wqt\" (UniqueName: \"kubernetes.io/projected/2526e11f-0d21-49b7-8b5e-0565d448314d-kube-api-access-96wqt\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.576781 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.576743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96wqt\" (UniqueName: \"kubernetes.io/projected/2526e11f-0d21-49b7-8b5e-0565d448314d-kube-api-access-96wqt\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577108 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-lib-modules\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577299 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-proc\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577485 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-sys\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577607 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-proc\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577695 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-lib-modules\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577794 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-podres\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.577915 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-sys\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.578048 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.577907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2526e11f-0d21-49b7-8b5e-0565d448314d-podres\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.588127 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.588079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96wqt\" (UniqueName: \"kubernetes.io/projected/2526e11f-0d21-49b7-8b5e-0565d448314d-kube-api-access-96wqt\") pod \"perf-node-gather-daemonset-mbzlz\" (UID: \"2526e11f-0d21-49b7-8b5e-0565d448314d\") " pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.774158 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.774069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:43.983189 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:43.983162    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"]
Jul 17 11:54:43.986211 ip-10-0-131-118 kubenswrapper[2564]: W0717 11:54:43.986170    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2526e11f_0d21_49b7_8b5e_0565d448314d.slice/crio-04817f3bba91c749049d315ec6e908a8899230c53059d6b43f5e1abc7a8ad5c5 WatchSource:0}: Error finding container 04817f3bba91c749049d315ec6e908a8899230c53059d6b43f5e1abc7a8ad5c5: Status 404 returned error can't find the container with id 04817f3bba91c749049d315ec6e908a8899230c53059d6b43f5e1abc7a8ad5c5
Jul 17 11:54:44.388164 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:44.388122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz" event={"ID":"2526e11f-0d21-49b7-8b5e-0565d448314d","Type":"ContainerStarted","Data":"0b7a67e5d0f21315df2b99fc6285d9c9b6f3c9e685a48fe03ed7fc0d1495e3a8"}
Jul 17 11:54:44.388317 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:44.388207    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:44.388317 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:44.388232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz" event={"ID":"2526e11f-0d21-49b7-8b5e-0565d448314d","Type":"ContainerStarted","Data":"04817f3bba91c749049d315ec6e908a8899230c53059d6b43f5e1abc7a8ad5c5"}
Jul 17 11:54:44.404869 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:44.404798    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz" podStartSLOduration=1.404779071 podStartE2EDuration="1.404779071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 11:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:54:44.404637353 +0000 UTC m=+3439.162447772" watchObservedRunningTime="2026-07-17 11:54:44.404779071 +0000 UTC m=+3439.162589488"
Jul 17 11:54:44.418771 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:44.418729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-nzmhn_d27b3795-3fa6-4998-b579-c6968df9bbf4/download-server/0.log"
Jul 17 11:54:45.067344 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:45.067307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-6pz87_4f99535e-1828-43d1-8370-2bcea13eb01e/volume-data-source-validator/0.log"
Jul 17 11:54:46.265389 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:46.265357    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rkfb_823e6c37-b200-443d-b6b1-ddd0ba79cad7/dns/0.log"
Jul 17 11:54:46.290388 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:46.290348    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rkfb_823e6c37-b200-443d-b6b1-ddd0ba79cad7/kube-rbac-proxy/0.log"
Jul 17 11:54:46.374652 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:46.374623    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52nv6_e407fa24-ddf7-4838-8f36-bf3b1f3a3ae6/dns-node-resolver/0.log"
Jul 17 11:54:47.045305 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:47.045264    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9n87w_35d634c1-7f8a-4020-9f6d-b7551e606135/node-ca/0.log"
Jul 17 11:54:48.429089 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:48.429044    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9qkps_a91d0211-52a0-4dcf-81f1-50bd266ff108/payload-pre-processing/0.log"
Jul 17 11:54:48.462100 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:48.462064    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kfwdh_a20854fc-0992-41c4-8912-3b4672f95e02/payload-processing/0.log"
Jul 17 11:54:48.487544 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:48.487482    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6876c6d6d4-dqdzq_a68c3e38-b162-4249-b041-07bfad19e101/router/0.log"
Jul 17 11:54:49.289455 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:49.289420    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghzgg_bce6f35f-9599-47db-9418-a912dcb988b0/serve-healthcheck-canary/0.log"
Jul 17 11:54:49.831380 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:49.831349    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-tx8mp_33c3ec98-d7b6-4384-af89-c4f515b6b856/insights-operator/0.log"
Jul 17 11:54:49.832103 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:49.832082    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-tx8mp_33c3ec98-d7b6-4384-af89-c4f515b6b856/insights-operator/1.log"
Jul 17 11:54:49.862035 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:49.862006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-69jq9_bfdac47a-29e5-411f-9a84-a5c0ded371ac/kube-rbac-proxy/0.log"
Jul 17 11:54:49.887798 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:49.887770    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-69jq9_bfdac47a-29e5-411f-9a84-a5c0ded371ac/exporter/0.log"
Jul 17 11:54:49.913838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:49.913809    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-69jq9_bfdac47a-29e5-411f-9a84-a5c0ded371ac/extractor/0.log"
Jul 17 11:54:50.408782 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:50.408756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lgfmw/perf-node-gather-daemonset-mbzlz"
Jul 17 11:54:52.704437 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:52.704393    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7858c79586-t7l9l_ea5aed11-bc14-462c-b7fe-3d2cf2178353/manager/0.log"
Jul 17 11:54:53.039206 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:53.039120    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd97f7fc7-htl45_fb09e448-18d1-42fc-9d77-84f98476317e/manager/0.log"
Jul 17 11:54:53.065988 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:53.065852    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cd97f7fc7-htl45_fb09e448-18d1-42fc-9d77-84f98476317e/copy-manifests/0.log"
Jul 17 11:54:54.470952 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:54.470901    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d4bfb48f4-s42hl_902a948c-cad2-4389-a559-7eae1033c7ef/manager/0.log"
Jul 17 11:54:54.866385 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:54.866284    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9qkps_a91d0211-52a0-4dcf-81f1-50bd266ff108/payload-pre-processing/0.log"
Jul 17 11:54:54.891356 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:54.891323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kfwdh_a20854fc-0992-41c4-8912-3b4672f95e02/payload-processing/0.log"
Jul 17 11:54:54.909313 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:54.909280    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6876c6d6d4-dqdzq_a68c3e38-b162-4249-b041-07bfad19e101/router/0.log"
Jul 17 11:54:56.402891 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:56.402858    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-9qkps_a91d0211-52a0-4dcf-81f1-50bd266ff108/payload-pre-processing/0.log"
Jul 17 11:54:56.427882 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:56.427854    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kfwdh_a20854fc-0992-41c4-8912-3b4672f95e02/payload-processing/0.log"
Jul 17 11:54:56.444458 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:54:56.444423    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6876c6d6d4-dqdzq_a68c3e38-b162-4249-b041-07bfad19e101/router/0.log"
Jul 17 11:55:01.461281 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:55:01.461242    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csw6c_f48418ba-9fa2-477c-bd0c-514970060925/kube-multus-additional-cni-plugins/0.log"
Jul 17 11:55:01.488801 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:55:01.488768    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csw6c_f48418ba-9fa2-477c-bd0c-514970060925/egress-router-binary-copy/0.log"
Jul 17 11:55:01.513375 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:55:01.513330    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csw6c_f48418ba-9fa2-477c-bd0c-514970060925/cni-plugins/0.log"
Jul 17 11:55:01.539052 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:55:01.539018    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csw6c_f48418ba-9fa2-477c-bd0c-514970060925/bond-cni-plugin/0.log"
Jul 17 11:55:01.564838 ip-10-0-131-118 kubenswrapper[2564]: I0717 11:55:01.564792    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csw6c_f48418ba-9fa2-477c-bd0c-514970060925/routeoverride-cni/0.log"