Sep 11 12:26:39.177665 ip-10-0-133-121 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 12:26:39.612651 ip-10-0-133-121 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:26:39.612651 ip-10-0-133-121 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 12:26:39.612651 ip-10-0-133-121 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:26:39.612651 ip-10-0-133-121 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 12:26:39.612651 ip-10-0-133-121 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:26:39.613755 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.613665    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 12:26:39.618740 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618724    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618741    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618747    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618751    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618754    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618757    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618759    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618762    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618766    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618770    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618774    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618777    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618780    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:39.618778 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618783    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618786    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618789    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618792    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618795    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618798    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618801    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618803    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618806    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618808    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618811    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618813    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618816    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618818    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618821    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618824    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618826    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618829    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618831    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618833    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:39.619091 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618836    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618838    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618841    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618843    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618846    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618848    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618851    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618854    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618856    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618860    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618862    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618865    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618867    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618870    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618873    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618876    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618878    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618881    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618884    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:39.619597 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618886    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618889    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618891    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618894    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618896    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618899    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618902    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618904    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618906    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618911    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618914    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618916    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618919    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618922    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618925    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618928    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618931    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618934    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618937    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:39.620061 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618945    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618948    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618951    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618954    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618956    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618959    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618961    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618964    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618967    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618970    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618972    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618975    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618979    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618981    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618984    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618986    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618989    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618991    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618994    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618996    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:39.620529 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.618999    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619002    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619004    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619007    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619009    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619012    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619015    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619017    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619732    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619739    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619742    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619745    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619748    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619751    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619755    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619758    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619760    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619763    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619766    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619770    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:39.621013 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619774    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619777    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619779    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619782    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619784    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619787    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619790    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619792    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619796    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619800    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619803    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619805    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619808    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619811    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619813    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619816    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619819    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619821    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619824    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:39.621519 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619827    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619829    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619832    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619834    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619837    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619841    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619845    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619851    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619855    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619858    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619861    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619863    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619866    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619870    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619872    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619875    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619878    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619881    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619883    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619886    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:39.621991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619888    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619891    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619894    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619896    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619899    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619902    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619904    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619907    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619909    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619912    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619914    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619917    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619919    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619922    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619924    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619927    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619930    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619932    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619935    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619937    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:39.622501 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619940    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619943    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619946    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619948    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619951    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619954    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619957    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619959    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619963    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619966    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619968    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619972    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619975    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619978    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619981    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619984    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619986    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619989    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619992    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:39.622995 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619995    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.619998    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620000    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620003    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620006    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620008    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620011    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620013    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620016    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620385    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620390    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620393    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620396    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620399    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620438    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620442    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620446    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620450    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620455    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620458    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:39.623476 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620461    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620464    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620467    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620470    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620473    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620476    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620479    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620482    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620484    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620487    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620490    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620492    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620495    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620498    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620501    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620504    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620506    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620509    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620511    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620514    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:39.623988 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620517    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620520    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620523    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620526    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620529    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620531    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620534    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620538    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620541    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620544    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620547    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620550    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620552    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620555    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620558    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620561    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620563    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620566    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620568    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620571    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:39.624508 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620574    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620577    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620581    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620586    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620590    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620593    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620596    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620599    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620601    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620604    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620607    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620609    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620612    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620615    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620618    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620621    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620624    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620627    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620630    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:39.625002 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620634    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620638    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620642    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620645    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620648    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620650    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620653    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620656    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620659    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620662    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620665    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620668    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620671    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620676    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620678    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620681    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620683    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620686    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620689    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620692    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:39.625488 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620694    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620697    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620699    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620702    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620706    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620709    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620712    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620715    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.620718    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620802    2563 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620840    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620848    2563 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620852    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620856    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620860    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620865    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620869    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620872    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620875    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620879    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620882    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620886    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 12:26:39.626012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620889    2563 flags.go:64] FLAG: --cgroup-root=""
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620891    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620894    2563 flags.go:64] FLAG: --client-ca-file=""
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620897    2563 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620900    2563 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620904    2563 flags.go:64] FLAG: --cluster-domain=""
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620907    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620910    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620914    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620917    2563 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620921    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620924    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620927    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620931    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620934    2563 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620937    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620940    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620943    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620946    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620950    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620953    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620957    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620960    2563 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620963    2563 flags.go:64] FLAG: --enable-server="true"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620966    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 12:26:39.626564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620972    2563 flags.go:64] FLAG: --event-burst="100"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620975    2563 flags.go:64] FLAG: --event-qps="50"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620978    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620981    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620985    2563 flags.go:64] FLAG: --eviction-hard=""
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620988    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620991    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620994    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.620997    2563 flags.go:64] FLAG: --eviction-soft=""
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621000    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621003    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621006    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621009    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621012    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621015    2563 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621018    2563 flags.go:64] FLAG: --feature-gates=""
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621022    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621025    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621028    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621032    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621035    2563 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621038    2563 flags.go:64] FLAG: --help="false"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621040    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621046    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 12:26:39.627276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621049    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621052    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621056    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621060    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621063    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621066    2563 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621069    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621071    2563 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621074    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621078    2563 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621081    2563 flags.go:64] FLAG: --kube-reserved=""
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621084    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621091    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621094    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621096    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621099    2563 flags.go:64] FLAG: --lock-file=""
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621102    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621105    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621108    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621113    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621116    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621119    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621122    2563 flags.go:64] FLAG: --logging-format="text"
Sep 11 12:26:39.627933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621125    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621128    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621131    2563 flags.go:64] FLAG: --manifest-url=""
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621135    2563 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621139    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621142    2563 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621146    2563 flags.go:64] FLAG: --max-pods="110"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621149    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621154    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621157    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621160    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621163    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621166    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621169    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621177    2563 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621180    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621183    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621186    2563 flags.go:64] FLAG: --pod-cidr=""
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621189    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621195    2563 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621198    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621201    2563 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621204    2563 flags.go:64] FLAG: --port="10250"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621206    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 12:26:39.628534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621209    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0619c9d4ec356eccf"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621213    2563 flags.go:64] FLAG: --qos-reserved=""
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621215    2563 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621218    2563 flags.go:64] FLAG: --register-node="true"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621221    2563 flags.go:64] FLAG: --register-with-taints=""
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621225    2563 flags.go:64] FLAG: --registry-burst="10"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621228    2563 flags.go:64] FLAG: --registry-qps="5"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621231    2563 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621234    2563 flags.go:64] FLAG: --reserved-memory=""
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621237    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621240    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621244    2563 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621247    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621250    2563 flags.go:64] FLAG: --runonce="false"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621253    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621256    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621259    2563 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621263    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621266    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621270    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621273    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621277    2563 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621280    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621282    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621285    2563 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621288    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 12:26:39.629264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621291    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621294    2563 flags.go:64] FLAG: --system-cgroups=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621297    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621303    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621306    2563 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621309    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621313    2563 flags.go:64] FLAG: --tls-min-version=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621316    2563 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621319    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621322    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621325    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621327    2563 flags.go:64] FLAG: --v="2"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621331    2563 flags.go:64] FLAG: --version="false"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621338    2563 flags.go:64] FLAG: --vmodule=""
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621342    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621346    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621480    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621485    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621489    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621492    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621495    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621499    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621502    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:39.630194 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621506    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621509    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621513    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621516    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621519    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621522    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621525    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621528    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621531    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621533    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621536    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621539    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621542    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621545    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621547    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621550    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621553    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621556    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621558    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621561    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:39.630803 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621564    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621566    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621569    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621572    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621574    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621577    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621580    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621582    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621585    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621587    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621590    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621593    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621596    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621599    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621604    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621606    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621609    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621611    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621614    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621616    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:39.631330 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621621    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621624    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621627    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621631    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621635    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621639    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621642    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621645    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621648    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621650    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621653    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621656    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621659    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621662    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621665    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621667    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621670    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621672    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621675    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621678    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:39.631870 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621681    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621683    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621686    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621689    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621694    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621696    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621700    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621703    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621706    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621708    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621711    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621714    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621716    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621719    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621722    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621724    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621727    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621729    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621733    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:39.632380 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621735    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621738    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621740    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621743    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621745    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621748    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621750    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621753    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621755    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621758    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621761    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621764    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.621766    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.621772    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.630873    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 12:26:39.632850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.630889    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.631773    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.631781    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631837    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631842    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631846    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631849    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631852    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631855    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631857    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631860    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631863    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631866    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631869    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631872    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631875    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631877    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631880    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631883    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:39.633209 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631886    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631888    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631898    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631902    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631906    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631909    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631912    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631915    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631918    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631921    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631924    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631927    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631930    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631933    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631936    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631939    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631942    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631945    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631948    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631951    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:39.633688 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631953    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631956    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631958    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631961    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631964    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631966    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631969    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631972    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631974    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631977    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631979    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631982    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631985    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631988    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631990    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631993    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631995    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.631998    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632000    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632003    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:39.634172 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632005    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632008    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632011    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632013    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632016    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632019    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632022    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632025    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632028    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632030    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632033    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632035    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632038    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632040    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632043    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632046    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632048    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632051    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632054    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632057    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:39.634707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632059    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632061    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632064    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632068    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632071    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632073    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632076    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632080    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632083    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632086    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632089    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632092    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632095    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632099    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632103    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632106    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632109    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632112    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632115    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:39.635191 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632118    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632121    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632124    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632126    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.632132    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632249    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632254    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632258    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632260    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632264    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632267    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632272    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632275    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632279    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632282    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:26:39.635692 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632285    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632288    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632292    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632295    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632298    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632301    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632304    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632306    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632309    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632312    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632314    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632317    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632320    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632322    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632326    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632330    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632333    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632336    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632339    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632342    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:26:39.636062 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632344    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632347    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632350    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632353    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632355    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632369    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632372    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632374    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632377    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632379    2563 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632382    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632385    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632388    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632391    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632394    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632397    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632400    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632402    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632405    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632408    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:26:39.636577 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632410    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632413    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632416    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632418    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632421    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632425    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632428    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632431    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632435    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632438    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632441    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632444    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632447    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632450    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632452    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632455    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632457    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632460    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632463    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:26:39.637067 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632465    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632467    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632470    2563 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632473    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632475    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632478    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632480    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632483    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632485    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632488    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632491    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632493    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632496    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632498    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632501    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632504    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632506    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632509    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632512    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632515    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:26:39.637537 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632517    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632520    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632522    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632525    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632527    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632530    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632532    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632535    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632537    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:39.632540    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.632545    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.632647    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 12:26:39.638052 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.637641    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 12:26:39.638655 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.638644    2563 server.go:1019] "Starting client certificate rotation"
Sep 11 12:26:39.638777 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.638758    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:26:39.638826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.638811    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:26:39.643044 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.643028    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:26:39.644154 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.644134    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:26:39.654620 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.654602    2563 log.go:25] "Validated CRI v1 runtime API"
Sep 11 12:26:39.659645 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.659630    2563 log.go:25] "Validated CRI v1 image API"
Sep 11 12:26:39.661012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.660992    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 12:26:39.667347 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.667329    2563 fs.go:135] Filesystem UUIDs: map[1417d0bb-acfe-47ac-bf98-a602448c0cbc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f88ccdf6-7685-41c8-b9fe-84a555896a3d:/dev/nvme0n1p3]
Sep 11 12:26:39.667418 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.667348    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 12:26:39.670698 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.670682    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:26:39.672991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.672888    2563 manager.go:216] Machine: {Timestamp:2026-09-11 12:26:39.672387349 +0000 UTC m=+0.385390383 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100017 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221e257223e2ef27e818204e2606fa SystemUUID:ec221e25-7223-e2ef-27e8-18204e2606fa BootID:eafb59d4-2c42-4290-a624-25b994e83080 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:cd:5a:67:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:cd:5a:67:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:48:11:85:fe:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 12:26:39.672991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.672986    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 12:26:39.673112 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.673101    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 12:26:39.676276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.676246    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 12:26:39.676425 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.676279    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 12:26:39.677535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.677524    2563 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 12:26:39.677566 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.677538    2563 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 12:26:39.677566 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.677546    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:26:39.678505 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.678495    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:26:39.679619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.679608    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 12:26:39.683851 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.683839    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:26:39.683972 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.683963    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 12:26:39.684001 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.683992    2563 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 12:26:39.684028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.684002    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 12:26:39.684028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.684021    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 12:26:39.684081 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.684066    2563 kubelet.go:398] "Adding apiserver pod source"
Sep 11 12:26:39.684081 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.684077    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 12:26:39.685008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.684990    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:26:39.685106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.685027    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:26:39.689161 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.689141    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 12:26:39.691998 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.691984    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 12:26:39.692065 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.692014    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 12:26:39.694743 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694727    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 12:26:39.694743 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694746    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694752    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694758    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694766    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694771    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694784    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694790    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694797    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694802    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694811    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 12:26:39.694872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.694816    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 12:26:39.695666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.695653    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 12:26:39.695666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.695663    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 12:26:39.697531 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.697513    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 12:26:39.698175 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.698150    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 12:26:39.698228 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.698151    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 12:26:39.699543 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.699531    2563 server.go:1268] "Started kubelet"
Sep 11 12:26:39.699666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.699618    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 12:26:39.699666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.699628    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 12:26:39.699742 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.699690    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 12:26:39.700427 ip-10-0-133-121 systemd[1]: Started Kubernetes Kubelet.
Sep 11 12:26:39.701391 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.701355    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 12:26:39.702493 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.702480    2563 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 12:26:39.706955 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.706928    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 12:26:39.708394 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.708376    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 12:26:39.709063 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.709046    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 12:26:39.709202 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.709184    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:39.709778 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.709760    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 12:26:39.709778 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.709779    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 12:26:39.709898 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.709761    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 12:26:39.709958 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.709922    2563 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 12:26:39.709958 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.709932    2563 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 12:26:39.710160 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710144    2563 factory.go:55] Registering systemd factory
Sep 11 12:26:39.710160 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710160    2563 factory.go:223] Registration of the systemd container factory successfully
Sep 11 12:26:39.710410 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710391    2563 factory.go:153] Registering CRI-O factory
Sep 11 12:26:39.710410 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710408    2563 factory.go:223] Registration of the crio container factory successfully
Sep 11 12:26:39.710535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710478    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 12:26:39.710535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710520    2563 factory.go:103] Registering Raw factory
Sep 11 12:26:39.710535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.710536    2563 manager.go:1196] Started watching for new ooms in manager
Sep 11 12:26:39.711690 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.711675    2563 manager.go:349] Starting recovery of all containers
Sep 11 12:26:39.715788 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.715759    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 12:26:39.715871 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.715797    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 12:26:39.717076 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.715943    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-121.ec2.internal.18d443e44739c8f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-121.ec2.internal,UID:ip-10-0-133-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-121.ec2.internal,},FirstTimestamp:2026-09-11 12:26:39.699503352 +0000 UTC m=+0.412506381,LastTimestamp:2026-09-11 12:26:39.699503352 +0000 UTC m=+0.412506381,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-121.ec2.internal,}"
Sep 11 12:26:39.725193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.725171    2563 manager.go:354] Recovery completed
Sep 11 12:26:39.731085 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.731062    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k5fg7"
Sep 11 12:26:39.731699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.731681    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.733607 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.733590    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.733691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.733623    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.733691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.733638    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.734277 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.734264    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 12:26:39.734277 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.734277    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 12:26:39.734399 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.734295    2563 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:26:39.734399 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.734276    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.735070 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.735054    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.735132 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.735077    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.735132 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.735091    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.735864 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.735782    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-121.ec2.internal.18d443e44942231e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-121.ec2.internal,UID:ip-10-0-133-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-121.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-121.ec2.internal,},FirstTimestamp:2026-09-11 12:26:39.73360515 +0000 UTC m=+0.446608184,LastTimestamp:2026-09-11 12:26:39.73360515 +0000 UTC m=+0.446608184,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-121.ec2.internal,}"
Sep 11 12:26:39.736409 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.736396    2563 policy_none.go:49] "None policy: Start"
Sep 11 12:26:39.736476 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.736414    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 12:26:39.736476 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.736428    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 12:26:39.738387 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.738374    2563 policy_none.go:47] "Start"
Sep 11 12:26:39.739410 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.739395    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k5fg7"
Sep 11 12:26:39.745391 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.745294    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-121.ec2.internal.18d443e449428297  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-121.ec2.internal,UID:ip-10-0-133-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-121.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-121.ec2.internal,},FirstTimestamp:2026-09-11 12:26:39.733629591 +0000 UTC m=+0.446632622,LastTimestamp:2026-09-11 12:26:39.733629591 +0000 UTC m=+0.446632622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-121.ec2.internal,}"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775002    2563 manager.go:337] "Starting Device Plugin manager"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.775040    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775049    2563 server.go:87] "Starting device plugin registration server"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775332    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775377    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775464    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775534    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.775545    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.776059    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 12:26:39.783965 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.776109    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:39.797446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.797416    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 12:26:39.798620 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.798600    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 12:26:39.798704 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.798646    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 12:26:39.798704 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.798664    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 12:26:39.798784 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.798706    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 12:26:39.801429 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.801413    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:39.876035 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.875960    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.876928 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.876912    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.877006 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.876946    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.877006 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.876960    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.877006 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.876984    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.887339 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.887325    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.887398 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.887345    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-121.ec2.internal\": node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:39.898886 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.898867    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"]
Sep 11 12:26:39.898940 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.898924    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.900197 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.900170    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.900263 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.900210    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.900263 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.900223    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.905099 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905086    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.905236 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.905269 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905252    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.905742 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905726    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.905808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905752    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.905808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905772    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.905878 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905815    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.905878 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905831    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.905878 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.905843    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.908087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.908072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.908134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.908097    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:26:39.908746 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.908728    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:26:39.908828 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.908758    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:26:39.908828 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.908768    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:26:39.910962 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.910945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b89b17ba77a25e9cc2cd959b9fba315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"2b89b17ba77a25e9cc2cd959b9fba315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.911036 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.910969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b89b17ba77a25e9cc2cd959b9fba315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"2b89b17ba77a25e9cc2cd959b9fba315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.911036 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:39.910989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8d2aef2a39cd9167d2677babe4e9748-config\") pod \"kube-apiserver-proxy-ip-10-0-133-121.ec2.internal\" (UID: \"f8d2aef2a39cd9167d2677babe4e9748\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.934228 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.934212    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:39.939965 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.939950    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-121.ec2.internal\" not found" node="ip-10-0-133-121.ec2.internal"
Sep 11 12:26:39.944428 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:39.944414    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-121.ec2.internal\" not found" node="ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.011210 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.011187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b89b17ba77a25e9cc2cd959b9fba315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"2b89b17ba77a25e9cc2cd959b9fba315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.011290 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.011214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b89b17ba77a25e9cc2cd959b9fba315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"2b89b17ba77a25e9cc2cd959b9fba315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.011290 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.011231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8d2aef2a39cd9167d2677babe4e9748-config\") pod \"kube-apiserver-proxy-ip-10-0-133-121.ec2.internal\" (UID: \"f8d2aef2a39cd9167d2677babe4e9748\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.011290 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.011254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8d2aef2a39cd9167d2677babe4e9748-config\") pod \"kube-apiserver-proxy-ip-10-0-133-121.ec2.internal\" (UID: \"f8d2aef2a39cd9167d2677babe4e9748\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.011420 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.011289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b89b17ba77a25e9cc2cd959b9fba315-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"2b89b17ba77a25e9cc2cd959b9fba315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.011420 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.011319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b89b17ba77a25e9cc2cd959b9fba315-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal\" (UID: \"2b89b17ba77a25e9cc2cd959b9fba315\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.034812 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.034794    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.135329 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.135277    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.236058 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.236022    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.242172 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.242157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.247247 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.246664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.337776 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.337744    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.439642 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.439570    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.540434 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.540406    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.639333 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.639310    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 12:26:40.639792 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.639506    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:26:40.640496 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.640466    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-121.ec2.internal\" not found"
Sep 11 12:26:40.659614 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.659588    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:40.685964 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.685947    2563 apiserver.go:52] "Watching apiserver"
Sep 11 12:26:40.696913 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.696856    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 12:26:40.697192 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.697171    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-wz25k","openshift-network-diagnostics/network-check-target-hwx88","kube-system/konnectivity-agent-sjxnz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd","openshift-cluster-node-tuning-operator/tuned-dzgcp","openshift-dns/node-resolver-gsb88","openshift-multus/multus-additional-cni-plugins-78xpk","openshift-multus/network-metrics-daemon-bc4j9","openshift-network-operator/iptables-alerter-tqwbk","openshift-ovn-kubernetes/ovnkube-node-5sslb","kube-system/global-pull-secret-syncer-bhqgf","openshift-image-registry/node-ca-mjr57"]
Sep 11 12:26:40.699884 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.699864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.702067 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.702048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:40.702387 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.702354    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:40.703666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.703639    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zj2q\""
Sep 11 12:26:40.703759 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.703732    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 12:26:40.703876 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.703859    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 12:26:40.703995 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.703976    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.704159 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.704143    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.704525 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.704505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.707008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.706989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.708304 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.708285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 12:26:40.708395 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.708309    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27wvb\""
Sep 11 12:26:40.708395 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.708286    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 12:26:40.708522 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.708480    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 12:26:40.709253 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.709236    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.709391 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.709378    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.710119 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.710093    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 12:26:40.710119 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.710096    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.710262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.710139    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.710262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.710175    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k7ftm\""
Sep 11 12:26:40.711749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.711732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.712358 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.712339    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.712452 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.712339    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.712452 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.712380    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mdl68\""
Sep 11 12:26:40.713976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.713959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.714908 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.714893    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.714988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.714916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jgwhk\""
Sep 11 12:26:40.714988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.714935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.716283 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5610ec0e-6a8f-4295-a5b2-511adee43ca4-konnectivity-ca\") pod \"konnectivity-agent-sjxnz\" (UID: \"5610ec0e-6a8f-4295-a5b2-511adee43ca4\") " pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.716334 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.716334 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-registration-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.716334 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:40.716548 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-run\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.716548 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.716396    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:40.716548 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-cni-binary-copy\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.716548 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-netns\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.716548 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-kubelet\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-host\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716576    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3738755c-d7ed-42ec-b73b-2293264b6a58-tmp-dir\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-system-cni-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysctl-d\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-sys\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-var-lib-kubelet\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-k8s-cni-cncf-io\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.716803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5610ec0e-6a8f-4295-a5b2-511adee43ca4-agent-certs\") pod \"konnectivity-agent-sjxnz\" (UID: \"5610ec0e-6a8f-4295-a5b2-511adee43ca4\") " pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysctl-conf\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8428ae-3836-42fe-a11d-396811239fba-etc-tuned\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-cni-bin\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-hostroot\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7kn\" (UniqueName: \"kubernetes.io/projected/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-kube-api-access-qb7kn\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.716996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-socket-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-modprobe-d\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysconfig\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-systemd\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3738755c-d7ed-42ec-b73b-2293264b6a58-hosts-file\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-conf-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-daemon-config\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-device-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-sys-fs\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717252    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r8mmf\""
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd2tj\" (UniqueName: \"kubernetes.io/projected/3738755c-d7ed-42ec-b73b-2293264b6a58-kube-api-access-rd2tj\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-cni-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrvf\" (UniqueName: \"kubernetes.io/projected/c713fd86-e94b-4839-8346-46140f3d50c6-kube-api-access-mhrvf\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8428ae-3836-42fe-a11d-396811239fba-tmp\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtpf\" (UniqueName: \"kubernetes.io/projected/ac8428ae-3836-42fe-a11d-396811239fba-kube-api-access-8jtpf\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-socket-dir-parent\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-cni-multus\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-multus-certs\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-kubernetes\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-lib-modules\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-cnibin\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.717825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.717576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-etc-kubernetes\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.718738 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.718720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.721192 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.721172    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:26:40.721192 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.721185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.721343 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.721230    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"
Sep 11 12:26:40.721748 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.721730    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.721932 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.721920    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.722024 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.722008    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 12:26:40.722089 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.722010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9dfj\""
Sep 11 12:26:40.723835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.723817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.723909 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.723888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:40.724333 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724320    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 12:26:40.724735 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724715    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.724735 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724728    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.724877 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724764    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 12:26:40.724877 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cl7z4\""
Sep 11 12:26:40.724877 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724721    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 12:26:40.724877 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.724767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 12:26:40.726345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.726327    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal"]
Sep 11 12:26:40.726442 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.726428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.728164 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.728142    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:26:40.729208 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.729181    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 12:26:40.729560 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.729547    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 12:26:40.729860 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.729844    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 12:26:40.729958 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.729943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nj78d\""
Sep 11 12:26:40.739824 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.738592    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:26:40.739824 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.738870    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal"]
Sep 11 12:26:40.744847 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.744800    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 12:21:40 +0000 UTC" deadline="2028-05-19 09:45:36.75851154 +0000 UTC"
Sep 11 12:26:40.744847 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.744845    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14781h18m56.013669151s"
Sep 11 12:26:40.751546 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.751528    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mkwtx"
Sep 11 12:26:40.759134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.759115    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mkwtx"
Sep 11 12:26:40.811532 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.811358    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 12:26:40.818514 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-k8s-cni-cncf-io\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.818627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8h6t\" (UniqueName: \"kubernetes.io/projected/3bd31588-602d-455d-99f2-abb5353ae7d0-kube-api-access-d8h6t\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.818627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysctl-conf\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.818627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-k8s-cni-cncf-io\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8428ae-3836-42fe-a11d-396811239fba-etc-tuned\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysctl-conf\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-tuning-conf-dir\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-cni-netd\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e165045a-b2b3-44a8-9668-c59c40e1dfe7-host-slash\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7749\" (UniqueName: \"kubernetes.io/projected/e165045a-b2b3-44a8-9668-c59c40e1dfe7-kube-api-access-d7749\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.818775 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysconfig\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-systemd\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-conf-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysconfig\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-slash\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-etc-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-conf-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-systemd\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-ovn\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.818999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-log-socket\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819003    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-sys-fs\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-systemd\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-env-overrides\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62afd5e-0b26-45bb-8113-f581cde3c6d5-kubelet-config\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtpf\" (UniqueName: \"kubernetes.io/projected/ac8428ae-3836-42fe-a11d-396811239fba-kube-api-access-8jtpf\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-sys-fs\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.819118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-cni-multus\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-multus-certs\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-system-cni-dir\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-cni-multus\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-kubelet\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-run-netns\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-multus-certs\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-ovnkube-config\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-lib-modules\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bd31588-602d-455d-99f2-abb5353ae7d0-ovn-node-metrics-cert\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5610ec0e-6a8f-4295-a5b2-511adee43ca4-konnectivity-ca\") pod \"konnectivity-agent-sjxnz\" (UID: \"5610ec0e-6a8f-4295-a5b2-511adee43ca4\") " pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-lib-modules\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-systemd-units\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.819937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3738755c-d7ed-42ec-b73b-2293264b6a58-tmp-dir\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysctl-d\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-sys\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-sysctl-d\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-var-lib-kubelet\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3738755c-d7ed-42ec-b73b-2293264b6a58-tmp-dir\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-var-lib-kubelet\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5610ec0e-6a8f-4295-a5b2-511adee43ca4-konnectivity-ca\") pod \"konnectivity-agent-sjxnz\" (UID: \"5610ec0e-6a8f-4295-a5b2-511adee43ca4\") " pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-sys\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.819974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z877r\" (UniqueName: \"kubernetes.io/projected/45419924-f936-4192-89df-b7f611862137-kube-api-access-z877r\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-cni-bin\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e165045a-b2b3-44a8-9668-c59c40e1dfe7-iptables-alerter-script\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5610ec0e-6a8f-4295-a5b2-511adee43ca4-agent-certs\") pod \"konnectivity-agent-sjxnz\" (UID: \"5610ec0e-6a8f-4295-a5b2-511adee43ca4\") " pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-cni-bin\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.820702 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-cni-bin\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-hostroot\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7kn\" (UniqueName: \"kubernetes.io/projected/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-kube-api-access-qb7kn\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-hostroot\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-socket-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-modprobe-d\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-socket-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3738755c-d7ed-42ec-b73b-2293264b6a58-hosts-file\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-daemon-config\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-modprobe-d\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3738755c-d7ed-42ec-b73b-2293264b6a58-hosts-file\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/398ed8ec-3c6b-4305-be68-5abbc29dc9be-serviceca\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-cnibin\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62afd5e-0b26-45bb-8113-f581cde3c6d5-dbus\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-device-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.821643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2tj\" (UniqueName: \"kubernetes.io/projected/3738755c-d7ed-42ec-b73b-2293264b6a58-kube-api-access-rd2tj\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-cni-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-device-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrvf\" (UniqueName: \"kubernetes.io/projected/c713fd86-e94b-4839-8346-46140f3d50c6-kube-api-access-mhrvf\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8428ae-3836-42fe-a11d-396811239fba-tmp\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-socket-dir-parent\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/398ed8ec-3c6b-4305-be68-5abbc29dc9be-host\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-cni-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-kubernetes\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-cnibin\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820915    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-etc-kubernetes\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-socket-dir-parent\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9zr\" (UniqueName: \"kubernetes.io/projected/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-kube-api-access-bd9zr\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-node-log\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.822561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-registration-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-cnibin\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-run\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-cni-binary-copy\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-netns\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-kubelet\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp4pn\" (UniqueName: \"kubernetes.io/projected/398ed8ec-3c6b-4305-be68-5abbc29dc9be-kube-api-access-xp4pn\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-run\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-cni-binary-copy\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c713fd86-e94b-4839-8346-46140f3d50c6-registration-dir\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-etc-kubernetes\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-var-lib-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-run-netns\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-host\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-host-var-lib-kubelet\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-system-cni-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-ovnkube-script-lib\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-etc-kubernetes\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.823509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.820978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-multus-daemon-config\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.824106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8428ae-3836-42fe-a11d-396811239fba-host\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.824106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-system-cni-dir\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.824106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.821963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-cni-binary-copy\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.824106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.823542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8428ae-3836-42fe-a11d-396811239fba-tmp\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.824106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.823619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8428ae-3836-42fe-a11d-396811239fba-etc-tuned\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.824106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.823755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5610ec0e-6a8f-4295-a5b2-511adee43ca4-agent-certs\") pod \"konnectivity-agent-sjxnz\" (UID: \"5610ec0e-6a8f-4295-a5b2-511adee43ca4\") " pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:40.830397 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.830378    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:40.830397 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.830398    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:40.830548 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.830411    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:40.830548 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.830490    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:26:41.330473782 +0000 UTC m=+2.043476800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:40.831533 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.831512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtpf\" (UniqueName: \"kubernetes.io/projected/ac8428ae-3836-42fe-a11d-396811239fba-kube-api-access-8jtpf\") pod \"tuned-dzgcp\" (UID: \"ac8428ae-3836-42fe-a11d-396811239fba\") " pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:40.832978 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.832956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7kn\" (UniqueName: \"kubernetes.io/projected/2f4b29b2-9f06-4aa0-9bdf-69be3866b271-kube-api-access-qb7kn\") pod \"multus-wz25k\" (UID: \"2f4b29b2-9f06-4aa0-9bdf-69be3866b271\") " pod="openshift-multus/multus-wz25k"
Sep 11 12:26:40.834060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.834038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrvf\" (UniqueName: \"kubernetes.io/projected/c713fd86-e94b-4839-8346-46140f3d50c6-kube-api-access-mhrvf\") pod \"aws-ebs-csi-driver-node-dzsqd\" (UID: \"c713fd86-e94b-4839-8346-46140f3d50c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:40.834679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.834661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd2tj\" (UniqueName: \"kubernetes.io/projected/3738755c-d7ed-42ec-b73b-2293264b6a58-kube-api-access-rd2tj\") pod \"node-resolver-gsb88\" (UID: \"3738755c-d7ed-42ec-b73b-2293264b6a58\") " pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:40.853404 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.853379    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:40.883238 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.883214    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:40.922625 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.922808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-systemd-units\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.922808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.922808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z877r\" (UniqueName: \"kubernetes.io/projected/45419924-f936-4192-89df-b7f611862137-kube-api-access-z877r\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.922808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-systemd-units\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.922808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-cni-bin\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.922808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e165045a-b2b3-44a8-9668-c59c40e1dfe7-iptables-alerter-script\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/398ed8ec-3c6b-4305-be68-5abbc29dc9be-serviceca\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-cnibin\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62afd5e-0b26-45bb-8113-f581cde3c6d5-dbus\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-cni-bin\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/398ed8ec-3c6b-4305-be68-5abbc29dc9be-host\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/398ed8ec-3c6b-4305-be68-5abbc29dc9be-host\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9zr\" (UniqueName: \"kubernetes.io/projected/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-kube-api-access-bd9zr\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-cnibin\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.922916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d62afd5e-0b26-45bb-8113-f581cde3c6d5-dbus\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.923186    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.923247    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:41.423229473 +0000 UTC m=+2.136232506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923247    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-node-log\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/398ed8ec-3c6b-4305-be68-5abbc29dc9be-serviceca\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp4pn\" (UniqueName: \"kubernetes.io/projected/398ed8ec-3c6b-4305-be68-5abbc29dc9be-kube-api-access-xp4pn\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-cni-binary-copy\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-node-log\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-var-lib-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-var-lib-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e165045a-b2b3-44a8-9668-c59c40e1dfe7-iptables-alerter-script\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-ovnkube-script-lib\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8h6t\" (UniqueName: \"kubernetes.io/projected/3bd31588-602d-455d-99f2-abb5353ae7d0-kube-api-access-d8h6t\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-tuning-conf-dir\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.923948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-cni-netd\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e165045a-b2b3-44a8-9668-c59c40e1dfe7-host-slash\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7749\" (UniqueName: \"kubernetes.io/projected/e165045a-b2b3-44a8-9668-c59c40e1dfe7-kube-api-access-d7749\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-slash\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-etc-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-ovn\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e165045a-b2b3-44a8-9668-c59c40e1dfe7-host-slash\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-tuning-conf-dir\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-log-socket\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-cni-netd\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-systemd\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-log-socket\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45419924-f936-4192-89df-b7f611862137-cni-binary-copy\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-env-overrides\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62afd5e-0b26-45bb-8113-f581cde3c6d5-kubelet-config\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-ovn\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.924594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-etc-openvswitch\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-slash\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-system-cni-dir\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-run-systemd\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45419924-f936-4192-89df-b7f611862137-system-cni-dir\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.923995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-kubelet\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-run-netns\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-ovnkube-config\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-run-netns\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd31588-602d-455d-99f2-abb5353ae7d0-host-kubelet\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bd31588-602d-455d-99f2-abb5353ae7d0-ovn-node-metrics-cert\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d62afd5e-0b26-45bb-8113-f581cde3c6d5-kubelet-config\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-ovnkube-script-lib\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.924213    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:40.924273    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:41.42425426 +0000 UTC m=+2.137257279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-env-overrides\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.925140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.924552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bd31588-602d-455d-99f2-abb5353ae7d0-ovnkube-config\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.926179 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.926159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bd31588-602d-455d-99f2-abb5353ae7d0-ovn-node-metrics-cert\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:40.933153 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.933125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp4pn\" (UniqueName: \"kubernetes.io/projected/398ed8ec-3c6b-4305-be68-5abbc29dc9be-kube-api-access-xp4pn\") pod \"node-ca-mjr57\" (UID: \"398ed8ec-3c6b-4305-be68-5abbc29dc9be\") " pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:40.933372 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.933353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z877r\" (UniqueName: \"kubernetes.io/projected/45419924-f936-4192-89df-b7f611862137-kube-api-access-z877r\") pod \"multus-additional-cni-plugins-78xpk\" (UID: \"45419924-f936-4192-89df-b7f611862137\") " pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:40.933473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.933457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7749\" (UniqueName: \"kubernetes.io/projected/e165045a-b2b3-44a8-9668-c59c40e1dfe7-kube-api-access-d7749\") pod \"iptables-alerter-tqwbk\" (UID: \"e165045a-b2b3-44a8-9668-c59c40e1dfe7\") " pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:40.933801 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.933776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9zr\" (UniqueName: \"kubernetes.io/projected/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-kube-api-access-bd9zr\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:40.934097 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:40.934079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8h6t\" (UniqueName: \"kubernetes.io/projected/3bd31588-602d-455d-99f2-abb5353ae7d0-kube-api-access-d8h6t\") pod \"ovnkube-node-5sslb\" (UID: \"3bd31588-602d-455d-99f2-abb5353ae7d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:41.027236 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.027209    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wz25k"
Sep 11 12:26:41.028507 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.028479    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d2aef2a39cd9167d2677babe4e9748.slice/crio-69640d5418b9bbe285a85d4b4493a769a681f9f1e6f64eda1194eac7b2533122 WatchSource:0}: Error finding container 69640d5418b9bbe285a85d4b4493a769a681f9f1e6f64eda1194eac7b2533122: Status 404 returned error can't find the container with id 69640d5418b9bbe285a85d4b4493a769a681f9f1e6f64eda1194eac7b2533122
Sep 11 12:26:41.029916 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.029894    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b89b17ba77a25e9cc2cd959b9fba315.slice/crio-d384d38766efcb9206af2cae1790baceec66c60a94742f06b0c7de2c46947933 WatchSource:0}: Error finding container d384d38766efcb9206af2cae1790baceec66c60a94742f06b0c7de2c46947933: Status 404 returned error can't find the container with id d384d38766efcb9206af2cae1790baceec66c60a94742f06b0c7de2c46947933
Sep 11 12:26:41.035947 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.035925    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:26:41.039702 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.039682    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4b29b2_9f06_4aa0_9bdf_69be3866b271.slice/crio-1620dc41221c9c831bda276ac26461601c9841dc0424203f8331c6b6075595b6 WatchSource:0}: Error finding container 1620dc41221c9c831bda276ac26461601c9841dc0424203f8331c6b6075595b6: Status 404 returned error can't find the container with id 1620dc41221c9c831bda276ac26461601c9841dc0424203f8331c6b6075595b6
Sep 11 12:26:41.045610 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.045592    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:26:41.055105 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.055081    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5610ec0e_6a8f_4295_a5b2_511adee43ca4.slice/crio-e485b1f0eff8c40a7b8fde78bea14c2e78fc74a0a5b50921dbdbad111911fa46 WatchSource:0}: Error finding container e485b1f0eff8c40a7b8fde78bea14c2e78fc74a0a5b50921dbdbad111911fa46: Status 404 returned error can't find the container with id e485b1f0eff8c40a7b8fde78bea14c2e78fc74a0a5b50921dbdbad111911fa46
Sep 11 12:26:41.067483 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.067457    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd"
Sep 11 12:26:41.068525 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.068509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzgcp"
Sep 11 12:26:41.077004 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.076972    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc713fd86_e94b_4839_8346_46140f3d50c6.slice/crio-f8d8dd91e65cd541a0cd4868517a8a5add2071efdd88ad69a1a92963889b724e WatchSource:0}: Error finding container f8d8dd91e65cd541a0cd4868517a8a5add2071efdd88ad69a1a92963889b724e: Status 404 returned error can't find the container with id f8d8dd91e65cd541a0cd4868517a8a5add2071efdd88ad69a1a92963889b724e
Sep 11 12:26:41.079798 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.079772    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8428ae_3836_42fe_a11d_396811239fba.slice/crio-00833042f741cd8dd9b32d7107ce0e03796b75d3bae17ac179451431c987580c WatchSource:0}: Error finding container 00833042f741cd8dd9b32d7107ce0e03796b75d3bae17ac179451431c987580c: Status 404 returned error can't find the container with id 00833042f741cd8dd9b32d7107ce0e03796b75d3bae17ac179451431c987580c
Sep 11 12:26:41.094363 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.094343    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gsb88"
Sep 11 12:26:41.103416 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.103395    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3738755c_d7ed_42ec_b73b_2293264b6a58.slice/crio-9bf4f0329d540e0551047579f20f4d500bcc5947f0e924847a91d84e29c105b5 WatchSource:0}: Error finding container 9bf4f0329d540e0551047579f20f4d500bcc5947f0e924847a91d84e29c105b5: Status 404 returned error can't find the container with id 9bf4f0329d540e0551047579f20f4d500bcc5947f0e924847a91d84e29c105b5
Sep 11 12:26:41.110420 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.110404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-78xpk"
Sep 11 12:26:41.118252 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.118233    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45419924_f936_4192_89df_b7f611862137.slice/crio-87a84e2190b80a26dae4e23472c5da04edc240f9919b4cd97400bb8ee85ea824 WatchSource:0}: Error finding container 87a84e2190b80a26dae4e23472c5da04edc240f9919b4cd97400bb8ee85ea824: Status 404 returned error can't find the container with id 87a84e2190b80a26dae4e23472c5da04edc240f9919b4cd97400bb8ee85ea824
Sep 11 12:26:41.122666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.122652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tqwbk"
Sep 11 12:26:41.130937 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.130918    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode165045a_b2b3_44a8_9668_c59c40e1dfe7.slice/crio-05f50c8ff3fec1371e0d4500fd29b0865ff7ad0562d55169692ad0b46804ea67 WatchSource:0}: Error finding container 05f50c8ff3fec1371e0d4500fd29b0865ff7ad0562d55169692ad0b46804ea67: Status 404 returned error can't find the container with id 05f50c8ff3fec1371e0d4500fd29b0865ff7ad0562d55169692ad0b46804ea67
Sep 11 12:26:41.157630 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.157607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:26:41.164520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.164490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mjr57"
Sep 11 12:26:41.166663 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.166642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd31588_602d_455d_99f2_abb5353ae7d0.slice/crio-b9b494e0852938e4032f65575b69107398b4385fe81b3ce004b54f1131652173 WatchSource:0}: Error finding container b9b494e0852938e4032f65575b69107398b4385fe81b3ce004b54f1131652173: Status 404 returned error can't find the container with id b9b494e0852938e4032f65575b69107398b4385fe81b3ce004b54f1131652173
Sep 11 12:26:41.172779 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:26:41.172758    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398ed8ec_3c6b_4305_be68_5abbc29dc9be.slice/crio-a21c01a66e01457ec54a80335e73466b995feafbfb250365384fb5cb0fb395cf WatchSource:0}: Error finding container a21c01a66e01457ec54a80335e73466b995feafbfb250365384fb5cb0fb395cf: Status 404 returned error can't find the container with id a21c01a66e01457ec54a80335e73466b995feafbfb250365384fb5cb0fb395cf
Sep 11 12:26:41.174516 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.174494    2563 kuberuntime_manager.go:1459] "Unhandled Error" err="container node-ca start failed in pod node-ca-mjr57_openshift-image-registry(398ed8ec-3c6b-4305-be68-5abbc29dc9be): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 11 12:26:41.174568 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.174533    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-image-registry/node-ca-mjr57" podUID="398ed8ec-3c6b-4305-be68-5abbc29dc9be"
Sep 11 12:26:41.427733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.427634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:41.427733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.427694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.427727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427797    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427821    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427833    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427847    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427857    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427864    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:42.427847059 +0000 UTC m=+3.140850097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427880    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:42.427872824 +0000 UTC m=+3.140875842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:41.427962 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.427892    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:26:42.427885971 +0000 UTC m=+3.140888989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:41.762318 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.762184    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:21:41 +0000 UTC" deadline="2028-03-08 09:34:08.24883137 +0000 UTC"
Sep 11 12:26:41.762318 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.762261    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13053h7m26.486575041s"
Sep 11 12:26:41.799911 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.799872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:41.800060 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.800017    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:41.809450 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.808545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mjr57" event={"ID":"398ed8ec-3c6b-4305-be68-5abbc29dc9be","Type":"ContainerStarted","Data":"a21c01a66e01457ec54a80335e73466b995feafbfb250365384fb5cb0fb395cf"}
Sep 11 12:26:41.811038 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:41.810997    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1ede51f0939b0c3d64025a444de8cbd252789c4c2a600a6301081f72ac78aeb7\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-image-registry/node-ca-mjr57" podUID="398ed8ec-3c6b-4305-be68-5abbc29dc9be"
Sep 11 12:26:41.815670 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.815535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"b9b494e0852938e4032f65575b69107398b4385fe81b3ce004b54f1131652173"}
Sep 11 12:26:41.817998 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.817924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tqwbk" event={"ID":"e165045a-b2b3-44a8-9668-c59c40e1dfe7","Type":"ContainerStarted","Data":"05f50c8ff3fec1371e0d4500fd29b0865ff7ad0562d55169692ad0b46804ea67"}
Sep 11 12:26:41.822444 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.822393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gsb88" event={"ID":"3738755c-d7ed-42ec-b73b-2293264b6a58","Type":"ContainerStarted","Data":"9bf4f0329d540e0551047579f20f4d500bcc5947f0e924847a91d84e29c105b5"}
Sep 11 12:26:41.825092 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.824908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzgcp" event={"ID":"ac8428ae-3836-42fe-a11d-396811239fba","Type":"ContainerStarted","Data":"00833042f741cd8dd9b32d7107ce0e03796b75d3bae17ac179451431c987580c"}
Sep 11 12:26:41.834178 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.833407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd" event={"ID":"c713fd86-e94b-4839-8346-46140f3d50c6","Type":"ContainerStarted","Data":"f8d8dd91e65cd541a0cd4868517a8a5add2071efdd88ad69a1a92963889b724e"}
Sep 11 12:26:41.835904 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.835874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sjxnz" event={"ID":"5610ec0e-6a8f-4295-a5b2-511adee43ca4","Type":"ContainerStarted","Data":"e485b1f0eff8c40a7b8fde78bea14c2e78fc74a0a5b50921dbdbad111911fa46"}
Sep 11 12:26:41.839065 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.839037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal" event={"ID":"f8d2aef2a39cd9167d2677babe4e9748","Type":"ContainerStarted","Data":"69640d5418b9bbe285a85d4b4493a769a681f9f1e6f64eda1194eac7b2533122"}
Sep 11 12:26:41.842872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.842846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerStarted","Data":"87a84e2190b80a26dae4e23472c5da04edc240f9919b4cd97400bb8ee85ea824"}
Sep 11 12:26:41.852874 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.852844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wz25k" event={"ID":"2f4b29b2-9f06-4aa0-9bdf-69be3866b271","Type":"ContainerStarted","Data":"1620dc41221c9c831bda276ac26461601c9841dc0424203f8331c6b6075595b6"}
Sep 11 12:26:41.859967 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:41.859944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" event={"ID":"2b89b17ba77a25e9cc2cd959b9fba315","Type":"ContainerStarted","Data":"d384d38766efcb9206af2cae1790baceec66c60a94742f06b0c7de2c46947933"}
Sep 11 12:26:42.163711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.163623    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:26:42.436085 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.435989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:42.436085 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.436071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.436129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436191    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436219    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436226    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436233    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436268    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436290    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:44.436268227 +0000 UTC m=+5.149271262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:42.436323 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436311    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:26:44.436300591 +0000 UTC m=+5.149303621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:42.436823 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.436348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:44.436330267 +0000 UTC m=+5.149333288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:42.762963 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.762859    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:21:41 +0000 UTC" deadline="2028-02-18 08:18:45.092245118 +0000 UTC"
Sep 11 12:26:42.762963 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.762911    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12595h52m2.329338987s"
Sep 11 12:26:42.800379 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.799759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:42.800379 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:42.799798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:42.800379 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.799911    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:42.800379 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:42.800066    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:43.802165 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:43.802132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:43.802661 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:43.802279    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:44.453753 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:44.453710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:44.453973 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:44.453827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:44.453973 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:44.453879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:44.454098 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454070    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:44.454098 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454097    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:44.454203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454110    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:44.454203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454173    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:26:48.454153069 +0000 UTC m=+9.167156103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:44.454716 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454691    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:44.454842 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454760    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:48.454742529 +0000 UTC m=+9.167745568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:44.454842 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454824    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:44.454959 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.454905    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:48.454882483 +0000 UTC m=+9.167885520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:44.799630 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:44.799534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:44.799814 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.799668    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:44.799814 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:44.799733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:44.799927 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:44.799826    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:45.799371 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:45.799330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:45.799996 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:45.799499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:46.799598 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:46.799569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:46.800073 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:46.799668    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:46.800073 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:46.799727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:46.800073 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:46.799783    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:47.799030 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:47.798987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:47.799197 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:47.799134    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:48.488585 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:48.488545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:48.488605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:48.488654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488774    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488834    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:56.488815496 +0000 UTC m=+17.201818528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488851    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488774    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488925    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:26:56.488906914 +0000 UTC m=+17.201909943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488866    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488947    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:48.489203 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.488979    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:26:56.488972181 +0000 UTC m=+17.201975198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:48.799348 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:48.799264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:48.799348 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:48.799301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:48.799544 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.799416    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:48.799588 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:48.799540    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:49.799691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:49.799661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:49.800109 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:49.799756    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:50.799858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:50.799799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:50.800322 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:50.799942    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:50.800322 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:50.799981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:50.800322 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:50.800068    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:51.799353 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:51.799317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:51.799544 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:51.799453    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:52.799991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:52.799950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:52.799991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:52.799976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:52.800519 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:52.800097    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:52.800519 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:52.800203    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:53.799600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:53.799563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:53.799741 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:53.799680    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:54.799142 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:54.799104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:54.799676 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:54.799251    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:54.799676 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:54.799455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:54.799676 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:54.799563    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:55.799442 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:55.799409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:55.799813 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:55.799516    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:56.548070 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:56.548039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:56.548273 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:56.548091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:56.548273 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:56.548144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:56.548273 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548226    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:26:56.548273 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548239    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:56.548273 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548256    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:26:56.548273 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548269    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:56.548545 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548235    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:56.548545 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548301    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:12.548282015 +0000 UTC m=+33.261285047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:26:56.548545 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548320    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:12.548309474 +0000 UTC m=+33.261312494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:26:56.548545 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.548333    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:12.548325889 +0000 UTC m=+33.261328910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:26:56.799912 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:56.799834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:56.800493 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:56.799846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:56.800493 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.799981    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:56.800493 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:56.800002    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:57.799969 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:57.799926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:57.800398 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:57.800071    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:26:58.799275 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:58.799234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:26:58.799275 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:58.799269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:26:58.799518 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:58.799382    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:26:58.799572 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:58.799504    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:26:59.800425 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:26:59.800396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:26:59.800760 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:26:59.800511    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:00.799667 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.799324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:00.799812 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.799333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:00.799812 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:00.799767    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:00.799925 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:00.799860    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:00.908087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908014    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908418    2563 generic.go:356] "Generic (PLEG): container finished" podID="3bd31588-602d-455d-99f2-abb5353ae7d0" containerID="5225acc4ee8726b8f39c3f04db8769c71b17b236a40c7780105418bdd1c245b9" exitCode=1
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"d464283e6100ab79b1cf50c724bc18c15e6fb45cbca49023baf8921bded3d20b"}
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"4ac9220f5d0ed3b1d0337d4b612ad2509c1455b1dd88d252b0387b89508e6b16"}
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"b612cc435b0b2d4a16275ddb99cfe7cced3b226dabb7325d84ea79214d45f552"}
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"da723dab1f26f020924dd7671cebf96d73c665d6ff8e563a93ed3cccc2b8c2f5"}
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerDied","Data":"5225acc4ee8726b8f39c3f04db8769c71b17b236a40c7780105418bdd1c245b9"}
Sep 11 12:27:00.908946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.908739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"ccbda36cc51a6db6a91077a0772c9dc4dfea3858c8d3b208fa6d9b1246b4d515"}
Sep 11 12:27:00.910151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.910126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gsb88" event={"ID":"3738755c-d7ed-42ec-b73b-2293264b6a58","Type":"ContainerStarted","Data":"8e8c496fc360a1d9ce040c284a1aee23792e81bd1eaf366a0ae7602b2610a7fa"}
Sep 11 12:27:00.911927 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.911880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzgcp" event={"ID":"ac8428ae-3836-42fe-a11d-396811239fba","Type":"ContainerStarted","Data":"fb8918fa0c7e002aa95fb203323b02a23fb6a8ac58d713c789b1df304bfce8cc"}
Sep 11 12:27:00.913600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.913575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd" event={"ID":"c713fd86-e94b-4839-8346-46140f3d50c6","Type":"ContainerStarted","Data":"37a42838e3323e4269c9bb9ead90cd74927c83914595b00c91b805f00d390889"}
Sep 11 12:27:00.915176 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.915146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sjxnz" event={"ID":"5610ec0e-6a8f-4295-a5b2-511adee43ca4","Type":"ContainerStarted","Data":"a5c30959c817ca86fb1130e1eede8f9602fe06c49786fb67bdb763c53f3a5e93"}
Sep 11 12:27:00.916769 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.916745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal" event={"ID":"f8d2aef2a39cd9167d2677babe4e9748","Type":"ContainerStarted","Data":"55477cb87b93eea03bc01d0485696ea7682330a277d1b6f79aa07daf5547c38e"}
Sep 11 12:27:00.918421 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.918395    2563 generic.go:356] "Generic (PLEG): container finished" podID="45419924-f936-4192-89df-b7f611862137" containerID="43366d33cd444c311f302c5fe57196dcf39f64ee624c92904fcf58b52e1a6ad5" exitCode=0
Sep 11 12:27:00.918528 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.918479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerDied","Data":"43366d33cd444c311f302c5fe57196dcf39f64ee624c92904fcf58b52e1a6ad5"}
Sep 11 12:27:00.920341 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.920314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wz25k" event={"ID":"2f4b29b2-9f06-4aa0-9bdf-69be3866b271","Type":"ContainerStarted","Data":"aca2ffddadab5387a1e6bfe16512cd10dafa1eaa1f33f05d19d092e7e159e53c"}
Sep 11 12:27:00.921901 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.921880    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b89b17ba77a25e9cc2cd959b9fba315" containerID="60e00889c872b8a79665b008439bcb8d310770b15de9028f6b2ab13d66bd67f3" exitCode=0
Sep 11 12:27:00.921997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.921914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" event={"ID":"2b89b17ba77a25e9cc2cd959b9fba315","Type":"ContainerDied","Data":"60e00889c872b8a79665b008439bcb8d310770b15de9028f6b2ab13d66bd67f3"}
Sep 11 12:27:00.930412 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.930345    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gsb88" podStartSLOduration=2.204650741 podStartE2EDuration="20.930330192s" totalImagesPullingTime="18.725679451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:00.929628502 +0000 UTC m=+21.642631540" watchObservedRunningTime="2026-09-11 12:27:00.930330192 +0000 UTC m=+21.643333232"
Sep 11 12:27:00.983887 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:00.983843    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-121.ec2.internal" podStartSLOduration=19.98382983 podStartE2EDuration="19.98382983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:00.983798248 +0000 UTC m=+21.696801285" watchObservedRunningTime="2026-09-11 12:27:00.98382983 +0000 UTC m=+21.696832867"
Sep 11 12:27:01.007846 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.007793    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wz25k" podStartSLOduration=2.175799366 podStartE2EDuration="21.007772834s" totalImagesPullingTime="18.831973468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:01.007306583 +0000 UTC m=+21.720309621" watchObservedRunningTime="2026-09-11 12:27:01.007772834 +0000 UTC m=+21.720775873"
Sep 11 12:27:01.025158 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.025107    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sjxnz" podStartSLOduration=9.82528818 podStartE2EDuration="21.025085572s" totalImagesPullingTime="11.199797392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:01.024632158 +0000 UTC m=+21.737635197" watchObservedRunningTime="2026-09-11 12:27:01.025085572 +0000 UTC m=+21.738088611"
Sep 11 12:27:01.043415 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.043351    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dzgcp" podStartSLOduration=2.291042453 podStartE2EDuration="21.043336037s" totalImagesPullingTime="18.752293584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:01.042868868 +0000 UTC m=+21.755871906" watchObservedRunningTime="2026-09-11 12:27:01.043336037 +0000 UTC m=+21.756339076"
Sep 11 12:27:01.799624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.799397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:01.799751 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:01.799655    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:01.925230 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.925195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mjr57" event={"ID":"398ed8ec-3c6b-4305-be68-5abbc29dc9be","Type":"ContainerStarted","Data":"1110c34fd806c6dd18d48949050ed52a32882cfd77e348e0fff618cb0f781541"}
Sep 11 12:27:01.926736 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.926713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tqwbk" event={"ID":"e165045a-b2b3-44a8-9668-c59c40e1dfe7","Type":"ContainerStarted","Data":"136df34eb4b500c0fbeda0f517a30fa7ff203ff1624377552dfae1f9293b39e0"}
Sep 11 12:27:01.928496 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.928470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" event={"ID":"2b89b17ba77a25e9cc2cd959b9fba315","Type":"ContainerStarted","Data":"c72d0bde8c69b43465cde479b997f3d920ff0643d25546d04293f31bfaf93d20"}
Sep 11 12:27:01.945507 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.945465    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mjr57" podStartSLOduration=1.7231400909999999 podStartE2EDuration="21.945447398s" totalImagesPullingTime="20.222307307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-11 12:27:01.945028393 +0000 UTC m=+22.658031432" watchObservedRunningTime="2026-09-11 12:27:01.945447398 +0000 UTC m=+22.658450438"
Sep 11 12:27:01.962050 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.962008    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tqwbk" podStartSLOduration=3.263374127 podStartE2EDuration="21.961992559s" totalImagesPullingTime="18.698618432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:01.961620324 +0000 UTC m=+22.674623363" watchObservedRunningTime="2026-09-11 12:27:01.961992559 +0000 UTC m=+22.674995598"
Sep 11 12:27:01.995085 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:01.995046    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-121.ec2.internal" podStartSLOduration=20.995032772 podStartE2EDuration="20.995032772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:01.994558477 +0000 UTC m=+22.707561516" watchObservedRunningTime="2026-09-11 12:27:01.995032772 +0000 UTC m=+22.708035809"
Sep 11 12:27:02.739451 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.739419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:27:02.740009 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.739988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:27:02.799006 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.798854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:02.799006 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.798890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:02.799006 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:02.798968    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:02.799262 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:02.799112    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:02.934380 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.934288    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:27:02.934851 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.934820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"bb6fbb4bce7036a705968c14e680e96afe802512ede30aa842aab6b39ba9bbcf"}
Sep 11 12:27:02.935254 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.935192    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:27:02.935739 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:02.935721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sjxnz"
Sep 11 12:27:03.172105 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:03.172086    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 12:27:03.791726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:03.791628    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T12:27:03.172101272Z","UUID":"b0cf9823-dfc2-4bc5-995e-42c778787528","Handler":null,"Name":"","Endpoint":""}
Sep 11 12:27:03.793121 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:03.793104    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 12:27:03.793219 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:03.793133    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 12:27:03.799346 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:03.799324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:03.799526 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:03.799506    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:03.938412 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:03.938378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd" event={"ID":"c713fd86-e94b-4839-8346-46140f3d50c6","Type":"ContainerStarted","Data":"2632c08ea656ebc93f22a71c45f8397f9400af241b7cb9236183ecee65a72244"}
Sep 11 12:27:04.799567 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:04.799540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:04.799724 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:04.799661    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:04.799724 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:04.799710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:04.799854 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:04.799835    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:05.799585 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:05.799547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:05.799955 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:05.799702    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:06.799279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.799080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:06.799380 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.799106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:06.799443 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:06.799419    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:06.799493 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:06.799478    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:06.951126 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.951100    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:27:06.951764 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.951542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"12b9df0da2dcde2ab9aa6c38bd07089774920b542110bd179d2314cb26c1ab06"}
Sep 11 12:27:06.951842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.951764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:27:06.952040 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.952017    2563 scope.go:117] "RemoveContainer" containerID="5225acc4ee8726b8f39c3f04db8769c71b17b236a40c7780105418bdd1c245b9"
Sep 11 12:27:06.954150 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.954123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd" event={"ID":"c713fd86-e94b-4839-8346-46140f3d50c6","Type":"ContainerStarted","Data":"223b375517b484c532f47f1bba92a258a2e521ec433609180a8171a6a0ea6a87"}
Sep 11 12:27:06.956053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.956031    2563 generic.go:356] "Generic (PLEG): container finished" podID="45419924-f936-4192-89df-b7f611862137" containerID="0f4c3d633bb28fc6524d87903a45ba173996aac7ce8682df8d7066d0cadeafe7" exitCode=0
Sep 11 12:27:06.956146 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.956061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerDied","Data":"0f4c3d633bb28fc6524d87903a45ba173996aac7ce8682df8d7066d0cadeafe7"}
Sep 11 12:27:06.967847 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:06.967828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:27:07.092282 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.091442    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzsqd" podStartSLOduration=2.343770483 podStartE2EDuration="27.09142081s" totalImagesPullingTime="24.747650327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:07.091274952 +0000 UTC m=+27.804277996" watchObservedRunningTime="2026-09-11 12:27:07.09142081 +0000 UTC m=+27.804423847"
Sep 11 12:27:07.799922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.799899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:07.800040 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:07.800001    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:07.961591 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.961555    2563 generic.go:356] "Generic (PLEG): container finished" podID="45419924-f936-4192-89df-b7f611862137" containerID="47b400c9337c38cfe798bab08b811a4551dd64f1feeee84554f4c8b3a8246ff3" exitCode=0
Sep 11 12:27:07.962126 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.961645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerDied","Data":"47b400c9337c38cfe798bab08b811a4551dd64f1feeee84554f4c8b3a8246ff3"}
Sep 11 12:27:07.966191 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.966173    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:27:07.968748 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.968722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" event={"ID":"3bd31588-602d-455d-99f2-abb5353ae7d0","Type":"ContainerStarted","Data":"5deb36c9b0abfbbfd4d64c26963c5fa5701f70e477fb05973fdce3597f4dc18c"}
Sep 11 12:27:07.968842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.968820    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 12:27:07.969061 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.969044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:27:07.995327 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:07.995298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:27:08.030848 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.030803    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb" podStartSLOduration=9.181188534 podStartE2EDuration="28.030786859s" totalImagesPullingTime="18.849598325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:08.030579243 +0000 UTC m=+28.743582280" watchObservedRunningTime="2026-09-11 12:27:08.030786859 +0000 UTC m=+28.743789897"
Sep 11 12:27:08.602978 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.602910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhqgf"]
Sep 11 12:27:08.603106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.603015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:08.603106 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:08.603098    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:08.605863 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.605836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bc4j9"]
Sep 11 12:27:08.605982 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.605939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:08.606046 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:08.606028    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:08.609144 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.609123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwx88"]
Sep 11 12:27:08.609243 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.609214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:08.609320 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:08.609300    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:08.973289 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.973110    2563 generic.go:356] "Generic (PLEG): container finished" podID="45419924-f936-4192-89df-b7f611862137" containerID="d6eb8205bd0c69e7f00c52aa903f677724281bfc245361a8fc88526eb305d24f" exitCode=0
Sep 11 12:27:08.973826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.973168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerDied","Data":"d6eb8205bd0c69e7f00c52aa903f677724281bfc245361a8fc88526eb305d24f"}
Sep 11 12:27:08.973826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:08.973445    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 12:27:09.800427 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:09.800395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:09.800633 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:09.800502    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:09.975439 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:09.975409    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 12:27:10.799824 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:10.799795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:10.799961 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:10.799797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:10.799961 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:10.799889    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:10.800041 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:10.799961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:11.082998 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:11.082902    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:27:11.083399 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:11.083120    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 12:27:11.094078 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:11.094056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5sslb"
Sep 11 12:27:11.803561 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:11.803528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:11.803789 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:11.803767    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bc4j9" podUID="fb568966-f7ba-4cfe-96c3-99ff3ff69cd4"
Sep 11 12:27:12.564679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:12.564646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:12.564704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:12.564724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.564822    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.564908    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.56488668 +0000 UTC m=+65.277889713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.564822    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.564975    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret podName:d62afd5e-0b26-45bb-8113-f581cde3c6d5 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.564957374 +0000 UTC m=+65.277960404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret") pod "global-pull-secret-syncer-bhqgf" (UID: "d62afd5e-0b26-45bb-8113-f581cde3c6d5") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.564830    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.565006    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.565018    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d8cks for pod openshift-network-diagnostics/network-check-target-hwx88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:27:12.565100 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.565061    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks podName:1a8f55c8-8b4f-467d-876b-6a9289fc3a1a nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.565048911 +0000 UTC m=+65.278051932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8cks" (UniqueName: "kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks") pod "network-check-target-hwx88" (UID: "1a8f55c8-8b4f-467d-876b-6a9289fc3a1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:27:12.799438 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:12.799401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:12.799627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:12.799404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:12.799627 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.799536    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwx88" podUID="1a8f55c8-8b4f-467d-876b-6a9289fc3a1a"
Sep 11 12:27:12.799627 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:12.799600    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhqgf" podUID="d62afd5e-0b26-45bb-8113-f581cde3c6d5"
Sep 11 12:27:13.081376 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.081335    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-121.ec2.internal" event="NodeReady"
Sep 11 12:27:13.081599 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.081483    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 12:27:13.122233 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.122138    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-695879bc56-9kjzf"]
Sep 11 12:27:13.160861 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.160833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-695879bc56-9kjzf"]
Sep 11 12:27:13.160861 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.160872    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9cq2v"]
Sep 11 12:27:13.161096 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.160986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.164466 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.164441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zqm8\""
Sep 11 12:27:13.164466 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.164441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 12:27:13.164672 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.164664    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 12:27:13.164733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.164664    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 12:27:13.176619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.176596    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 12:27:13.178604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.178573    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2h7pz"]
Sep 11 12:27:13.178693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.178631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.181674 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.181652    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 12:27:13.183701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.183402    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 12:27:13.183701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.183448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 12:27:13.183701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.183461    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q7zjm\""
Sep 11 12:27:13.198649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.198627    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cq2v"]
Sep 11 12:27:13.198751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.198666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2h7pz"]
Sep 11 12:27:13.198801 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.198749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.202604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.202586    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-48qpm\""
Sep 11 12:27:13.202815 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.202795    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 12:27:13.202909 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.202821    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 12:27:13.271282 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-tmp-dir\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.271478 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-config-volume\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.271478 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-image-registry-private-configuration\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.271478 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-installation-pull-secrets\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.271478 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cc7aa5a-9199-4f15-a14c-c0389d079388-ca-trust-extracted\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-certificates\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvvkp\" (UniqueName: \"kubernetes.io/projected/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-kube-api-access-xvvkp\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7deaa126-8256-42ed-9c6f-5976a5ec0aa2-cert\") pod \"ingress-canary-9cq2v\" (UID: \"7deaa126-8256-42ed-9c6f-5976a5ec0aa2\") " pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-bound-sa-token\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.271701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gscx\" (UniqueName: \"kubernetes.io/projected/7deaa126-8256-42ed-9c6f-5976a5ec0aa2-kube-api-access-2gscx\") pod \"ingress-canary-9cq2v\" (UID: \"7deaa126-8256-42ed-9c6f-5976a5ec0aa2\") " pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.272034 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-trusted-ca\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.272034 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.271738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-kube-api-access-dd9zm\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372080 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-tmp-dir\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-config-volume\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-image-registry-private-configuration\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-installation-pull-secrets\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cc7aa5a-9199-4f15-a14c-c0389d079388-ca-trust-extracted\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-certificates\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvvkp\" (UniqueName: \"kubernetes.io/projected/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-kube-api-access-xvvkp\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7deaa126-8256-42ed-9c6f-5976a5ec0aa2-cert\") pod \"ingress-canary-9cq2v\" (UID: \"7deaa126-8256-42ed-9c6f-5976a5ec0aa2\") " pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-bound-sa-token\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gscx\" (UniqueName: \"kubernetes.io/projected/7deaa126-8256-42ed-9c6f-5976a5ec0aa2-kube-api-access-2gscx\") pod \"ingress-canary-9cq2v\" (UID: \"7deaa126-8256-42ed-9c6f-5976a5ec0aa2\") " pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-trusted-ca\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-tmp-dir\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.372584    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:13.372693 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.372640    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:13.872623313 +0000 UTC m=+34.585626348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:13.373111 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-config-volume\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.373111 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.372485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-kube-api-access-dd9zm\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.373111 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.373010    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:13.373111 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.373029    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:13.373111 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.373029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cc7aa5a-9199-4f15-a14c-c0389d079388-ca-trust-extracted\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.373111 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.373082    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:13.873063893 +0000 UTC m=+34.586066909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:13.373718 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.373652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-certificates\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.374436 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.374411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-trusted-ca\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.377552 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.377528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-installation-pull-secrets\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.377649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.377557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7deaa126-8256-42ed-9c6f-5976a5ec0aa2-cert\") pod \"ingress-canary-9cq2v\" (UID: \"7deaa126-8256-42ed-9c6f-5976a5ec0aa2\") " pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.377649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.377538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-image-registry-private-configuration\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.384642 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.384618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-kube-api-access-dd9zm\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.384739 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.384712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-bound-sa-token\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.386248 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.386225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gscx\" (UniqueName: \"kubernetes.io/projected/7deaa126-8256-42ed-9c6f-5976a5ec0aa2-kube-api-access-2gscx\") pod \"ingress-canary-9cq2v\" (UID: \"7deaa126-8256-42ed-9c6f-5976a5ec0aa2\") " pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.386491 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.386474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvvkp\" (UniqueName: \"kubernetes.io/projected/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-kube-api-access-xvvkp\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.488637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.488598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cq2v"
Sep 11 12:27:13.799305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.799113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:13.802829 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.802628    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:27:13.803049 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.803001    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmfdf\""
Sep 11 12:27:13.804040 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.804010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cq2v"]
Sep 11 12:27:13.808607 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:27:13.808583    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7deaa126_8256_42ed_9c6f_5976a5ec0aa2.slice/crio-bd9903c2dc14b4f1e72a98b44845924251f6d3f7bdd36b83ee47d20c00d9f5c4 WatchSource:0}: Error finding container bd9903c2dc14b4f1e72a98b44845924251f6d3f7bdd36b83ee47d20c00d9f5c4: Status 404 returned error can't find the container with id bd9903c2dc14b4f1e72a98b44845924251f6d3f7bdd36b83ee47d20c00d9f5c4
Sep 11 12:27:13.876338 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.876305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:13.876494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.876350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:13.876494 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.876459    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:13.876567 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.876520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:14.87650504 +0000 UTC m=+35.589508072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:13.876567 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.876464    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:13.876567 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.876552    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:13.876661 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:13.876595    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:14.876584435 +0000 UTC m=+35.589587451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:13.985474 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:13.985442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cq2v" event={"ID":"7deaa126-8256-42ed-9c6f-5976a5ec0aa2","Type":"ContainerStarted","Data":"bd9903c2dc14b4f1e72a98b44845924251f6d3f7bdd36b83ee47d20c00d9f5c4"}
Sep 11 12:27:14.799757 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.799724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:14.799757 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.799748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:14.803000 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.802971    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:27:14.803144 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.802971    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:27:14.804329 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.804307    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6d4p\""
Sep 11 12:27:14.804452 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.804309    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:27:14.884630 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.884595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:14.884808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:14.884644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:14.884808 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:14.884767    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:14.884808 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:14.884791    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:14.884961 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:14.884777    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:14.884961 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:14.884865    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:16.884849637 +0000 UTC m=+37.597852669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:14.884961 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:14.884911    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:16.88489849 +0000 UTC m=+37.597901511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:15.993533 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:15.993502    2563 generic.go:356] "Generic (PLEG): container finished" podID="45419924-f936-4192-89df-b7f611862137" containerID="b1e19f6e24a9e6e3e8c032955dc93222445c50ef2a94837394441290b4707b8c" exitCode=0
Sep 11 12:27:15.993533 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:15.993541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerDied","Data":"b1e19f6e24a9e6e3e8c032955dc93222445c50ef2a94837394441290b4707b8c"}
Sep 11 12:27:16.900374 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:16.900324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:16.900552 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:16.900396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:16.900552 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:16.900524    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:16.900552 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:16.900547    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:16.900700 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:16.900568    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:16.900700 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:16.900624    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:20.900602227 +0000 UTC m=+41.613605258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:16.900700 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:16.900644    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:20.900634951 +0000 UTC m=+41.613637973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:17.000511 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:17.000478    2563 generic.go:356] "Generic (PLEG): container finished" podID="45419924-f936-4192-89df-b7f611862137" containerID="3f36f0c3fe58b8ea3fa3d0a5de9309218c5fd656d678dce91927ee20a96f88e2" exitCode=0
Sep 11 12:27:17.001053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:17.000535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerDied","Data":"3f36f0c3fe58b8ea3fa3d0a5de9309218c5fd656d678dce91927ee20a96f88e2"}
Sep 11 12:27:18.006426 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:18.006390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-78xpk" event={"ID":"45419924-f936-4192-89df-b7f611862137","Type":"ContainerStarted","Data":"1977a4dec4dc5adbaf4d8bd32511c9e213caf984be8b23a92c22c78da94521f6"}
Sep 11 12:27:18.041062 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:18.040834    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-78xpk" podStartSLOduration=5.423262004 podStartE2EDuration="38.040811087s" totalImagesPullingTime="32.617549083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:18.038151865 +0000 UTC m=+38.751154907" watchObservedRunningTime="2026-09-11 12:27:18.040811087 +0000 UTC m=+38.753814125"
Sep 11 12:27:19.009978 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:19.009940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cq2v" event={"ID":"7deaa126-8256-42ed-9c6f-5976a5ec0aa2","Type":"ContainerStarted","Data":"5f31f5e7576b2e6461f1da80fb5e925afc8efdf3ab26d71d64f82c1b04281fa5"}
Sep 11 12:27:19.031181 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:19.031123    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9cq2v" podStartSLOduration=1.8486858179999999 podStartE2EDuration="6.031109352s" totalImagesPullingTime="4.182423534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:19.030440544 +0000 UTC m=+39.743443581" watchObservedRunningTime="2026-09-11 12:27:19.031109352 +0000 UTC m=+39.744112389"
Sep 11 12:27:20.928979 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:20.928930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:20.928979 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:20.928987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:20.929423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:20.929098    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:20.929423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:20.929118    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:20.929423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:20.929113    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:20.929423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:20.929180    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:28.929160418 +0000 UTC m=+49.642163455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:20.929423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:20.929194    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:28.929188444 +0000 UTC m=+49.642191460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:28.988165 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:28.988119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:28.988165 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:28.988169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:28.988651 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:28.988269    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:28.988651 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:28.988273    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:28.988651 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:28.988294    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:28.988651 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:28.988325    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.988311202 +0000 UTC m=+65.701314218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:28.988651 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:28.988348    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.988335004 +0000 UTC m=+65.701338025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:29.397476 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.397395    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"]
Sep 11 12:27:29.432341 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.432311    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"]
Sep 11 12:27:29.432490 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.432449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"
Sep 11 12:27:29.435734 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.435706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8lvv7\""
Sep 11 12:27:29.456184 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.456155    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"]
Sep 11 12:27:29.456328 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.456282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.459291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.459250    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.460943 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.460920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 12:27:29.461062 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.460929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-thv78\""
Sep 11 12:27:29.461062 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.460930    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.461062 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.461025    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 12:27:29.480353 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.480325    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bc64c6b56-xmhwh"]
Sep 11 12:27:29.480492 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.480436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.484137 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.484117    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.484137 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.484137    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.484297 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.484199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 12:27:29.484297 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.484231    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 12:27:29.484297 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.484245    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rt4rv\""
Sep 11 12:27:29.502405 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.502341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"]
Sep 11 12:27:29.502405 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.502389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"]
Sep 11 12:27:29.502558 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.502414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"]
Sep 11 12:27:29.502558 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.502431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc64c6b56-xmhwh"]
Sep 11 12:27:29.502558 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.502465    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.506467 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.506425    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nclsq"]
Sep 11 12:27:29.506823 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.506804    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.506823 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.506820    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.506977 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.506812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 12:27:29.507019 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.507002    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 12:27:29.508002 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.507989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5w4k2\""
Sep 11 12:27:29.508099 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.508085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 12:27:29.508138 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.508132    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 12:27:29.522400 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.522381    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nclsq"]
Sep 11 12:27:29.522479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.522464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.525650 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.525630    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:27:29.525739 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.525634    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 12:27:29.525938 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.525918    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 12:27:29.526169 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.526153    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 12:27:29.526612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.526593    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5qvsj\""
Sep 11 12:27:29.530980 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.530957    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 12:27:29.593242 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-stats-auth\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.593242 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8p9\" (UniqueName: \"kubernetes.io/projected/2890bec1-678f-4e11-8645-13ec890840e9-kube-api-access-kv8p9\") pod \"network-check-source-6f8b768455-rzxhs\" (UID: \"2890bec1-678f-4e11-8645-13ec890840e9\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q76kb\" (UniqueName: \"kubernetes.io/projected/a3f26454-b9d0-4199-82dd-e59f12fb5130-kube-api-access-q76kb\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-config\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-default-certificate\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3f26454-b9d0-4199-82dd-e59f12fb5130-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dzs5\" (UniqueName: \"kubernetes.io/projected/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-kube-api-access-7dzs5\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrgl\" (UniqueName: \"kubernetes.io/projected/15635f4b-3982-4cd9-8130-6d5de40458e3-kube-api-access-dbrgl\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.593535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-serving-cert\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.593806 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.593806 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.593592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.694701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.694663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c62718e5-19aa-45cf-bf82-50570d247c63-config\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.694990 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.694963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-stats-auth\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.695107 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8p9\" (UniqueName: \"kubernetes.io/projected/2890bec1-678f-4e11-8645-13ec890840e9-kube-api-access-kv8p9\") pod \"network-check-source-6f8b768455-rzxhs\" (UID: \"2890bec1-678f-4e11-8645-13ec890840e9\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"
Sep 11 12:27:29.695234 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q76kb\" (UniqueName: \"kubernetes.io/projected/a3f26454-b9d0-4199-82dd-e59f12fb5130-kube-api-access-q76kb\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.695339 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c62718e5-19aa-45cf-bf82-50570d247c63-serving-cert\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.695488 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-default-certificate\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.695580 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.695710 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.695822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c62718e5-19aa-45cf-bf82-50570d247c63-trusted-ca\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.695913 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrgl\" (UniqueName: \"kubernetes.io/projected/15635f4b-3982-4cd9-8130-6d5de40458e3-kube-api-access-dbrgl\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.696007 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.695995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-serving-cert\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.696103 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.696091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w954t\" (UniqueName: \"kubernetes.io/projected/c62718e5-19aa-45cf-bf82-50570d247c63-kube-api-access-w954t\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.696201 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.696190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-config\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.696297 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.696285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3f26454-b9d0-4199-82dd-e59f12fb5130-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.696426 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.696411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dzs5\" (UniqueName: \"kubernetes.io/projected/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-kube-api-access-7dzs5\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.696562 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.696548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.696778 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:29.696763    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:29.696917 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:29.696908    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls podName:a3f26454-b9d0-4199-82dd-e59f12fb5130 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.196887997 +0000 UTC m=+50.909891027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-sgfhz" (UID: "a3f26454-b9d0-4199-82dd-e59f12fb5130") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:29.697856 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:29.697830    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:27:29.697958 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:29.697912    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.197895318 +0000 UTC m=+50.910898351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:27:29.698030 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:29.697962    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:30.197942877 +0000 UTC m=+50.910945915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : secret "router-metrics-certs-default" not found
Sep 11 12:27:29.699149 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.699108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-config\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.699321 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.699300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3f26454-b9d0-4199-82dd-e59f12fb5130-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.701125 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.701097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-serving-cert\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.701346 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.701329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-stats-auth\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.701518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.701496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-default-certificate\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.707484 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.707452    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76kb\" (UniqueName: \"kubernetes.io/projected/a3f26454-b9d0-4199-82dd-e59f12fb5130-kube-api-access-q76kb\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:29.708157 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.708125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dzs5\" (UniqueName: \"kubernetes.io/projected/5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d-kube-api-access-7dzs5\") pod \"service-ca-operator-cf7c776b7-bdrcn\" (UID: \"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.708551 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.708531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8p9\" (UniqueName: \"kubernetes.io/projected/2890bec1-678f-4e11-8645-13ec890840e9-kube-api-access-kv8p9\") pod \"network-check-source-6f8b768455-rzxhs\" (UID: \"2890bec1-678f-4e11-8645-13ec890840e9\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"
Sep 11 12:27:29.708717 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.708698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrgl\" (UniqueName: \"kubernetes.io/projected/15635f4b-3982-4cd9-8130-6d5de40458e3-kube-api-access-dbrgl\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:29.741925 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.741893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"
Sep 11 12:27:29.788155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.788121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"
Sep 11 12:27:29.797703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.797678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c62718e5-19aa-45cf-bf82-50570d247c63-trusted-ca\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.797820 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.797710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w954t\" (UniqueName: \"kubernetes.io/projected/c62718e5-19aa-45cf-bf82-50570d247c63-kube-api-access-w954t\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.797820 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.797773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c62718e5-19aa-45cf-bf82-50570d247c63-config\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.797820 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.797801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c62718e5-19aa-45cf-bf82-50570d247c63-serving-cert\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.798538 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.798512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c62718e5-19aa-45cf-bf82-50570d247c63-config\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.798732 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.798715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c62718e5-19aa-45cf-bf82-50570d247c63-trusted-ca\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.800331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.800309    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c62718e5-19aa-45cf-bf82-50570d247c63-serving-cert\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.808267 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.808213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w954t\" (UniqueName: \"kubernetes.io/projected/c62718e5-19aa-45cf-bf82-50570d247c63-kube-api-access-w954t\") pod \"console-operator-696884fb9c-nclsq\" (UID: \"c62718e5-19aa-45cf-bf82-50570d247c63\") " pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:29.831946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:29.831682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:30.043690 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:30.043606    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs"]
Sep 11 12:27:30.048349 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:27:30.048320    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2890bec1_678f_4e11_8645_13ec890840e9.slice/crio-39b79ff2022a225fa349403c4355e872d18a1f5f5406719d1908c0e6493362d5 WatchSource:0}: Error finding container 39b79ff2022a225fa349403c4355e872d18a1f5f5406719d1908c0e6493362d5: Status 404 returned error can't find the container with id 39b79ff2022a225fa349403c4355e872d18a1f5f5406719d1908c0e6493362d5
Sep 11 12:27:30.083113 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:30.083083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn"]
Sep 11 12:27:30.086241 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:27:30.086211    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d750dfb_ad26_4bc4_8c6c_cb63c09ec83d.slice/crio-455415df2057b715d520843c216f9282e33d34ffb602919bea0abe35acb89c82 WatchSource:0}: Error finding container 455415df2057b715d520843c216f9282e33d34ffb602919bea0abe35acb89c82: Status 404 returned error can't find the container with id 455415df2057b715d520843c216f9282e33d34ffb602919bea0abe35acb89c82
Sep 11 12:27:30.135446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:30.135411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-nclsq"]
Sep 11 12:27:30.148049 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:27:30.148017    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62718e5_19aa_45cf_bf82_50570d247c63.slice/crio-45f7c20019bcd2d2fdd7e0d0731c82d0628a1d168442066a2167174c3c808d71 WatchSource:0}: Error finding container 45f7c20019bcd2d2fdd7e0d0731c82d0628a1d168442066a2167174c3c808d71: Status 404 returned error can't find the container with id 45f7c20019bcd2d2fdd7e0d0731c82d0628a1d168442066a2167174c3c808d71
Sep 11 12:27:30.201621 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:30.201581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:30.201817 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:30.201667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:30.201817 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:30.201698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:30.201817 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:30.201733    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:30.201817 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:30.201800    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls podName:a3f26454-b9d0-4199-82dd-e59f12fb5130 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:31.201784697 +0000 UTC m=+51.914787713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-sgfhz" (UID: "a3f26454-b9d0-4199-82dd-e59f12fb5130") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:30.201817 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:30.201812    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:27:30.202025 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:30.201816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:31.201808449 +0000 UTC m=+51.914811466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:27:30.202025 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:30.201884    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:31.201864748 +0000 UTC m=+51.914867777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : secret "router-metrics-certs-default" not found
Sep 11 12:27:31.037671 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:31.037628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" event={"ID":"c62718e5-19aa-45cf-bf82-50570d247c63","Type":"ContainerStarted","Data":"45f7c20019bcd2d2fdd7e0d0731c82d0628a1d168442066a2167174c3c808d71"}
Sep 11 12:27:31.039110 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:31.039079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn" event={"ID":"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d","Type":"ContainerStarted","Data":"455415df2057b715d520843c216f9282e33d34ffb602919bea0abe35acb89c82"}
Sep 11 12:27:31.041115 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:31.041091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs" event={"ID":"2890bec1-678f-4e11-8645-13ec890840e9","Type":"ContainerStarted","Data":"39b79ff2022a225fa349403c4355e872d18a1f5f5406719d1908c0e6493362d5"}
Sep 11 12:27:31.209672 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:31.209635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:31.209716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:31.209754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:31.209798    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:31.209863    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:31.209870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls podName:a3f26454-b9d0-4199-82dd-e59f12fb5130 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:33.209846668 +0000 UTC m=+53.922849701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-sgfhz" (UID: "a3f26454-b9d0-4199-82dd-e59f12fb5130") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:31.209914    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:33.209902516 +0000 UTC m=+53.922905536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:27:31.210211 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:31.209926    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:33.209918084 +0000 UTC m=+53.922921100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : secret "router-metrics-certs-default" not found
Sep 11 12:27:33.049323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.049280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" event={"ID":"c62718e5-19aa-45cf-bf82-50570d247c63","Type":"ContainerStarted","Data":"abaffc61684f1412bcd8681d35f464c0042887d4496e8bfe90dd658f787c5a7e"}
Sep 11 12:27:33.049788 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.049630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:33.051127 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.051100    2563 patch_prober.go:28] interesting pod/console-operator-696884fb9c-nclsq container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Sep 11 12:27:33.051267 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.051176    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused"
Sep 11 12:27:33.072785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.072732    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podStartSLOduration=1.768665849 podStartE2EDuration="4.072712341s" totalImagesPullingTime="2.304046492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:33.071665417 +0000 UTC m=+53.784668457" watchObservedRunningTime="2026-09-11 12:27:33.072712341 +0000 UTC m=+53.785715381"
Sep 11 12:27:33.226155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.226109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:33.226423 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.226256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:33.226423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:33.226267    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.226248929 +0000 UTC m=+57.939251944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:27:33.226423 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:33.226381    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:33.226590 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:33.226450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls podName:a3f26454-b9d0-4199-82dd-e59f12fb5130 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.226431798 +0000 UTC m=+57.939434833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-sgfhz" (UID: "a3f26454-b9d0-4199-82dd-e59f12fb5130") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:33.226590 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:33.226504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:33.226703 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:33.226665    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:27:33.226754 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:33.226739    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.226722789 +0000 UTC m=+57.939725822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : secret "router-metrics-certs-default" not found
Sep 11 12:27:34.054084 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.054042    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs" event={"ID":"2890bec1-678f-4e11-8645-13ec890840e9","Type":"ContainerStarted","Data":"ca9c1ad32f530d7e520c11b8d9b76e45a7b1ef7c64ced0c5e9a8cabf9a80da55"}
Sep 11 12:27:34.055695 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.055673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/0.log"
Sep 11 12:27:34.055778 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.055718    2563 generic.go:356] "Generic (PLEG): container finished" podID="c62718e5-19aa-45cf-bf82-50570d247c63" containerID="abaffc61684f1412bcd8681d35f464c0042887d4496e8bfe90dd658f787c5a7e" exitCode=255
Sep 11 12:27:34.055828 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.055801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" event={"ID":"c62718e5-19aa-45cf-bf82-50570d247c63","Type":"ContainerDied","Data":"abaffc61684f1412bcd8681d35f464c0042887d4496e8bfe90dd658f787c5a7e"}
Sep 11 12:27:34.055999 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.055984    2563 scope.go:117] "RemoveContainer" containerID="abaffc61684f1412bcd8681d35f464c0042887d4496e8bfe90dd658f787c5a7e"
Sep 11 12:27:34.057485 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.057461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn" event={"ID":"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d","Type":"ContainerStarted","Data":"15638a4af5286bc24d0facd34a169b913eaee097a6d9f19e1e40842b9680c72a"}
Sep 11 12:27:34.073000 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.072956    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rzxhs" podStartSLOduration=1.207257012 podStartE2EDuration="5.072939692s" totalImagesPullingTime="3.86568268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:34.072754061 +0000 UTC m=+54.785757091" watchObservedRunningTime="2026-09-11 12:27:34.072939692 +0000 UTC m=+54.785942734"
Sep 11 12:27:34.093216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:34.093169    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn" podStartSLOduration=1.26791414 podStartE2EDuration="5.093153151s" totalImagesPullingTime="3.825239011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:34.092204679 +0000 UTC m=+54.805207718" watchObservedRunningTime="2026-09-11 12:27:34.093153151 +0000 UTC m=+54.806156182"
Sep 11 12:27:35.061986 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:35.061957    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/1.log"
Sep 11 12:27:35.062473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:35.062408    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/0.log"
Sep 11 12:27:35.062473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:35.062439    2563 generic.go:356] "Generic (PLEG): container finished" podID="c62718e5-19aa-45cf-bf82-50570d247c63" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91" exitCode=255
Sep 11 12:27:35.062586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:35.062466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" event={"ID":"c62718e5-19aa-45cf-bf82-50570d247c63","Type":"ContainerDied","Data":"cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"}
Sep 11 12:27:35.062586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:35.062549    2563 scope.go:117] "RemoveContainer" containerID="abaffc61684f1412bcd8681d35f464c0042887d4496e8bfe90dd658f787c5a7e"
Sep 11 12:27:35.062766 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:35.062748    2563 scope.go:117] "RemoveContainer" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"
Sep 11 12:27:35.062975 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:35.062947    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:27:36.066263 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.066234    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/1.log"
Sep 11 12:27:36.066663 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.066586    2563 scope.go:117] "RemoveContainer" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"
Sep 11 12:27:36.066753 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:36.066733    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:27:36.332166 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.332090    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8mhfj"]
Sep 11 12:27:36.334458 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.334442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.337474 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.337431    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 12:27:36.337603 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.337506    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9m2p7\""
Sep 11 12:27:36.337603 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.337583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 12:27:36.337803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.337784    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 12:27:36.337850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.337836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 12:27:36.348793 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.348773    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mhfj"]
Sep 11 12:27:36.454237 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.454207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnscm\" (UniqueName: \"kubernetes.io/projected/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-api-access-hnscm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.454421 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.454267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-crio-socket\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.454421 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.454324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.454502 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.454441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-data-volume\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.454502 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.454479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555602 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-data-volume\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555602 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555839 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:36.555767    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:36.555892 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:36.555840    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.055818874 +0000 UTC m=+57.768821905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:36.555892 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnscm\" (UniqueName: \"kubernetes.io/projected/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-api-access-hnscm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-data-volume\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-crio-socket\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-crio-socket\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.555997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.555994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:36.556177 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:36.556060    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:36.556177 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:36.556103    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:37.05609174 +0000 UTC m=+57.769094760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:36.565798 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:36.565772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnscm\" (UniqueName: \"kubernetes.io/projected/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-api-access-hnscm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:37.063981 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:37.063939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:37.064174 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:37.064055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:37.064174 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.064084    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:37.064174 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.064162    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:38.064141761 +0000 UTC m=+58.777144793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:37.064174 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.064169    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:37.064329 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.064206    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:38.064196134 +0000 UTC m=+58.777199162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:37.265539 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:37.265463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:37.265561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.265616    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.265682    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:45.265667522 +0000 UTC m=+65.978670544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : secret "router-metrics-certs-default" not found
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.265689    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:37.265618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.265733    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:45.265716176 +0000 UTC m=+65.978719212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:27:37.265997 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:37.265773    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls podName:a3f26454-b9d0-4199-82dd-e59f12fb5130 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:45.265762819 +0000 UTC m=+65.978765836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-sgfhz" (UID: "a3f26454-b9d0-4199-82dd-e59f12fb5130") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:38.072975 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:38.072940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:38.073143 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:38.073028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:38.073143 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:38.073096    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:38.073212 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:38.073138    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:38.073212 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:38.073160    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:40.073146476 +0000 UTC m=+60.786149497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:38.073212 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:38.073184    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:40.07317264 +0000 UTC m=+60.786175656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:38.445283 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:38.445256    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gsb88_3738755c-d7ed-42ec-b73b-2293264b6a58/dns-node-resolver/0.log"
Sep 11 12:27:39.254376 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:39.254327    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mjr57_398ed8ec-3c6b-4305-be68-5abbc29dc9be/node-ca/0.log"
Sep 11 12:27:39.832090 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:39.832057    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:39.832558 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:39.832493    2563 scope.go:117] "RemoveContainer" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"
Sep 11 12:27:39.832694 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:39.832674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:27:39.854904 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:39.854880    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cq2v_7deaa126-8256-42ed-9c6f-5976a5ec0aa2/serve-healthcheck-canary/0.log"
Sep 11 12:27:40.088305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:40.088211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:40.088499 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:40.088329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:40.088499 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:40.088348    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:40.088499 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:40.088431    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.088413524 +0000 UTC m=+64.801416539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:40.088499 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:40.088454    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:40.088659 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:40.088510    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:44.088494471 +0000 UTC m=+64.801497506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:43.049791 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:43.049758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:43.050257 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:43.050131    2563 scope.go:117] "RemoveContainer" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"
Sep 11 12:27:43.050297 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:43.050267    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:27:44.121869 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.121840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:44.122256 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:44.121967    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:27:44.122256 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.121991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:44.122256 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:44.122041    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:52.122025988 +0000 UTC m=+72.835029005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : configmap "kube-rbac-proxy" not found
Sep 11 12:27:44.122256 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:44.122095    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:44.122256 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:44.122140    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:27:52.122127492 +0000 UTC m=+72.835130508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:44.625985 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.625950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:44.626154 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.626025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:27:44.626154 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.626080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:44.628569 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.628550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8cks\" (UniqueName: \"kubernetes.io/projected/1a8f55c8-8b4f-467d-876b-6a9289fc3a1a-kube-api-access-d8cks\") pod \"network-check-target-hwx88\" (UID: \"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a\") " pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:44.629570 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.629549    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:27:44.629658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.629615    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:27:44.636832 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:44.636809    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:27:44.636940 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:44.636879    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs podName:fb568966-f7ba-4cfe-96c3-99ff3ff69cd4 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:48.63685985 +0000 UTC m=+129.349862883 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs") pod "network-metrics-daemon-bc4j9" (UID: "fb568966-f7ba-4cfe-96c3-99ff3ff69cd4") : secret "metrics-daemon-secret" not found
Sep 11 12:27:44.638815 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.638788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d62afd5e-0b26-45bb-8113-f581cde3c6d5-original-pull-secret\") pod \"global-pull-secret-syncer-bhqgf\" (UID: \"d62afd5e-0b26-45bb-8113-f581cde3c6d5\") " pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:44.815133 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.815103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6d4p\""
Sep 11 12:27:44.818278 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.818262    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhqgf"
Sep 11 12:27:44.822384 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:44.822340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:45.029730 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.029695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:27:45.029730 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.029742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:27:45.029948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.029860    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:27:45.029948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.029862    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:27:45.029948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.029883    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-695879bc56-9kjzf: secret "image-registry-tls" not found
Sep 11 12:27:45.029948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.029928    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls podName:0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:17.0298987 +0000 UTC m=+97.742901716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls") pod "dns-default-2h7pz" (UID: "0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308") : secret "dns-default-metrics-tls" not found
Sep 11 12:27:45.029948 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.029942    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls podName:5cc7aa5a-9199-4f15-a14c-c0389d079388 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:17.029935848 +0000 UTC m=+97.742938864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls") pod "image-registry-695879bc56-9kjzf" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388") : secret "image-registry-tls" not found
Sep 11 12:27:45.093964 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.093933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhqgf"]
Sep 11 12:27:45.096865 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.096840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwx88"]
Sep 11 12:27:45.097288 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:27:45.097266    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62afd5e_0b26_45bb_8113_f581cde3c6d5.slice/crio-cf3e1fd630e99ec73b282595f22f8d0339e229160da38516938a66e13db121a7 WatchSource:0}: Error finding container cf3e1fd630e99ec73b282595f22f8d0339e229160da38516938a66e13db121a7: Status 404 returned error can't find the container with id cf3e1fd630e99ec73b282595f22f8d0339e229160da38516938a66e13db121a7
Sep 11 12:27:45.099663 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:27:45.099639    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8f55c8_8b4f_467d_876b_6a9289fc3a1a.slice/crio-b43462028386ac8e3ce85bfa72f7c338e7d897aca3a7531d440570bbb257360b WatchSource:0}: Error finding container b43462028386ac8e3ce85bfa72f7c338e7d897aca3a7531d440570bbb257360b: Status 404 returned error can't find the container with id b43462028386ac8e3ce85bfa72f7c338e7d897aca3a7531d440570bbb257360b
Sep 11 12:27:45.331635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.331595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:45.331635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.331642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:27:45.332057 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:45.331692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:27:45.332057 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.331750    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 12:27:45.332057 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.331805    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:45.332057 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.331817    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:01.331801688 +0000 UTC m=+82.044804704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : secret "router-metrics-certs-default" not found
Sep 11 12:27:45.332057 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.331830    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle podName:15635f4b-3982-4cd9-8130-6d5de40458e3 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:01.331824692 +0000 UTC m=+82.044827708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle") pod "router-default-5bc64c6b56-xmhwh" (UID: "15635f4b-3982-4cd9-8130-6d5de40458e3") : configmap references non-existent config key: service-ca.crt
Sep 11 12:27:45.332057 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:45.331842    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls podName:a3f26454-b9d0-4199-82dd-e59f12fb5130 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:01.331835854 +0000 UTC m=+82.044838870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-sgfhz" (UID: "a3f26454-b9d0-4199-82dd-e59f12fb5130") : secret "cluster-monitoring-operator-tls" not found
Sep 11 12:27:46.094212 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:46.094162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwx88" event={"ID":"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a","Type":"ContainerStarted","Data":"7d80b37dc5d5f37a9b0cb03c29a299975ad40165798b06b3c956cdae5b2c4321"}
Sep 11 12:27:46.094426 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:46.094221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwx88" event={"ID":"1a8f55c8-8b4f-467d-876b-6a9289fc3a1a","Type":"ContainerStarted","Data":"b43462028386ac8e3ce85bfa72f7c338e7d897aca3a7531d440570bbb257360b"}
Sep 11 12:27:46.094426 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:46.094285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:27:46.095716 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:46.095686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhqgf" event={"ID":"d62afd5e-0b26-45bb-8113-f581cde3c6d5","Type":"ContainerStarted","Data":"cf3e1fd630e99ec73b282595f22f8d0339e229160da38516938a66e13db121a7"}
Sep 11 12:27:46.114091 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:46.114035    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hwx88" podStartSLOduration=66.114017221 podStartE2EDuration="1m6.114017221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:46.113004406 +0000 UTC m=+66.826007443" watchObservedRunningTime="2026-09-11 12:27:46.114017221 +0000 UTC m=+66.827020260"
Sep 11 12:27:50.110619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:50.110582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhqgf" event={"ID":"d62afd5e-0b26-45bb-8113-f581cde3c6d5","Type":"ContainerStarted","Data":"9e686af76d1049dc8f36f152f647202a1638898adcf6d1ea76196e8290b9ac5a"}
Sep 11 12:27:50.129606 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:50.129556    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bhqgf" podStartSLOduration=66.153806748 podStartE2EDuration="1m10.12954273s" totalImagesPullingTime="3.975735982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:50.129118089 +0000 UTC m=+70.842121126" watchObservedRunningTime="2026-09-11 12:27:50.12954273 +0000 UTC m=+70.842545790"
Sep 11 12:27:52.192155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:52.192120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:52.192539 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:52.192193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:52.192539 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:52.192295    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:52.192539 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:52.192344    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls podName:e4d3aa49-8bb5-40d1-8ee5-2258463f93b3 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:08.192331932 +0000 UTC m=+88.905334962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8mhfj" (UID: "e4d3aa49-8bb5-40d1-8ee5-2258463f93b3") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:27:52.192650 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:52.192633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:27:57.799625 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:57.799590    2563 scope.go:117] "RemoveContainer" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"
Sep 11 12:27:58.136713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:58.136638    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:27:58.137073 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:58.137058    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/1.log"
Sep 11 12:27:58.137142 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:58.137091    2563 generic.go:356] "Generic (PLEG): container finished" podID="c62718e5-19aa-45cf-bf82-50570d247c63" containerID="bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14" exitCode=255
Sep 11 12:27:58.137188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:58.137155    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" event={"ID":"c62718e5-19aa-45cf-bf82-50570d247c63","Type":"ContainerDied","Data":"bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14"}
Sep 11 12:27:58.137232 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:58.137208    2563 scope.go:117] "RemoveContainer" containerID="cfde974ec96b461aa9931491839c01628b646c2dc878aba6ac121fc0cace7e91"
Sep 11 12:27:58.137556 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:58.137534    2563 scope.go:117] "RemoveContainer" containerID="bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14"
Sep 11 12:27:58.137721 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:58.137700    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:27:59.142536 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:59.142510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:27:59.832441 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:59.832403    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:27:59.832746 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:27:59.832726    2563 scope.go:117] "RemoveContainer" containerID="bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14"
Sep 11 12:27:59.832884 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:27:59.832866    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:28:01.369718 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.369677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:01.370090 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.369725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:01.370090 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.369803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:28:01.370393 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.370350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15635f4b-3982-4cd9-8130-6d5de40458e3-service-ca-bundle\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:01.372216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.372185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3f26454-b9d0-4199-82dd-e59f12fb5130-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-sgfhz\" (UID: \"a3f26454-b9d0-4199-82dd-e59f12fb5130\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:28:01.372345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.372322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15635f4b-3982-4cd9-8130-6d5de40458e3-metrics-certs\") pod \"router-default-5bc64c6b56-xmhwh\" (UID: \"15635f4b-3982-4cd9-8130-6d5de40458e3\") " pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:01.567733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.567698    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-thv78\""
Sep 11 12:28:01.575500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.575480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"
Sep 11 12:28:01.614645 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.614613    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5w4k2\""
Sep 11 12:28:01.623093 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.622839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:01.844101 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.844070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz"]
Sep 11 12:28:01.846624 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:01.846598    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f26454_b9d0_4199_82dd_e59f12fb5130.slice/crio-3a2f79d84dc46e2f572d74f1f433af6a6ff05de4936a8ac3196504e697ebf938 WatchSource:0}: Error finding container 3a2f79d84dc46e2f572d74f1f433af6a6ff05de4936a8ac3196504e697ebf938: Status 404 returned error can't find the container with id 3a2f79d84dc46e2f572d74f1f433af6a6ff05de4936a8ac3196504e697ebf938
Sep 11 12:28:01.914612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:01.914585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc64c6b56-xmhwh"]
Sep 11 12:28:01.917445 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:01.917409    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15635f4b_3982_4cd9_8130_6d5de40458e3.slice/crio-295fd1fde43629506ae9027ad52633b5193b988d9de5efde165f7ec629033bb8 WatchSource:0}: Error finding container 295fd1fde43629506ae9027ad52633b5193b988d9de5efde165f7ec629033bb8: Status 404 returned error can't find the container with id 295fd1fde43629506ae9027ad52633b5193b988d9de5efde165f7ec629033bb8
Sep 11 12:28:02.153690 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:02.153653    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh" event={"ID":"15635f4b-3982-4cd9-8130-6d5de40458e3","Type":"ContainerStarted","Data":"e0c0ae2353269b8c8157ffb06c69c6ca91262d7be05ac8a505e6454506f669c7"}
Sep 11 12:28:02.153870 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:02.153709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh" event={"ID":"15635f4b-3982-4cd9-8130-6d5de40458e3","Type":"ContainerStarted","Data":"295fd1fde43629506ae9027ad52633b5193b988d9de5efde165f7ec629033bb8"}
Sep 11 12:28:02.154794 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:02.154769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz" event={"ID":"a3f26454-b9d0-4199-82dd-e59f12fb5130","Type":"ContainerStarted","Data":"3a2f79d84dc46e2f572d74f1f433af6a6ff05de4936a8ac3196504e697ebf938"}
Sep 11 12:28:02.175317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:02.175232    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh" podStartSLOduration=33.175211507 podStartE2EDuration="33.175211507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:02.175178103 +0000 UTC m=+82.888181140" watchObservedRunningTime="2026-09-11 12:28:02.175211507 +0000 UTC m=+82.888214544"
Sep 11 12:28:02.624319 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:02.624219    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:02.626886 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:02.626866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:03.050548 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:03.050512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:28:03.050970 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:03.050946    2563 scope.go:117] "RemoveContainer" containerID="bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14"
Sep 11 12:28:03.051176 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:03.051149    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:28:03.158241 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:03.158212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:03.159626 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:03.159597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bc64c6b56-xmhwh"
Sep 11 12:28:04.686941 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.686910    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"]
Sep 11 12:28:04.718789 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.718752    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"]
Sep 11 12:28:04.718949 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.718864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:04.722915 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.722896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lnrdh\""
Sep 11 12:28:04.723086 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.723071    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 12:28:04.798970 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.798937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1560719d-bea2-46df-b35f-c34fb82267c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dc8pv\" (UID: \"1560719d-bea2-46df-b35f-c34fb82267c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:04.900214 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:04.900176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1560719d-bea2-46df-b35f-c34fb82267c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dc8pv\" (UID: \"1560719d-bea2-46df-b35f-c34fb82267c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:04.900436 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:04.900323    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 12:28:04.900436 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:04.900428    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1560719d-bea2-46df-b35f-c34fb82267c4-tls-certificates podName:1560719d-bea2-46df-b35f-c34fb82267c4 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:05.400408213 +0000 UTC m=+86.113411243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1560719d-bea2-46df-b35f-c34fb82267c4-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-dc8pv" (UID: "1560719d-bea2-46df-b35f-c34fb82267c4") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 12:28:05.166231 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:05.166195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz" event={"ID":"a3f26454-b9d0-4199-82dd-e59f12fb5130","Type":"ContainerStarted","Data":"6f26f403e00c154dc260f022099c6f5c35f511c7f6d7281cdcde030efa63a5a9"}
Sep 11 12:28:05.185429 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:05.185386    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-sgfhz" podStartSLOduration=33.867952078 podStartE2EDuration="36.185352593s" totalImagesPullingTime="2.317400515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:05.184310854 +0000 UTC m=+85.897313891" watchObservedRunningTime="2026-09-11 12:28:05.185352593 +0000 UTC m=+85.898355631"
Sep 11 12:28:05.405698 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:05.405649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1560719d-bea2-46df-b35f-c34fb82267c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dc8pv\" (UID: \"1560719d-bea2-46df-b35f-c34fb82267c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:05.407904 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:05.407862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1560719d-bea2-46df-b35f-c34fb82267c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-dc8pv\" (UID: \"1560719d-bea2-46df-b35f-c34fb82267c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:05.628429 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:05.628327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:05.917766 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:05.917740    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"]
Sep 11 12:28:05.921026 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:05.920997    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1560719d_bea2_46df_b35f_c34fb82267c4.slice/crio-fd1456126b1a974520dc8dafc0d8d16ab9fc5a98658ef4fa29a6c6821458e522 WatchSource:0}: Error finding container fd1456126b1a974520dc8dafc0d8d16ab9fc5a98658ef4fa29a6c6821458e522: Status 404 returned error can't find the container with id fd1456126b1a974520dc8dafc0d8d16ab9fc5a98658ef4fa29a6c6821458e522
Sep 11 12:28:06.170977 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:06.170895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv" event={"ID":"1560719d-bea2-46df-b35f-c34fb82267c4","Type":"ContainerStarted","Data":"fd1456126b1a974520dc8dafc0d8d16ab9fc5a98658ef4fa29a6c6821458e522"}
Sep 11 12:28:08.178722 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.178689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv" event={"ID":"1560719d-bea2-46df-b35f-c34fb82267c4","Type":"ContainerStarted","Data":"51fa4beecadb0111dc9f9ce228205c487b1128c92d9f7b64e8db0cf9206d8372"}
Sep 11 12:28:08.179066 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.178875    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:08.183608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.183587    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv"
Sep 11 12:28:08.195662 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.195627    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-dc8pv" podStartSLOduration=2.909026036 podStartE2EDuration="4.195614317s" totalImagesPullingTime="1.286588281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:08.195230112 +0000 UTC m=+88.908233144" watchObservedRunningTime="2026-09-11 12:28:08.195614317 +0000 UTC m=+88.908617355"
Sep 11 12:28:08.227090 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.227066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:28:08.229416 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.229381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4d3aa49-8bb5-40d1-8ee5-2258463f93b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8mhfj\" (UID: \"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3\") " pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:28:08.446264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.446176    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9m2p7\""
Sep 11 12:28:08.453237 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.453217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8mhfj"
Sep 11 12:28:08.726255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.726178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8mhfj"]
Sep 11 12:28:08.729007 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:08.728978    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d3aa49_8bb5_40d1_8ee5_2258463f93b3.slice/crio-4eb1ebe65265613e38799cdba719820600fbfeb97f3504241d989c70db9d3fa9 WatchSource:0}: Error finding container 4eb1ebe65265613e38799cdba719820600fbfeb97f3504241d989c70db9d3fa9: Status 404 returned error can't find the container with id 4eb1ebe65265613e38799cdba719820600fbfeb97f3504241d989c70db9d3fa9
Sep 11 12:28:08.761904 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.761878    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"]
Sep 11 12:28:08.763951 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.763931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.767267 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.767246    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 12:28:08.767581 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.767565    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 12:28:08.768736 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.768716    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 12:28:08.768807 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.768716    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f5lfz\""
Sep 11 12:28:08.781882 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.781862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"]
Sep 11 12:28:08.831041 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.831011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54911bce-ca7e-41e3-8154-9823cbe64640-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.831041 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.831046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.831222 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.831071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqwlw\" (UniqueName: \"kubernetes.io/projected/54911bce-ca7e-41e3-8154-9823cbe64640-kube-api-access-vqwlw\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.831222 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.831140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.931898 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.931860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.932133 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:08.932040    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 12:28:08.932133 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.932043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54911bce-ca7e-41e3-8154-9823cbe64640-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.932133 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:08.932114    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-tls podName:54911bce-ca7e-41e3-8154-9823cbe64640 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:09.43209381 +0000 UTC m=+90.145096845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-sh4tq" (UID: "54911bce-ca7e-41e3-8154-9823cbe64640") : secret "prometheus-operator-tls" not found
Sep 11 12:28:08.932238 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.932157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.932238 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.932194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqwlw\" (UniqueName: \"kubernetes.io/projected/54911bce-ca7e-41e3-8154-9823cbe64640-kube-api-access-vqwlw\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.932807 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.932790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54911bce-ca7e-41e3-8154-9823cbe64640-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.934631 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.934614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:08.941756 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:08.941737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqwlw\" (UniqueName: \"kubernetes.io/projected/54911bce-ca7e-41e3-8154-9823cbe64640-kube-api-access-vqwlw\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:09.183426 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:09.183393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mhfj" event={"ID":"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3","Type":"ContainerStarted","Data":"9554f18bff05a108b767083af96ec681f4e1ed811d53f560a1e74d68fced0163"}
Sep 11 12:28:09.183801 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:09.183450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mhfj" event={"ID":"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3","Type":"ContainerStarted","Data":"4eb1ebe65265613e38799cdba719820600fbfeb97f3504241d989c70db9d3fa9"}
Sep 11 12:28:09.436070 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:09.435985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:09.438478 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:09.438453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/54911bce-ca7e-41e3-8154-9823cbe64640-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-sh4tq\" (UID: \"54911bce-ca7e-41e3-8154-9823cbe64640\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:09.673869 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:09.673834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"
Sep 11 12:28:09.947314 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:09.947281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq"]
Sep 11 12:28:09.950725 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:09.950700    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54911bce_ca7e_41e3_8154_9823cbe64640.slice/crio-5f0937e1edddc4e59df2f5fd2a29d1071358131bc6d0f6760a3180916b9d24cf WatchSource:0}: Error finding container 5f0937e1edddc4e59df2f5fd2a29d1071358131bc6d0f6760a3180916b9d24cf: Status 404 returned error can't find the container with id 5f0937e1edddc4e59df2f5fd2a29d1071358131bc6d0f6760a3180916b9d24cf
Sep 11 12:28:10.187965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:10.187906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq" event={"ID":"54911bce-ca7e-41e3-8154-9823cbe64640","Type":"ContainerStarted","Data":"5f0937e1edddc4e59df2f5fd2a29d1071358131bc6d0f6760a3180916b9d24cf"}
Sep 11 12:28:10.189639 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:10.189611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mhfj" event={"ID":"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3","Type":"ContainerStarted","Data":"7ac62ed173fd5405dc16d3f0df9c3bc5b38d36d9b365367f55a2de9a5e118e61"}
Sep 11 12:28:12.200707 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:12.200658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq" event={"ID":"54911bce-ca7e-41e3-8154-9823cbe64640","Type":"ContainerStarted","Data":"9e5c1a85b7adc49ab57efe055b4e3395bc9d3aa4ccae42adeb9bb155923f1688"}
Sep 11 12:28:12.201114 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:12.200736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq" event={"ID":"54911bce-ca7e-41e3-8154-9823cbe64640","Type":"ContainerStarted","Data":"1a643d3770f9ffc768bcb1f241148ef578ed44d1a6bd599db566028b22183294"}
Sep 11 12:28:12.223957 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:12.223909    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-sh4tq" podStartSLOduration=2.925982842 podStartE2EDuration="4.223892208s" totalImagesPullingTime="1.297909366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:12.222335888 +0000 UTC m=+92.935338925" watchObservedRunningTime="2026-09-11 12:28:12.223892208 +0000 UTC m=+92.936895245"
Sep 11 12:28:13.206131 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:13.206086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8mhfj" event={"ID":"e4d3aa49-8bb5-40d1-8ee5-2258463f93b3","Type":"ContainerStarted","Data":"2bc60a1b84f55202099185fdf545a4a0c38ecf4b0d61bcae40049c47825713a5"}
Sep 11 12:28:13.242005 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:13.241957    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8mhfj" podStartSLOduration=33.737326739 podStartE2EDuration="37.24194202s" totalImagesPullingTime="3.504615281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:27:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:13.24038495 +0000 UTC m=+93.953387979" watchObservedRunningTime="2026-09-11 12:28:13.24194202 +0000 UTC m=+93.954945068"
Sep 11 12:28:14.129583 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.129551    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"]
Sep 11 12:28:14.132814 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.132797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.135914 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.135890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r6bxj\""
Sep 11 12:28:14.135914 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.135902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 12:28:14.136086 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.135911    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 12:28:14.145024 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.145001    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"]
Sep 11 12:28:14.152408 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.152386    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"]
Sep 11 12:28:14.155397 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.155380    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.158096 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.158080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 12:28:14.159381 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.159355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 12:28:14.159536 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.159516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ldcbw\""
Sep 11 12:28:14.159718 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.159700    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 12:28:14.169377 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.169341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"]
Sep 11 12:28:14.192910 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.192889    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zlp4v"]
Sep 11 12:28:14.195837 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.195820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.199944 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.199927    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:28:14.200395 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.200377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:28:14.200813 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.200799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pz2h4\""
Sep 11 12:28:14.200874 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.200833    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:28:14.276798 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.276763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-tls\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.276814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.276841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zdl\" (UniqueName: \"kubernetes.io/projected/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-kube-api-access-w4zdl\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.276872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6sm\" (UniqueName: \"kubernetes.io/projected/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-api-access-xf6sm\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.276931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bc939b-f33e-4938-9920-5d2d52d9628b-metrics-client-ca\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.276960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-root\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt9w7\" (UniqueName: \"kubernetes.io/projected/c6bc939b-f33e-4938-9920-5d2d52d9628b-kube-api-access-vt9w7\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-wtmp\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-sys\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.277220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-textfile\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.277617 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.277419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.378218 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zdl\" (UniqueName: \"kubernetes.io/projected/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-kube-api-access-w4zdl\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.378370 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6sm\" (UniqueName: \"kubernetes.io/projected/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-api-access-xf6sm\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.378370 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bc939b-f33e-4938-9920-5d2d52d9628b-metrics-client-ca\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378370 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-root\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378370 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt9w7\" (UniqueName: \"kubernetes.io/projected/c6bc939b-f33e-4938-9920-5d2d52d9628b-kube-api-access-vt9w7\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378370 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-wtmp\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378638 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-root\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378638 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-wtmp\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378638 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.378638 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-sys\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378638 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.378872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6bc939b-f33e-4938-9920-5d2d52d9628b-sys\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.378872 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:14.378755    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 11 12:28:14.378872 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:14.378820    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-tls podName:ee2711f9-8aeb-4a92-8757-54b9c1c84d15 nodeName:}" failed. No retries permitted until 2026-09-11 12:28:14.8788022 +0000 UTC m=+95.591805230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-dz4nk" (UID: "ee2711f9-8aeb-4a92-8757-54b9c1c84d15") : secret "openshift-state-metrics-tls" not found
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bc939b-f33e-4938-9920-5d2d52d9628b-metrics-client-ca\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-textfile\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.378976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.379122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-tls\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.379500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-textfile\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.379500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.379828 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.379971 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.379946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.381274 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.381244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.381607 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.381589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6bc939b-f33e-4938-9920-5d2d52d9628b-node-exporter-tls\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.381787 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.381768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.382246 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.382222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.382477 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.382456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.393665 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.393642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt9w7\" (UniqueName: \"kubernetes.io/projected/c6bc939b-f33e-4938-9920-5d2d52d9628b-kube-api-access-vt9w7\") pod \"node-exporter-zlp4v\" (UID: \"c6bc939b-f33e-4938-9920-5d2d52d9628b\") " pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.394910 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.394889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6sm\" (UniqueName: \"kubernetes.io/projected/92a3d652-d4ae-4012-ab07-1cd026b9bbd1-kube-api-access-xf6sm\") pod \"kube-state-metrics-59fbdd77d-2bq5j\" (UID: \"92a3d652-d4ae-4012-ab07-1cd026b9bbd1\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.396327 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.396306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zdl\" (UniqueName: \"kubernetes.io/projected/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-kube-api-access-w4zdl\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.463709 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.463674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"
Sep 11 12:28:14.505160 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.505126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlp4v"
Sep 11 12:28:14.518737 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:14.518707    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bc939b_f33e_4938_9920_5d2d52d9628b.slice/crio-194d600316b7bfd2c7b05bb7e3c25fccacde951fdf5aa6b313d91582ec054fee WatchSource:0}: Error finding container 194d600316b7bfd2c7b05bb7e3c25fccacde951fdf5aa6b313d91582ec054fee: Status 404 returned error can't find the container with id 194d600316b7bfd2c7b05bb7e3c25fccacde951fdf5aa6b313d91582ec054fee
Sep 11 12:28:14.748726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.748694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j"]
Sep 11 12:28:14.751632 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:14.751606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a3d652_d4ae_4012_ab07_1cd026b9bbd1.slice/crio-42d2172a26bc3535cc9fc88c6db2bfe2b037a42edc43f3d74765dae698f5b045 WatchSource:0}: Error finding container 42d2172a26bc3535cc9fc88c6db2bfe2b037a42edc43f3d74765dae698f5b045: Status 404 returned error can't find the container with id 42d2172a26bc3535cc9fc88c6db2bfe2b037a42edc43f3d74765dae698f5b045
Sep 11 12:28:14.799993 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.799970    2563 scope.go:117] "RemoveContainer" containerID="bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14"
Sep 11 12:28:14.800140 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:14.800120    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-nclsq_openshift-console-operator(c62718e5-19aa-45cf-bf82-50570d247c63)\"" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" podUID="c62718e5-19aa-45cf-bf82-50570d247c63"
Sep 11 12:28:14.884552 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.884515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:14.886829 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:14.886806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee2711f9-8aeb-4a92-8757-54b9c1c84d15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dz4nk\" (UID: \"ee2711f9-8aeb-4a92-8757-54b9c1c84d15\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:15.041600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.041514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"
Sep 11 12:28:15.215703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.215598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j" event={"ID":"92a3d652-d4ae-4012-ab07-1cd026b9bbd1","Type":"ContainerStarted","Data":"42d2172a26bc3535cc9fc88c6db2bfe2b037a42edc43f3d74765dae698f5b045"}
Sep 11 12:28:15.217073 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.217039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlp4v" event={"ID":"c6bc939b-f33e-4938-9920-5d2d52d9628b","Type":"ContainerStarted","Data":"194d600316b7bfd2c7b05bb7e3c25fccacde951fdf5aa6b313d91582ec054fee"}
Sep 11 12:28:15.328740 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.328654    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:28:15.335218 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.335186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk"]
Sep 11 12:28:15.335380 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.335342    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.339506 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339456    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 12:28:15.339768 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 12:28:15.339768 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339657    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 12:28:15.339934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 12:28:15.339934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 12:28:15.339934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 12:28:15.339934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gshrk\""
Sep 11 12:28:15.340177 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.339907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 12:28:15.340177 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.340136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 12:28:15.340512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.340411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 12:28:15.353286 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.353200    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:28:15.489899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.489874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.489997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.489908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.489997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.489939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.489997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.489983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-out\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-web-config\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndrpf\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-kube-api-access-ndrpf\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-volume\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.490469 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.490329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.591781 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-volume\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.591781 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592003 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.591993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592419 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.592048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-out\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592419 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.592082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592419 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.592114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-web-config\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.592419 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.592161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndrpf\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-kube-api-access-ndrpf\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.594634 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.593502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.594634 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.594075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.594634 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.594572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.595454 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.595427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.595675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.595641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.596550 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.596529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.596826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.596804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-out\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.597535 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.597495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-volume\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.597921 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.597881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-web-config\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.598529 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.598479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.598641 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.598577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.599167 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.599143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.601959 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.601923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndrpf\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-kube-api-access-ndrpf\") pod \"alertmanager-main-0\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.647605 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.647576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:28:15.944124 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:15.943871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:28:15.950990 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:15.950964    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de28b7b_b18a_44de_8ae7_e15134ce6139.slice/crio-a333722a24e9bc6b4f2376cdcaa7e8a25eb0fe0d429ebce541dbec96e08ec572 WatchSource:0}: Error finding container a333722a24e9bc6b4f2376cdcaa7e8a25eb0fe0d429ebce541dbec96e08ec572: Status 404 returned error can't find the container with id a333722a24e9bc6b4f2376cdcaa7e8a25eb0fe0d429ebce541dbec96e08ec572
Sep 11 12:28:16.222330 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:16.222238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk" event={"ID":"ee2711f9-8aeb-4a92-8757-54b9c1c84d15","Type":"ContainerStarted","Data":"3f6432aceeb519091e93f591a8e6450f10b91d9ad566b486bfce827552e7de67"}
Sep 11 12:28:16.222330 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:16.222316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk" event={"ID":"ee2711f9-8aeb-4a92-8757-54b9c1c84d15","Type":"ContainerStarted","Data":"a626153c5d485ddc82263858ff295ed256c927c06f17c65d56aee1435c56dcbe"}
Sep 11 12:28:16.222530 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:16.222349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk" event={"ID":"ee2711f9-8aeb-4a92-8757-54b9c1c84d15","Type":"ContainerStarted","Data":"49d213f3edb9d64e7181f17c9b3cc45a35742736b444ff8f50cd6c8c8217c8d1"}
Sep 11 12:28:16.223800 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:16.223771    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6bc939b-f33e-4938-9920-5d2d52d9628b" containerID="5b9eefab41ea6d078beb02b8df700d8cf8baea4fc1a6bb6b44c53fdd13554f6e" exitCode=0
Sep 11 12:28:16.223914 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:16.223854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlp4v" event={"ID":"c6bc939b-f33e-4938-9920-5d2d52d9628b","Type":"ContainerDied","Data":"5b9eefab41ea6d078beb02b8df700d8cf8baea4fc1a6bb6b44c53fdd13554f6e"}
Sep 11 12:28:16.225156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:16.225133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"a333722a24e9bc6b4f2376cdcaa7e8a25eb0fe0d429ebce541dbec96e08ec572"}
Sep 11 12:28:17.103157 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.103127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hwx88"
Sep 11 12:28:17.108856 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.108416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:17.108856 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.108473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:28:17.111942 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.111897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"image-registry-695879bc56-9kjzf\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") " pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:17.112091 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.112076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308-metrics-tls\") pod \"dns-default-2h7pz\" (UID: \"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308\") " pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:28:17.236134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.235339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j" event={"ID":"92a3d652-d4ae-4012-ab07-1cd026b9bbd1","Type":"ContainerStarted","Data":"f100e977d450a38b78960bf6381ba8ff780dff7d992031f6bcee8a064c88d5af"}
Sep 11 12:28:17.236134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.235439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j" event={"ID":"92a3d652-d4ae-4012-ab07-1cd026b9bbd1","Type":"ContainerStarted","Data":"85b81e22fd7658d1540fd61a5cea68c22a86957d3f1bbc9082b926dc3c9565d2"}
Sep 11 12:28:17.236134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.235469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j" event={"ID":"92a3d652-d4ae-4012-ab07-1cd026b9bbd1","Type":"ContainerStarted","Data":"5c7098b83a92f77a3749f8464ada24f4d80948f506a509bffe6cdd61c401e66b"}
Sep 11 12:28:17.238928 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.238897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk" event={"ID":"ee2711f9-8aeb-4a92-8757-54b9c1c84d15","Type":"ContainerStarted","Data":"7684d8c47a1c8c731cdc64527af503ba8f82133009b6db938f147efdf118fdfb"}
Sep 11 12:28:17.242560 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.242523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlp4v" event={"ID":"c6bc939b-f33e-4938-9920-5d2d52d9628b","Type":"ContainerStarted","Data":"e82a4e29d995d28ce9d1be5a45a073704594053a1dfe62c6908723103f2064ae"}
Sep 11 12:28:17.242737 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.242583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlp4v" event={"ID":"c6bc939b-f33e-4938-9920-5d2d52d9628b","Type":"ContainerStarted","Data":"5852c17f5cbce922df89d95640f76feb99315bc9fb5d5410e0d503d3c0f58c06"}
Sep 11 12:28:17.301941 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.301892    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-2bq5j" podStartSLOduration=1.164982341 podStartE2EDuration="3.301875331s" totalImagesPullingTime="2.13689299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:17.268540172 +0000 UTC m=+97.981543201" watchObservedRunningTime="2026-09-11 12:28:17.301875331 +0000 UTC m=+98.014878368"
Sep 11 12:28:17.332951 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.332892    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dz4nk" podStartSLOduration=1.987928811 podStartE2EDuration="3.332875101s" totalImagesPullingTime="1.34494629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:17.301473849 +0000 UTC m=+98.014476888" watchObservedRunningTime="2026-09-11 12:28:17.332875101 +0000 UTC m=+98.045878139"
Sep 11 12:28:17.333273 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.333248    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zlp4v" podStartSLOduration=2.321317191 podStartE2EDuration="3.333240743s" totalImagesPullingTime="932.921464ms" totalInitContainerRuntime="79.002088ms" isStatefulPod=true podCreationTimestamp="2026-09-11 12:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:17.33238709 +0000 UTC m=+98.045390130" watchObservedRunningTime="2026-09-11 12:28:17.333240743 +0000 UTC m=+98.046243822"
Sep 11 12:28:17.379876 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.379843    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zqm8\""
Sep 11 12:28:17.387524 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.387500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:17.413407 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.413384    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-48qpm\""
Sep 11 12:28:17.421121 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.421096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:28:17.864722 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.864699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2h7pz"]
Sep 11 12:28:17.866283 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:17.866257    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8213c4_c1e3_4b5a_b4ef_3b8c87ede308.slice/crio-ce3e0effe32a5949a6cec99b36eaaf6d7b73ada7f8623a214f28ceb37ac19451 WatchSource:0}: Error finding container ce3e0effe32a5949a6cec99b36eaaf6d7b73ada7f8623a214f28ceb37ac19451: Status 404 returned error can't find the container with id ce3e0effe32a5949a6cec99b36eaaf6d7b73ada7f8623a214f28ceb37ac19451
Sep 11 12:28:17.874181 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:17.874149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-695879bc56-9kjzf"]
Sep 11 12:28:17.877886 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:17.877856    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc7aa5a_9199_4f15_a14c_c0389d079388.slice/crio-60bf1fe5f91f0594088958a48f335e7e57b40611d0f595169a4104b1b8fe376f WatchSource:0}: Error finding container 60bf1fe5f91f0594088958a48f335e7e57b40611d0f595169a4104b1b8fe376f: Status 404 returned error can't find the container with id 60bf1fe5f91f0594088958a48f335e7e57b40611d0f595169a4104b1b8fe376f
Sep 11 12:28:18.247669 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.247635    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c" exitCode=0
Sep 11 12:28:18.247669 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.247666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c"}
Sep 11 12:28:18.249050 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.249029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2h7pz" event={"ID":"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308","Type":"ContainerStarted","Data":"ce3e0effe32a5949a6cec99b36eaaf6d7b73ada7f8623a214f28ceb37ac19451"}
Sep 11 12:28:18.256703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.252053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-695879bc56-9kjzf" event={"ID":"5cc7aa5a-9199-4f15-a14c-c0389d079388","Type":"ContainerStarted","Data":"8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4"}
Sep 11 12:28:18.256703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.252142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-695879bc56-9kjzf" event={"ID":"5cc7aa5a-9199-4f15-a14c-c0389d079388","Type":"ContainerStarted","Data":"60bf1fe5f91f0594088958a48f335e7e57b40611d0f595169a4104b1b8fe376f"}
Sep 11 12:28:18.256703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.252638    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:18.310603 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:18.310549    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-695879bc56-9kjzf" podStartSLOduration=98.310531792 podStartE2EDuration="1m38.310531792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:18.30914467 +0000 UTC m=+99.022147709" watchObservedRunningTime="2026-09-11 12:28:18.310531792 +0000 UTC m=+99.023534829"
Sep 11 12:28:20.265414 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.265380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172"}
Sep 11 12:28:20.265749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.265492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07"}
Sep 11 12:28:20.265749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.265535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f"}
Sep 11 12:28:20.265749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.265573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d"}
Sep 11 12:28:20.267512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.267486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2h7pz" event={"ID":"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308","Type":"ContainerStarted","Data":"d6a10305f8940c1987fd17087b464fd2b27f0a6a37b6c613bd2b36d8d37d94b1"}
Sep 11 12:28:20.267612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.267539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2h7pz" event={"ID":"0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308","Type":"ContainerStarted","Data":"03f92d78a85772aad44ae38ecfd92c3735f983f2d1906b7e64b446e6fd230a3c"}
Sep 11 12:28:20.267696 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.267668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:28:20.291688 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.291626    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2h7pz" podStartSLOduration=65.238908655 podStartE2EDuration="1m7.29160544s" totalImagesPullingTime="2.052696785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:20.29042569 +0000 UTC m=+101.003428730" watchObservedRunningTime="2026-09-11 12:28:20.29160544 +0000 UTC m=+101.004608479"
Sep 11 12:28:20.577668 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.577572    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:28:20.582855 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.582832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.586649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586608    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 12:28:20.586761 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586740    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 12:28:20.586761 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 12:28:20.586885 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586822    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 12:28:20.586885 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 12:28:20.586980 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586951    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m4rtl\""
Sep 11 12:28:20.587028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.586987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 12:28:20.587028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587018    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 12:28:20.587134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587054    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 12:28:20.587134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587126    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-54c0lqagkulun\""
Sep 11 12:28:20.587679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 12:28:20.587782 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587716    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 12:28:20.587782 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587739    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 12:28:20.587782 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.587760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 12:28:20.588094 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.588074    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 12:28:20.588183 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.588122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 12:28:20.589204 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.589184    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 12:28:20.607351 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.607323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:28:20.742963 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.742929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.742984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-web-config\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzt6x\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-kube-api-access-fzt6x\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743806 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743806 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-config\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.743899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.743881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-config-out\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-config\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-config-out\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-web-config\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzt6x\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-kube-api-access-fzt6x\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.847479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.848498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.848498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.848498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.845853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.848498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.846038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.848498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.847085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.848498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.848161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.849627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.849308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.849988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.849962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.850099 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.850018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.850636 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.850607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.850757 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.850715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.851122 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.851076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852324 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-config-out\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852442 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-web-config\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852689 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852864 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-config\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.852926 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.852892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.853332 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.853306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.853332 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.853320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.853897 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.853880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.855930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.855887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzt6x\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-kube-api-access-fzt6x\") pod \"prometheus-k8s-0\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:20.895671 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:20.895631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:21.274703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:21.274672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf"}
Sep 11 12:28:21.275138 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:21.274737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerStarted","Data":"e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173"}
Sep 11 12:28:21.286299 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:21.286269    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:28:21.287613 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:21.287587    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52bee5b_e920_4511_946f_d065e20c332e.slice/crio-4e6972d200255e27826686e98332db793a0438de70cead62735a3840f431004e WatchSource:0}: Error finding container 4e6972d200255e27826686e98332db793a0438de70cead62735a3840f431004e: Status 404 returned error can't find the container with id 4e6972d200255e27826686e98332db793a0438de70cead62735a3840f431004e
Sep 11 12:28:21.313198 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:21.313156    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.161533313 podStartE2EDuration="6.313141836s" totalImagesPullingTime="4.13587048s" totalInitContainerRuntime="15.738043ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:21.311204462 +0000 UTC m=+102.024207501" watchObservedRunningTime="2026-09-11 12:28:21.313141836 +0000 UTC m=+102.026144874"
Sep 11 12:28:22.281100 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:22.281067    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677" exitCode=0
Sep 11 12:28:22.281494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:22.281154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"}
Sep 11 12:28:22.281494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:22.281220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"4e6972d200255e27826686e98332db793a0438de70cead62735a3840f431004e"}
Sep 11 12:28:25.298262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:25.298234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"}
Sep 11 12:28:26.305245 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:26.305205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"}
Sep 11 12:28:27.039796 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:27.039756    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-695879bc56-9kjzf"]
Sep 11 12:28:28.327201 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:28.327161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"}
Sep 11 12:28:28.327712 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:28.327270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"}
Sep 11 12:28:28.327712 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:28.327321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"}
Sep 11 12:28:28.327712 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:28.327384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerStarted","Data":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"}
Sep 11 12:28:28.379369 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:28.379299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.546059236 podStartE2EDuration="8.379272566s" totalImagesPullingTime="4.814571942s" totalInitContainerRuntime="18.641388ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:28:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:28.378535708 +0000 UTC m=+109.091538749" watchObservedRunningTime="2026-09-11 12:28:28.379272566 +0000 UTC m=+109.092275604"
Sep 11 12:28:28.800083 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:28.800051    2563 scope.go:117] "RemoveContainer" containerID="bcf0a41fc3b18cc104ecec88c77cf1e1b7bd0101753f70bf55d972a86cb65d14"
Sep 11 12:28:29.333137 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:29.333108    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:28:29.333609 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:29.333222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-nclsq" event={"ID":"c62718e5-19aa-45cf-bf82-50570d247c63","Type":"ContainerStarted","Data":"12cd01413364fa524910dde27eae4ec940848aaecf200432ffa791e942cd88fe"}
Sep 11 12:28:30.276927 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:30.276899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2h7pz"
Sep 11 12:28:30.896500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:30.896461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:28:37.045766 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:37.045738    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:39.333840 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:39.333815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:28:39.337541 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:39.337521    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-nclsq"
Sep 11 12:28:39.373714 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:39.373679    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d" containerID="15638a4af5286bc24d0facd34a169b913eaee097a6d9f19e1e40842b9680c72a" exitCode=0
Sep 11 12:28:39.373830 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:39.373732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn" event={"ID":"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d","Type":"ContainerDied","Data":"15638a4af5286bc24d0facd34a169b913eaee097a6d9f19e1e40842b9680c72a"}
Sep 11 12:28:39.374151 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:39.374134    2563 scope.go:117] "RemoveContainer" containerID="15638a4af5286bc24d0facd34a169b913eaee097a6d9f19e1e40842b9680c72a"
Sep 11 12:28:40.379893 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:40.379852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bdrcn" event={"ID":"5d750dfb-ad26-4bc4-8c6c-cb63c09ec83d","Type":"ContainerStarted","Data":"cb8864e49a5a55d518cac6b91da758cb5c830cc340e2286f26903efa1211ee87"}
Sep 11 12:28:48.704793 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:48.704752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:28:48.707168 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:48.707142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb568966-f7ba-4cfe-96c3-99ff3ff69cd4-metrics-certs\") pod \"network-metrics-daemon-bc4j9\" (UID: \"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4\") " pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:28:48.914438 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:48.914406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmfdf\""
Sep 11 12:28:48.922016 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:48.921989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bc4j9"
Sep 11 12:28:49.196811 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:49.196787    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bc4j9"]
Sep 11 12:28:49.199050 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:28:49.199021    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb568966_f7ba_4cfe_96c3_99ff3ff69cd4.slice/crio-69d5bd9c3e311792fce7b3488e79e95cfe5b33bd1f6d308820e9457f0baeeb9f WatchSource:0}: Error finding container 69d5bd9c3e311792fce7b3488e79e95cfe5b33bd1f6d308820e9457f0baeeb9f: Status 404 returned error can't find the container with id 69d5bd9c3e311792fce7b3488e79e95cfe5b33bd1f6d308820e9457f0baeeb9f
Sep 11 12:28:49.416512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:49.416478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bc4j9" event={"ID":"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4","Type":"ContainerStarted","Data":"69d5bd9c3e311792fce7b3488e79e95cfe5b33bd1f6d308820e9457f0baeeb9f"}
Sep 11 12:28:52.060939 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.060888    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-695879bc56-9kjzf" podUID="5cc7aa5a-9199-4f15-a14c-c0389d079388" containerName="registry" containerID="cri-o://8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4" gracePeriod=30
Sep 11 12:28:52.310541 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.310499    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:52.430161 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.430124    2563 generic.go:356] "Generic (PLEG): container finished" podID="5cc7aa5a-9199-4f15-a14c-c0389d079388" containerID="8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4" exitCode=0
Sep 11 12:28:52.430319 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.430173    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-695879bc56-9kjzf"
Sep 11 12:28:52.430319 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.430189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-695879bc56-9kjzf" event={"ID":"5cc7aa5a-9199-4f15-a14c-c0389d079388","Type":"ContainerDied","Data":"8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4"}
Sep 11 12:28:52.430319 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.430239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-695879bc56-9kjzf" event={"ID":"5cc7aa5a-9199-4f15-a14c-c0389d079388","Type":"ContainerDied","Data":"60bf1fe5f91f0594088958a48f335e7e57b40611d0f595169a4104b1b8fe376f"}
Sep 11 12:28:52.430319 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.430266    2563 scope.go:117] "RemoveContainer" containerID="8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4"
Sep 11 12:28:52.435578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-certificates\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435600    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-bound-sa-token\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435632    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cc7aa5a-9199-4f15-a14c-c0389d079388-ca-trust-extracted\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-installation-pull-secrets\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-image-registry-private-configuration\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435775    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-trusted-ca\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.435835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-kube-api-access-dd9zm\") pod \"5cc7aa5a-9199-4f15-a14c-c0389d079388\" (UID: \"5cc7aa5a-9199-4f15-a14c-c0389d079388\") "
Sep 11 12:28:52.436024 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.435965    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:28:52.436376 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.436108    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-certificates\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.436841 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.436798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:28:52.438600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.438547    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:28:52.438600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.438562    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:28:52.438600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.438568    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-kube-api-access-dd9zm" (OuterVolumeSpecName: "kube-api-access-dd9zm") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "kube-api-access-dd9zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:28:52.438874 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.438848    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:28:52.439020 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.438996    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:28:52.439605 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.439590    2563 scope.go:117] "RemoveContainer" containerID="8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4"
Sep 11 12:28:52.439875 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:28:52.439853    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4\": container with ID starting with 8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4 not found: ID does not exist" containerID="8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4"
Sep 11 12:28:52.439936 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.439881    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4"} err="failed to get container status \"8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4\": rpc error: code = NotFound desc = could not find container \"8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4\": container with ID starting with 8d9691c8553e4bd31b4cce6a53d29dd3789dd6acb08a571cd0df06de944c5ff4 not found: ID does not exist"
Sep 11 12:28:52.447513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.447485    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc7aa5a-9199-4f15-a14c-c0389d079388-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5cc7aa5a-9199-4f15-a14c-c0389d079388" (UID: "5cc7aa5a-9199-4f15-a14c-c0389d079388"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:28:52.537039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537002    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-image-registry-private-configuration\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.537039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537030    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cc7aa5a-9199-4f15-a14c-c0389d079388-trusted-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.537039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537040    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-kube-api-access-dd9zm\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.537039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537049    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-bound-sa-token\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.537352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537059    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5cc7aa5a-9199-4f15-a14c-c0389d079388-ca-trust-extracted\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.537352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537067    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5cc7aa5a-9199-4f15-a14c-c0389d079388-installation-pull-secrets\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.537352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.537081    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5cc7aa5a-9199-4f15-a14c-c0389d079388-registry-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:28:52.752990 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.752958    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-695879bc56-9kjzf"]
Sep 11 12:28:52.759396 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:52.759370    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-695879bc56-9kjzf"]
Sep 11 12:28:53.805412 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:53.805372    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc7aa5a-9199-4f15-a14c-c0389d079388" path="/var/lib/kubelet/pods/5cc7aa5a-9199-4f15-a14c-c0389d079388/volumes"
Sep 11 12:28:54.440710 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:54.440678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bc4j9" event={"ID":"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4","Type":"ContainerStarted","Data":"c3de21b455c950f4e9883a59ee9b8f6b7f50cc7b57b6385af4e720f9e568ee54"}
Sep 11 12:28:54.440903 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:54.440744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bc4j9" event={"ID":"fb568966-f7ba-4cfe-96c3-99ff3ff69cd4","Type":"ContainerStarted","Data":"a838e0fcc48103f9e6fbf5e689e45d9c5623618e320cdaefc596872302daa433"}
Sep 11 12:28:54.462461 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:54.462413    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bc4j9" podStartSLOduration=129.725672078 podStartE2EDuration="2m14.462398344s" totalImagesPullingTime="4.736726266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:28:54.460262795 +0000 UTC m=+135.173265848" watchObservedRunningTime="2026-09-11 12:28:54.462398344 +0000 UTC m=+135.175401381"
Sep 11 12:28:57.205494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:57.205462    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/init-config-reloader/0.log"
Sep 11 12:28:57.403056 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:57.403026    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/alertmanager/0.log"
Sep 11 12:28:57.599962 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:57.599891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/config-reloader/0.log"
Sep 11 12:28:57.799069 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:57.799036    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/kube-rbac-proxy-web/0.log"
Sep 11 12:28:58.000520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:58.000492    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/kube-rbac-proxy/0.log"
Sep 11 12:28:58.198604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:58.198558    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/kube-rbac-proxy-metric/0.log"
Sep 11 12:28:58.406767 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:58.406742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6de28b7b-b18a-44de-8ae7-e15134ce6139/prom-label-proxy/0.log"
Sep 11 12:28:58.600193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:58.600161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-sgfhz_a3f26454-b9d0-4199-82dd-e59f12fb5130/cluster-monitoring-operator/0.log"
Sep 11 12:28:58.799861 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:58.799783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-2bq5j_92a3d652-d4ae-4012-ab07-1cd026b9bbd1/kube-state-metrics/0.log"
Sep 11 12:28:58.999263 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:58.999238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-2bq5j_92a3d652-d4ae-4012-ab07-1cd026b9bbd1/kube-rbac-proxy-main/0.log"
Sep 11 12:28:59.199307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:28:59.199261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-2bq5j_92a3d652-d4ae-4012-ab07-1cd026b9bbd1/kube-rbac-proxy-self/0.log"
Sep 11 12:29:00.999687 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:00.999659    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlp4v_c6bc939b-f33e-4938-9920-5d2d52d9628b/init-textfile/0.log"
Sep 11 12:29:01.199248 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:01.199218    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlp4v_c6bc939b-f33e-4938-9920-5d2d52d9628b/node-exporter/0.log"
Sep 11 12:29:01.403433 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:01.400452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlp4v_c6bc939b-f33e-4938-9920-5d2d52d9628b/kube-rbac-proxy/0.log"
Sep 11 12:29:01.599031 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:01.599004    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dz4nk_ee2711f9-8aeb-4a92-8757-54b9c1c84d15/kube-rbac-proxy-main/0.log"
Sep 11 12:29:01.799628 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:01.799544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dz4nk_ee2711f9-8aeb-4a92-8757-54b9c1c84d15/kube-rbac-proxy-self/0.log"
Sep 11 12:29:02.000824 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:02.000795    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dz4nk_ee2711f9-8aeb-4a92-8757-54b9c1c84d15/openshift-state-metrics/0.log"
Sep 11 12:29:02.204352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:02.204324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/init-config-reloader/0.log"
Sep 11 12:29:02.399766 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:02.399736    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/prometheus/0.log"
Sep 11 12:29:02.599891 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:02.599803    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/config-reloader/0.log"
Sep 11 12:29:02.799340 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:02.799294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/thanos-sidecar/0.log"
Sep 11 12:29:03.000519 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:03.000487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/kube-rbac-proxy-web/0.log"
Sep 11 12:29:03.199008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:03.198981    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/kube-rbac-proxy/0.log"
Sep 11 12:29:03.399436 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:03.399342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52bee5b-e920-4511-946f-d065e20c332e/kube-rbac-proxy-thanos/0.log"
Sep 11 12:29:03.600540 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:03.600515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-sh4tq_54911bce-ca7e-41e3-8154-9823cbe64640/prometheus-operator/0.log"
Sep 11 12:29:03.801599 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:03.801574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-sh4tq_54911bce-ca7e-41e3-8154-9823cbe64640/kube-rbac-proxy/0.log"
Sep 11 12:29:03.999038 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:03.999011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-dc8pv_1560719d-bea2-46df-b35f-c34fb82267c4/prometheus-operator-admission-webhook/0.log"
Sep 11 12:29:05.601325 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:05.601295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:29:05.801144 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:05.801113    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/3.log"
Sep 11 12:29:06.600605 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:06.600575    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc64c6b56-xmhwh_15635f4b-3982-4cd9-8130-6d5de40458e3/router/0.log"
Sep 11 12:29:06.801172 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:06.801145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cq2v_7deaa126-8256-42ed-9c6f-5976a5ec0aa2/serve-healthcheck-canary/0.log"
Sep 11 12:29:20.896233 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:20.896196    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:20.912008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:20.911978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:21.566656 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:21.566629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:34.618087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618007    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:29:34.618578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618277    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="alertmanager" containerID="cri-o://2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d" gracePeriod=120
Sep 11 12:29:34.618578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618340    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-metric" containerID="cri-o://e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf" gracePeriod=120
Sep 11 12:29:34.618578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618399    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-web" containerID="cri-o://569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07" gracePeriod=120
Sep 11 12:29:34.618578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618460    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy" containerID="cri-o://1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172" gracePeriod=120
Sep 11 12:29:34.618578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618413    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="config-reloader" containerID="cri-o://9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f" gracePeriod=120
Sep 11 12:29:34.618578 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:34.618420    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="prom-label-proxy" containerID="cri-o://e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173" gracePeriod=120
Sep 11 12:29:35.619506 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619462    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173" exitCode=0
Sep 11 12:29:35.619506 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619498    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf" exitCode=0
Sep 11 12:29:35.619506 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619505    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172" exitCode=0
Sep 11 12:29:35.619506 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619511    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f" exitCode=0
Sep 11 12:29:35.619966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619520    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d" exitCode=0
Sep 11 12:29:35.619966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173"}
Sep 11 12:29:35.619966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf"}
Sep 11 12:29:35.619966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172"}
Sep 11 12:29:35.619966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f"}
Sep 11 12:29:35.619966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.619686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d"}
Sep 11 12:29:35.856555 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.856532    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:35.891344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891274    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndrpf\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-kube-api-access-ndrpf\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891327    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-trusted-ca-bundle\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891585 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-metrics-client-ca\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891694 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891592    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-volume\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891694 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891653    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-out\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891694 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891685    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-main-tls\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891847 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.891847 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891809    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.892028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.891995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:35.892097 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:35.892152 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892117    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-cluster-tls-config\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.892208 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892150    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-web\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.892255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-tls-assets\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.892307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892258    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-main-db\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.892307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892293    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-web-config\") pod \"6de28b7b-b18a-44de-8ae7-e15134ce6139\" (UID: \"6de28b7b-b18a-44de-8ae7-e15134ce6139\") "
Sep 11 12:29:35.892835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.892794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:29:35.893134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.893117    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-main-db\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.893249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.893234    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.893339 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.893325    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6de28b7b-b18a-44de-8ae7-e15134ce6139-metrics-client-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.896428 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.896382    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-out" (OuterVolumeSpecName: "config-out") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:29:35.896651 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.896618    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:29:35.897150 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.897118    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.897239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.897216    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.897922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.897885    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.898117 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.898089    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-volume" (OuterVolumeSpecName: "config-volume") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.898286 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.898257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-kube-api-access-ndrpf" (OuterVolumeSpecName: "kube-api-access-ndrpf") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "kube-api-access-ndrpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:29:35.903857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.903818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.905834 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.905801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.913842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.913808    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-web-config" (OuterVolumeSpecName: "web-config") pod "6de28b7b-b18a-44de-8ae7-e15134ce6139" (UID: "6de28b7b-b18a-44de-8ae7-e15134ce6139"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:35.993988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.993960    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndrpf\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-kube-api-access-ndrpf\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.993988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.993984    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.993988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.993994    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6de28b7b-b18a-44de-8ae7-e15134ce6139-config-out\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994005    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-main-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994015    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994025    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994033    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-cluster-tls-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994042    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994050    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6de28b7b-b18a-44de-8ae7-e15134ce6139-tls-assets\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:35.994188 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:35.994057    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6de28b7b-b18a-44de-8ae7-e15134ce6139-web-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:36.627473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.627442    2563 generic.go:356] "Generic (PLEG): container finished" podID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerID="569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07" exitCode=0
Sep 11 12:29:36.627839 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.627481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07"}
Sep 11 12:29:36.627839 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.627522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.627839 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.627552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6de28b7b-b18a-44de-8ae7-e15134ce6139","Type":"ContainerDied","Data":"a333722a24e9bc6b4f2376cdcaa7e8a25eb0fe0d429ebce541dbec96e08ec572"}
Sep 11 12:29:36.627839 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.627589    2563 scope.go:117] "RemoveContainer" containerID="e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173"
Sep 11 12:29:36.635429 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.635412    2563 scope.go:117] "RemoveContainer" containerID="e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf"
Sep 11 12:29:36.642212 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.642191    2563 scope.go:117] "RemoveContainer" containerID="1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172"
Sep 11 12:29:36.648583 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.648565    2563 scope.go:117] "RemoveContainer" containerID="569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07"
Sep 11 12:29:36.656305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.656274    2563 scope.go:117] "RemoveContainer" containerID="9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f"
Sep 11 12:29:36.656305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.656281    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:29:36.660836 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.660813    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:29:36.663789 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.663776    2563 scope.go:117] "RemoveContainer" containerID="2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d"
Sep 11 12:29:36.670624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.670607    2563 scope.go:117] "RemoveContainer" containerID="d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c"
Sep 11 12:29:36.677332 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.677315    2563 scope.go:117] "RemoveContainer" containerID="e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173"
Sep 11 12:29:36.677676 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.677657    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173\": container with ID starting with e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173 not found: ID does not exist" containerID="e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173"
Sep 11 12:29:36.677721 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.677684    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173"} err="failed to get container status \"e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173\": rpc error: code = NotFound desc = could not find container \"e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173\": container with ID starting with e548adbfd44ff5e280da4eaa63f706483782cd20a4bf69d5d682a99ebd289173 not found: ID does not exist"
Sep 11 12:29:36.677721 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.677703    2563 scope.go:117] "RemoveContainer" containerID="e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf"
Sep 11 12:29:36.677931 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.677915    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf\": container with ID starting with e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf not found: ID does not exist" containerID="e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf"
Sep 11 12:29:36.677976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.677936    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf"} err="failed to get container status \"e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf\": rpc error: code = NotFound desc = could not find container \"e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf\": container with ID starting with e4bc86e8a7d993f0a69cf61127c2748c628e320eb98c4ba448296d1fafbe1bbf not found: ID does not exist"
Sep 11 12:29:36.677976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.677951    2563 scope.go:117] "RemoveContainer" containerID="1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172"
Sep 11 12:29:36.678150 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.678135    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172\": container with ID starting with 1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172 not found: ID does not exist" containerID="1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172"
Sep 11 12:29:36.678193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678155    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172"} err="failed to get container status \"1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172\": rpc error: code = NotFound desc = could not find container \"1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172\": container with ID starting with 1540c94266bd3fe3e803537f51fbb6ad141934c5385b96176d48c00ac3cfe172 not found: ID does not exist"
Sep 11 12:29:36.678193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678168    2563 scope.go:117] "RemoveContainer" containerID="569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07"
Sep 11 12:29:36.678425 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.678410    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07\": container with ID starting with 569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07 not found: ID does not exist" containerID="569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07"
Sep 11 12:29:36.678467 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678427    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07"} err="failed to get container status \"569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07\": rpc error: code = NotFound desc = could not find container \"569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07\": container with ID starting with 569b55cccd30d5345366ab8d24f8e4762e9df702f3f1b2e087f85cd95396cf07 not found: ID does not exist"
Sep 11 12:29:36.678467 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678442    2563 scope.go:117] "RemoveContainer" containerID="9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f"
Sep 11 12:29:36.678629 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.678615    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f\": container with ID starting with 9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f not found: ID does not exist" containerID="9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f"
Sep 11 12:29:36.678671 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678632    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f"} err="failed to get container status \"9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f\": rpc error: code = NotFound desc = could not find container \"9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f\": container with ID starting with 9cc0a29473fa05bb89a497f3a18fca32568f39f969a68019a7edad8d457d442f not found: ID does not exist"
Sep 11 12:29:36.678671 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678645    2563 scope.go:117] "RemoveContainer" containerID="2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d"
Sep 11 12:29:36.678850 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.678835    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d\": container with ID starting with 2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d not found: ID does not exist" containerID="2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d"
Sep 11 12:29:36.678895 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678853    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d"} err="failed to get container status \"2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d\": rpc error: code = NotFound desc = could not find container \"2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d\": container with ID starting with 2033d38d59f24f749fc959ca0a755b46abf5b365346f71a33e53ad3fb7a23f1d not found: ID does not exist"
Sep 11 12:29:36.678895 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.678864    2563 scope.go:117] "RemoveContainer" containerID="d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c"
Sep 11 12:29:36.679061 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:36.679046    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c\": container with ID starting with d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c not found: ID does not exist" containerID="d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c"
Sep 11 12:29:36.679103 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.679062    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c"} err="failed to get container status \"d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c\": rpc error: code = NotFound desc = could not find container \"d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c\": container with ID starting with d6724723771a6a12d94ddce0a5a2b926c35b1e1985bb6e9d1481f4bc3e35973c not found: ID does not exist"
Sep 11 12:29:36.694481 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694460    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:29:36.694743 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694731    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-metric"
Sep 11 12:29:36.694785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694744    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-metric"
Sep 11 12:29:36.694785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694761    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="config-reloader"
Sep 11 12:29:36.694785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694766    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="config-reloader"
Sep 11 12:29:36.694785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694773    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="prom-label-proxy"
Sep 11 12:29:36.694785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694778    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="prom-label-proxy"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694786    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="alertmanager"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694792    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="alertmanager"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694806    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="init-config-reloader"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694812    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="init-config-reloader"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694819    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-web"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694824    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-web"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694830    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694835    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694843    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc7aa5a-9199-4f15-a14c-c0389d079388" containerName="registry"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694849    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc7aa5a-9199-4f15-a14c-c0389d079388" containerName="registry"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694895    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc7aa5a-9199-4f15-a14c-c0389d079388" containerName="registry"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694910    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="alertmanager"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694915    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="config-reloader"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694920    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-web"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694925    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="kube-rbac-proxy-metric"
Sep 11 12:29:36.694930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.694931    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" containerName="prom-label-proxy"
Sep 11 12:29:36.699965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.699947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.707131 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 12:29:36.707131 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 12:29:36.707307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 12:29:36.707488 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 12:29:36.707641 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707620    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 12:29:36.707733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 12:29:36.707733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.707715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 12:29:36.708061 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.708039    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gshrk\""
Sep 11 12:29:36.708061 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.708051    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 12:29:36.712989 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.712971    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 12:29:36.716643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.716623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:29:36.800610 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800610 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.800803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-web-config\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.801077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.801077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.801077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.800984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.801077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.801018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-config-out\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.801077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.801044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdsm\" (UniqueName: \"kubernetes.io/projected/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-kube-api-access-tkdsm\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901460 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-config-out\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdsm\" (UniqueName: \"kubernetes.io/projected/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-kube-api-access-tkdsm\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901873 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.901991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.901956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.902089 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.902023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.902089 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.902055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-web-config\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.902179 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.902129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.902179 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.902170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.902279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.902215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.902786 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.902758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.904306 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.903966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.904598 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.904575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.905713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.904768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.905713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.904776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-config-out\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.905713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.904834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.905713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.905210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.905713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.905323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.905713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.905415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.906120 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.906084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.907102 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.907078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-web-config\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:36.910832 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:36.910805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdsm\" (UniqueName: \"kubernetes.io/projected/0cff8dcb-35e3-44cf-92e4-8ec947a58daa-kube-api-access-tkdsm\") pod \"alertmanager-main-0\" (UID: \"0cff8dcb-35e3-44cf-92e4-8ec947a58daa\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:37.009595 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:37.009562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 12:29:37.293718 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:37.293683    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 12:29:37.297122 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:29:37.297080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cff8dcb_35e3_44cf_92e4_8ec947a58daa.slice/crio-0791fde23286ef42d82bfc10dccd7ef36e35cd89db69e7397e5d68ed602d067d WatchSource:0}: Error finding container 0791fde23286ef42d82bfc10dccd7ef36e35cd89db69e7397e5d68ed602d067d: Status 404 returned error can't find the container with id 0791fde23286ef42d82bfc10dccd7ef36e35cd89db69e7397e5d68ed602d067d
Sep 11 12:29:37.632674 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:37.632592    2563 generic.go:356] "Generic (PLEG): container finished" podID="0cff8dcb-35e3-44cf-92e4-8ec947a58daa" containerID="353a13d78ab22188bfd80db06586104a9ea5c75e6c4771a33fbd8af25d481ee9" exitCode=0
Sep 11 12:29:37.633077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:37.632687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerDied","Data":"353a13d78ab22188bfd80db06586104a9ea5c75e6c4771a33fbd8af25d481ee9"}
Sep 11 12:29:37.633077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:37.632767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"0791fde23286ef42d82bfc10dccd7ef36e35cd89db69e7397e5d68ed602d067d"}
Sep 11 12:29:37.805242 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:37.805212    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de28b7b-b18a-44de-8ae7-e15134ce6139" path="/var/lib/kubelet/pods/6de28b7b-b18a-44de-8ae7-e15134ce6139/volumes"
Sep 11 12:29:38.644827 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.644793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"41899c253c98bd9e5fb13f284711cbe7a0cb27aa89aba2d24c37641d20bc276b"}
Sep 11 12:29:38.645239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.644865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"a9a80741d717fc7e3ccba18e42d3e94e51ee1126518afeec14e513cbd7fbfbe0"}
Sep 11 12:29:38.645239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.644892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"693fb3f1108db88b4b298d72c5a4febae85cec09671f94f7fbe964dd9687658c"}
Sep 11 12:29:38.645239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.644915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"83176b869140a84c2977b6f3d5a9d926b9774b89af58ba663b18f80c3f4a2231"}
Sep 11 12:29:38.645239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.644940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"22f65e1aa97cda5f33f0c65d16c235322e7f9a49a3c4362454d06c04565037fd"}
Sep 11 12:29:38.645239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.644965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0cff8dcb-35e3-44cf-92e4-8ec947a58daa","Type":"ContainerStarted","Data":"c4a7eba079ac41b9053779d8f3e377c54770b85c0b3952e7b0453cd00d0c8ad3"}
Sep 11 12:29:38.699619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:38.699550    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.68493162 podStartE2EDuration="2.699525056s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.593436ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:29:38.69795675 +0000 UTC m=+179.410959799" watchObservedRunningTime="2026-09-11 12:29:38.699525056 +0000 UTC m=+179.412528096"
Sep 11 12:29:39.013421 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013236    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:29:39.013631 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013598    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="prometheus" containerID="cri-o://0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb" gracePeriod=600
Sep 11 12:29:39.013699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013622    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy" containerID="cri-o://9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b" gracePeriod=600
Sep 11 12:29:39.013699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013659    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="thanos-sidecar" containerID="cri-o://f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953" gracePeriod=600
Sep 11 12:29:39.013699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013681    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="config-reloader" containerID="cri-o://6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9" gracePeriod=600
Sep 11 12:29:39.013859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013654    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800" gracePeriod=600
Sep 11 12:29:39.013859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.013762    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-web" containerID="cri-o://8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9" gracePeriod=600
Sep 11 12:29:39.268149 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.267808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.325225 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzt6x\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-kube-api-access-fzt6x\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325381 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325238    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-tls\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325381 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325268    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-web-config\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325381 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-0\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325381 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325323    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-db\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325381 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-thanos-prometheus-http-client-file\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325430    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-config\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325465    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-kube-rbac-proxy\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325503    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-trusted-ca-bundle\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-metrics-client-ca\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325608 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-config-out\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325929 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325630    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-kubelet-serving-ca-bundle\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325929 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325678    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-1\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325929 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-grpc-tls\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325929 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-serving-certs-ca-bundle\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.325929 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.325788    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-metrics-client-certs\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.326166 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.326094    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.326166 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.326155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-tls-assets\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.326265 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.326219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-2\") pod \"d52bee5b-e920-4511-946f-d065e20c332e\" (UID: \"d52bee5b-e920-4511-946f-d065e20c332e\") "
Sep 11 12:29:39.326525 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.326496    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.327103 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.327074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.329513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.329331    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-config" (OuterVolumeSpecName: "config") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.329905 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.329758    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.329905 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.329818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.329905 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.329892    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.330106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330080    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.330214 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330117    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.330214 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330144    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.330328 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330163    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-metrics-client-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.330328 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330310    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.330464 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330329    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.330938 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.330549    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:29:39.331426 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.331389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:29:39.331831 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.331806    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.332980 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.332954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-config-out" (OuterVolumeSpecName: "config-out") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:29:39.333076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.333034    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-kube-api-access-fzt6x" (OuterVolumeSpecName: "kube-api-access-fzt6x") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "kube-api-access-fzt6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:29:39.333187 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.333160    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.333187 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.333171    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.333345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.333190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.333345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.333254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:29:39.333345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.333329    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.334753 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.334727    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.344307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.344283    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-web-config" (OuterVolumeSpecName: "web-config") pod "d52bee5b-e920-4511-946f-d065e20c332e" (UID: "d52bee5b-e920-4511-946f-d065e20c332e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:29:39.431068 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431032    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-grpc-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431068 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431069    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431087    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-metrics-client-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431103    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-tls-assets\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431116    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431131    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzt6x\" (UniqueName: \"kubernetes.io/projected/d52bee5b-e920-4511-946f-d065e20c332e-kube-api-access-fzt6x\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431147    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431159    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-web-config\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431170    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431182    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-prometheus-k8s-db\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431205    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431220    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431235    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431251    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52bee5b-e920-4511-946f-d065e20c332e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.431624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.431266    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52bee5b-e920-4511-946f-d065e20c332e-config-out\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:29:39.660193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660151    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800" exitCode=0
Sep 11 12:29:39.660193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660188    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b" exitCode=0
Sep 11 12:29:39.660193 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660197    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9" exitCode=0
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660209    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953" exitCode=0
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660218    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9" exitCode=0
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660227    2563 generic.go:356] "Generic (PLEG): container finished" podID="d52bee5b-e920-4511-946f-d065e20c332e" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb" exitCode=0
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660231    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"}
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"}
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"}
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660484    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"}
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"}
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"}
Sep 11 12:29:39.660675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.660564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52bee5b-e920-4511-946f-d065e20c332e","Type":"ContainerDied","Data":"4e6972d200255e27826686e98332db793a0438de70cead62735a3840f431004e"}
Sep 11 12:29:39.668586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.668564    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.675474 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.675454    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.682291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.682276    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.688623 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.688596    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:29:39.689619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.689601    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.694048 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.694022    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:29:39.696871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.696858    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.704027 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.704012    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.710540 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.710522    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.710819 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.710795    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.710892 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.710823    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"} err="failed to get container status \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist"
Sep 11 12:29:39.710892 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.710841    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.711148 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.711130    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.711208 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.711152    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"} err="failed to get container status \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist"
Sep 11 12:29:39.711208 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.711168    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.711482 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.711464    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.711541 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.711486    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"} err="failed to get container status \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist"
Sep 11 12:29:39.711541 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.711499    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.711756 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.711743    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.711806 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.711758    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"} err="failed to get container status \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist"
Sep 11 12:29:39.711806 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.711771    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.712018 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.712002    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.712060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712023    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"} err="failed to get container status \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist"
Sep 11 12:29:39.712060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712038    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.712292 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.712276    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.712344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712295    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"} err="failed to get container status \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist"
Sep 11 12:29:39.712344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712309    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.712562 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:29:39.712544    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.712599 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712566    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"} err="failed to get container status \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist"
Sep 11 12:29:39.712599 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712579    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.712822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712804    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"} err="failed to get container status \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist"
Sep 11 12:29:39.712860 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.712830    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.713108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713089    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"} err="failed to get container status \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist"
Sep 11 12:29:39.713108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713107    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.713512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713385    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"} err="failed to get container status \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist"
Sep 11 12:29:39.713512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713407    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.713727 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713709    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"} err="failed to get container status \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist"
Sep 11 12:29:39.713783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713728    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.713991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713951    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"} err="failed to get container status \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist"
Sep 11 12:29:39.713991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.713970    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.714209 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714189    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"} err="failed to get container status \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist"
Sep 11 12:29:39.714248 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714211    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.714441 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714425    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"} err="failed to get container status \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist"
Sep 11 12:29:39.714492 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714440    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.714652 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714634    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"} err="failed to get container status \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist"
Sep 11 12:29:39.714652 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714650    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.714878 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714860    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"} err="failed to get container status \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist"
Sep 11 12:29:39.714919 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.714879    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.715077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715062    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"} err="failed to get container status \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist"
Sep 11 12:29:39.715131 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715075    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.715307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715289    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"} err="failed to get container status \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist"
Sep 11 12:29:39.715346 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715309    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.715522 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715507    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"} err="failed to get container status \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist"
Sep 11 12:29:39.715568 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715521    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.715701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715687    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"} err="failed to get container status \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist"
Sep 11 12:29:39.715701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715700    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.715917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715896    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"} err="failed to get container status \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist"
Sep 11 12:29:39.715963 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.715918    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.716175 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716159    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"} err="failed to get container status \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist"
Sep 11 12:29:39.716220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716175    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.716440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716417    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"} err="failed to get container status \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist"
Sep 11 12:29:39.716440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716440    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.716652 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716637    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"} err="failed to get container status \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist"
Sep 11 12:29:39.716652 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716650    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.716848 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716833    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"} err="failed to get container status \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist"
Sep 11 12:29:39.716848 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.716847    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.717039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717025    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"} err="failed to get container status \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist"
Sep 11 12:29:39.717039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717039    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.717316 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717295    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"} err="failed to get container status \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist"
Sep 11 12:29:39.717316 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717317    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.717597 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717579    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"} err="failed to get container status \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist"
Sep 11 12:29:39.717649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717597    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.717852 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717832    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"} err="failed to get container status \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist"
Sep 11 12:29:39.717904 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.717855    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.718092 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718070    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"} err="failed to get container status \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist"
Sep 11 12:29:39.718142 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718104    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.718342 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718322    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"} err="failed to get container status \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist"
Sep 11 12:29:39.718412 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718343    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.718583 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718567    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"} err="failed to get container status \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist"
Sep 11 12:29:39.718628 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718583    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.718781 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718762    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"} err="failed to get container status \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist"
Sep 11 12:29:39.718824 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718781    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.718976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718957    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"} err="failed to get container status \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist"
Sep 11 12:29:39.719056 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.718976    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.719187 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719165    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"} err="failed to get container status \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist"
Sep 11 12:29:39.719237 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719188    2563 scope.go:117] "RemoveContainer" containerID="8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"
Sep 11 12:29:39.719453 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719437    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800"} err="failed to get container status \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": rpc error: code = NotFound desc = could not find container \"8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800\": container with ID starting with 8d46922053fa9a20c46bbf011abdfe513a5f77244c70f9b3653a7c8e7d590800 not found: ID does not exist"
Sep 11 12:29:39.719453 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719452    2563 scope.go:117] "RemoveContainer" containerID="9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"
Sep 11 12:29:39.719653 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719637    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b"} err="failed to get container status \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": rpc error: code = NotFound desc = could not find container \"9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b\": container with ID starting with 9184f15c48fb5795987b49056c0e9002940f81b5c272ef87e3284d140195801b not found: ID does not exist"
Sep 11 12:29:39.719691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719653    2563 scope.go:117] "RemoveContainer" containerID="8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"
Sep 11 12:29:39.719877 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719854    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9"} err="failed to get container status \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": rpc error: code = NotFound desc = could not find container \"8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9\": container with ID starting with 8a4f21c21cae951400bb9675982038d122abe2596a5c45629c3d13c51c7aa2a9 not found: ID does not exist"
Sep 11 12:29:39.719919 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.719879    2563 scope.go:117] "RemoveContainer" containerID="f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"
Sep 11 12:29:39.720121 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720099    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953"} err="failed to get container status \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": rpc error: code = NotFound desc = could not find container \"f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953\": container with ID starting with f0dfc9bb5675b19c40f4441a1381c9391f93e4f15080baff8429da33abfb4953 not found: ID does not exist"
Sep 11 12:29:39.720191 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720123    2563 scope.go:117] "RemoveContainer" containerID="6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"
Sep 11 12:29:39.720394 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720349    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9"} err="failed to get container status \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": rpc error: code = NotFound desc = could not find container \"6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9\": container with ID starting with 6bb6044055280641940c68cf0566ae549ba52349e11142cc018a176e489ea7f9 not found: ID does not exist"
Sep 11 12:29:39.720446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720396    2563 scope.go:117] "RemoveContainer" containerID="0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"
Sep 11 12:29:39.720670 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720647    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb"} err="failed to get container status \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": rpc error: code = NotFound desc = could not find container \"0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb\": container with ID starting with 0df0f137cf949f9d84d09211c79cf650ff382465da951c1380535959425bd7fb not found: ID does not exist"
Sep 11 12:29:39.720740 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720673    2563 scope.go:117] "RemoveContainer" containerID="e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"
Sep 11 12:29:39.720914 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.720896    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677"} err="failed to get container status \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": rpc error: code = NotFound desc = could not find container \"e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677\": container with ID starting with e400e40284fe07d8d8130777e955482628daf724f593feed51e893ccd3d1c677 not found: ID does not exist"
Sep 11 12:29:39.725841 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.725821    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:29:39.726118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726105    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-web"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726119    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-web"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726133    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726142    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726154    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="thanos-sidecar"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726162    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="thanos-sidecar"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726176    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="config-reloader"
Sep 11 12:29:39.726180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726182    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="config-reloader"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726194    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-thanos"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726199    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-thanos"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.726210    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="init-config-reloader"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728698    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="init-config-reloader"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728727    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="prometheus"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728737    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="prometheus"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728849    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="thanos-sidecar"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728861    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="config-reloader"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728869    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-thanos"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728877    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy-web"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728889    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="prometheus"
Sep 11 12:29:39.728988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.728896    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52bee5b-e920-4511-946f-d065e20c332e" containerName="kube-rbac-proxy"
Sep 11 12:29:39.735527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.735508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.738692 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.738667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 12:29:39.738802 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.738786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 12:29:39.738871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.738807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 12:29:39.738871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.738786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 12:29:39.739209 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.739179    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 12:29:39.739330 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.739310    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-54c0lqagkulun\""
Sep 11 12:29:39.739457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.739436    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 12:29:39.739607 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.739585    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 12:29:39.739715 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.739672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m4rtl\""
Sep 11 12:29:39.740190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.740171    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 12:29:39.740190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.740181    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 12:29:39.740190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.740244    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 12:29:39.740190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.740279    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 12:29:39.740190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.740386    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 12:29:39.740190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.740448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 12:29:39.742135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.742115    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 12:29:39.747432 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.747411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:29:39.747658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.747643    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 12:29:39.804300 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.804273    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d52bee5b-e920-4511-946f-d065e20c332e" path="/var/lib/kubelet/pods/d52bee5b-e920-4511-946f-d065e20c332e/volumes"
Sep 11 12:29:39.835305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93952af1-6213-4458-b6bd-71966877bf1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835540 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835540 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835540 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835661 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835661 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-config\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835661 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835661 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6f9q\" (UniqueName: \"kubernetes.io/projected/93952af1-6213-4458-b6bd-71966877bf1e-kube-api-access-n6f9q\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.835858 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.836104 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.836104 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.836104 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93952af1-6213-4458-b6bd-71966877bf1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.836104 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.835940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937198 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937198 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937396 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937396 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937396 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93952af1-6213-4458-b6bd-71966877bf1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937396 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93952af1-6213-4458-b6bd-71966877bf1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937996 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937996 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.937996 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.937925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-config\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6f9q\" (UniqueName: \"kubernetes.io/projected/93952af1-6213-4458-b6bd-71966877bf1e-kube-api-access-n6f9q\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.938494 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.938413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.940047 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.939355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.940047 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.939471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942136 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.941530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942136 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.941760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942136 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.941916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942136 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.941977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942136 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93952af1-6213-4458-b6bd-71966877bf1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942136 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93952af1-6213-4458-b6bd-71966877bf1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.942927 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.942902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.943024 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.943006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.943213 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.943185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93952af1-6213-4458-b6bd-71966877bf1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.943431 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.943409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/93952af1-6213-4458-b6bd-71966877bf1e-config\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:39.947022 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:39.947000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6f9q\" (UniqueName: \"kubernetes.io/projected/93952af1-6213-4458-b6bd-71966877bf1e-kube-api-access-n6f9q\") pod \"prometheus-k8s-0\" (UID: \"93952af1-6213-4458-b6bd-71966877bf1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:40.045616 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:40.045583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:29:40.334825 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:40.334796    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 12:29:40.337204 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:29:40.337177    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93952af1_6213_4458_b6bd_71966877bf1e.slice/crio-80cfb0589ad8d5215b8c863ba4b15885f2f9d67fceed5618c6877fc2e1429770 WatchSource:0}: Error finding container 80cfb0589ad8d5215b8c863ba4b15885f2f9d67fceed5618c6877fc2e1429770: Status 404 returned error can't find the container with id 80cfb0589ad8d5215b8c863ba4b15885f2f9d67fceed5618c6877fc2e1429770
Sep 11 12:29:40.666816 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:40.666778    2563 generic.go:356] "Generic (PLEG): container finished" podID="93952af1-6213-4458-b6bd-71966877bf1e" containerID="c102f7b68d8005c63d509d00054a87d9ea7c1cfb665b55a4115be83839ce4a09" exitCode=0
Sep 11 12:29:40.667180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:40.666865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerDied","Data":"c102f7b68d8005c63d509d00054a87d9ea7c1cfb665b55a4115be83839ce4a09"}
Sep 11 12:29:40.667180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:40.666938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"80cfb0589ad8d5215b8c863ba4b15885f2f9d67fceed5618c6877fc2e1429770"}
Sep 11 12:29:41.674404 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.674348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"6fcaf6c1c5bbc1eae1d3b8319acb1dc9425805509d09626b455b1177cf3779de"}
Sep 11 12:29:41.674888 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.674447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"b7636da61883fb82145a6598b3d27e840692504d88a6571229ded4b0f373024d"}
Sep 11 12:29:41.674888 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.674493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"566ea1237161a1f4b52cfc96b67c81e5f01c2b19a48f2103b5b1c6da7b3eaef0"}
Sep 11 12:29:41.674888 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.674535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"b4e5b4c9ce11f79584e0af4b47891111addef2faf9f22700cefd6325322b53b7"}
Sep 11 12:29:41.674888 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.674582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"b75fe2d87a16669d93bc0e4e5a4e498ddd10483de6fb03ebf6592564c6fc94f9"}
Sep 11 12:29:41.674888 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.674634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93952af1-6213-4458-b6bd-71966877bf1e","Type":"ContainerStarted","Data":"402283797ec8cca26549c57ee67067bc4df0da2cbd6d1cd11091c3d216e3ba13"}
Sep 11 12:29:41.724095 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:41.724040    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.703311169 podStartE2EDuration="2.72402349s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.712321ms" isStatefulPod=false podCreationTimestamp="2026-09-11 12:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:29:41.722669524 +0000 UTC m=+182.435672574" watchObservedRunningTime="2026-09-11 12:29:41.72402349 +0000 UTC m=+182.437026525"
Sep 11 12:29:45.046668 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:29:45.046634    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:30:40.046703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:30:40.046665    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:30:40.062092 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:30:40.062068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:30:40.930318 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:30:40.930287    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 12:31:39.729103 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:31:39.729072    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:31:39.732088 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:31:39.732064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:31:39.733279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:31:39.733258    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:31:39.736352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:31:39.736333    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:31:39.740982 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:31:39.740967    2563 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 12:32:18.357171 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.357131    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2mtpk"]
Sep 11 12:32:18.360394 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.360375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.372507 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.372485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 12:32:18.373099 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.373084    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 12:32:18.373782 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.373768    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bwm8h\""
Sep 11 12:32:18.389132 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.389107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2mtpk"]
Sep 11 12:32:18.455883 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.455841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2mtpk\" (UID: \"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.456046 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.455986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjw6q\" (UniqueName: \"kubernetes.io/projected/37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81-kube-api-access-qjw6q\") pod \"cert-manager-webhook-6486ffd997-2mtpk\" (UID: \"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.556627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.556596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2mtpk\" (UID: \"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.556788 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.556678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjw6q\" (UniqueName: \"kubernetes.io/projected/37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81-kube-api-access-qjw6q\") pod \"cert-manager-webhook-6486ffd997-2mtpk\" (UID: \"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.567217 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.567184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2mtpk\" (UID: \"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.567354 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.567333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjw6q\" (UniqueName: \"kubernetes.io/projected/37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81-kube-api-access-qjw6q\") pod \"cert-manager-webhook-6486ffd997-2mtpk\" (UID: \"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.683808 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.683782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:18.964864 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.964790    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2mtpk"]
Sep 11 12:32:18.967987 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:32:18.967957    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37a5d37b_3ab9_4a9d_bb4a_e872c88b3c81.slice/crio-0de3c5fa6e85ad7907b5f8479a067ee983375fd45eee89d31acebdfc0b32c53c WatchSource:0}: Error finding container 0de3c5fa6e85ad7907b5f8479a067ee983375fd45eee89d31acebdfc0b32c53c: Status 404 returned error can't find the container with id 0de3c5fa6e85ad7907b5f8479a067ee983375fd45eee89d31acebdfc0b32c53c
Sep 11 12:32:18.969995 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:18.969976    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:32:19.307836 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:19.307757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk" event={"ID":"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81","Type":"ContainerStarted","Data":"0de3c5fa6e85ad7907b5f8479a067ee983375fd45eee89d31acebdfc0b32c53c"}
Sep 11 12:32:22.323933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:22.323853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk" event={"ID":"37a5d37b-3ab9-4a9d-bb4a-e872c88b3c81","Type":"ContainerStarted","Data":"5e44ad39f2f80c373686a6c16aaedda37bd59e7872f5639348956f4b43361f55"}
Sep 11 12:32:22.324379 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:22.323983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:22.350073 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:22.350024    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk" podStartSLOduration=1.272354627 podStartE2EDuration="4.350008767s" totalImagesPullingTime="3.07765414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:32:22.348940489 +0000 UTC m=+343.061943541" watchObservedRunningTime="2026-09-11 12:32:22.350008767 +0000 UTC m=+343.063011806"
Sep 11 12:32:28.331575 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:28.331541    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2mtpk"
Sep 11 12:32:55.748292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.748197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"]
Sep 11 12:32:55.753485 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.753452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.757032 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.757009    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 12:32:55.757216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.757194    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d9rvx\""
Sep 11 12:32:55.757300 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.757236    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 12:32:55.758488 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.758459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 12:32:55.763707 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.763689    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 12:32:55.772795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.772770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2a1c760-1069-4483-8ddb-c9143c39c49b-manifests\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.772901 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.772801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a1c760-1069-4483-8ddb-c9143c39c49b-tmp\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.772901 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.772836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2a1c760-1069-4483-8ddb-c9143c39c49b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.773021 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.772930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2a1c760-1069-4483-8ddb-c9143c39c49b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.773021 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.772978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xfdh\" (UniqueName: \"kubernetes.io/projected/a2a1c760-1069-4483-8ddb-c9143c39c49b-kube-api-access-5xfdh\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.786779 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.786756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"]
Sep 11 12:32:55.874041 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.874013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2a1c760-1069-4483-8ddb-c9143c39c49b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.874191 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.874046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfdh\" (UniqueName: \"kubernetes.io/projected/a2a1c760-1069-4483-8ddb-c9143c39c49b-kube-api-access-5xfdh\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.874191 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.874124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2a1c760-1069-4483-8ddb-c9143c39c49b-manifests\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.874191 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.874161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a1c760-1069-4483-8ddb-c9143c39c49b-tmp\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.874355 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.874200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2a1c760-1069-4483-8ddb-c9143c39c49b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.874673 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.874651    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2a1c760-1069-4483-8ddb-c9143c39c49b-manifests\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.876549 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.876528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2a1c760-1069-4483-8ddb-c9143c39c49b-tmp\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.876679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.876661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2a1c760-1069-4483-8ddb-c9143c39c49b-webhook-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.876756 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.876739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2a1c760-1069-4483-8ddb-c9143c39c49b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:55.889239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:55.889213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xfdh\" (UniqueName: \"kubernetes.io/projected/a2a1c760-1069-4483-8ddb-c9143c39c49b-kube-api-access-5xfdh\") pod \"opendatahub-operator-controller-manager-65cbc8d955-f9z7q\" (UID: \"a2a1c760-1069-4483-8ddb-c9143c39c49b\") " pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:56.064058 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:56.063975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:32:56.359789 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:56.359717    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"]
Sep 11 12:32:56.363828 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:32:56.363802    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a1c760_1069_4483_8ddb_c9143c39c49b.slice/crio-72fec90f52fc6a8851ed4dc86a53f23f2dfc94771a8fa89df787f36a6e959c0c WatchSource:0}: Error finding container 72fec90f52fc6a8851ed4dc86a53f23f2dfc94771a8fa89df787f36a6e959c0c: Status 404 returned error can't find the container with id 72fec90f52fc6a8851ed4dc86a53f23f2dfc94771a8fa89df787f36a6e959c0c
Sep 11 12:32:56.466053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:32:56.466024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q" event={"ID":"a2a1c760-1069-4483-8ddb-c9143c39c49b","Type":"ContainerStarted","Data":"72fec90f52fc6a8851ed4dc86a53f23f2dfc94771a8fa89df787f36a6e959c0c"}
Sep 11 12:33:00.487189 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:00.487155    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q" event={"ID":"a2a1c760-1069-4483-8ddb-c9143c39c49b","Type":"ContainerStarted","Data":"65df96864696332c25908ac52f027bf2e77d4fe67ed3ab87cad42606aa270ea9"}
Sep 11 12:33:01.492717 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:01.492682    2563 generic.go:356] "Generic (PLEG): container finished" podID="a2a1c760-1069-4483-8ddb-c9143c39c49b" containerID="65df96864696332c25908ac52f027bf2e77d4fe67ed3ab87cad42606aa270ea9" exitCode=0
Sep 11 12:33:01.493079 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:01.492738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q" event={"ID":"a2a1c760-1069-4483-8ddb-c9143c39c49b","Type":"ContainerDied","Data":"65df96864696332c25908ac52f027bf2e77d4fe67ed3ab87cad42606aa270ea9"}
Sep 11 12:33:03.503508 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:03.503459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q" event={"ID":"a2a1c760-1069-4483-8ddb-c9143c39c49b","Type":"ContainerStarted","Data":"2d35b48ee93d8987460dc50ab007f5a02da4888af521c3c227225f6545b29597"}
Sep 11 12:33:03.503973 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:03.503593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:33:14.510678 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:14.510647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q"
Sep 11 12:33:14.537800 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:14.537748    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65cbc8d955-f9z7q" podStartSLOduration=14.071779101 podStartE2EDuration="19.537734277s" totalImagesPullingTime="4.415681052s" totalInitContainerRuntime="1.050274124s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:32:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:03.543948932 +0000 UTC m=+384.256951970" watchObservedRunningTime="2026-09-11 12:33:14.537734277 +0000 UTC m=+395.250737353"
Sep 11 12:33:28.019705 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.019672    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jlt5s"]
Sep 11 12:33:28.032651 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.032623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.035751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.035718    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 12:33:28.035751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.035733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fmnqk\""
Sep 11 12:33:28.039940 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.039912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jlt5s"]
Sep 11 12:33:28.151915 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.151877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tggsf\" (UniqueName: \"kubernetes.io/projected/f744a4c1-b285-4540-9a40-228ebdc71d54-kube-api-access-tggsf\") pod \"model-serving-api-54d89bd5fc-jlt5s\" (UID: \"f744a4c1-b285-4540-9a40-228ebdc71d54\") " pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.152087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.151939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f744a4c1-b285-4540-9a40-228ebdc71d54-tls-certs\") pod \"model-serving-api-54d89bd5fc-jlt5s\" (UID: \"f744a4c1-b285-4540-9a40-228ebdc71d54\") " pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.252592 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.252555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tggsf\" (UniqueName: \"kubernetes.io/projected/f744a4c1-b285-4540-9a40-228ebdc71d54-kube-api-access-tggsf\") pod \"model-serving-api-54d89bd5fc-jlt5s\" (UID: \"f744a4c1-b285-4540-9a40-228ebdc71d54\") " pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.252752 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.252609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f744a4c1-b285-4540-9a40-228ebdc71d54-tls-certs\") pod \"model-serving-api-54d89bd5fc-jlt5s\" (UID: \"f744a4c1-b285-4540-9a40-228ebdc71d54\") " pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.255042 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.255022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f744a4c1-b285-4540-9a40-228ebdc71d54-tls-certs\") pod \"model-serving-api-54d89bd5fc-jlt5s\" (UID: \"f744a4c1-b285-4540-9a40-228ebdc71d54\") " pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.261590 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.261570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tggsf\" (UniqueName: \"kubernetes.io/projected/f744a4c1-b285-4540-9a40-228ebdc71d54-kube-api-access-tggsf\") pod \"model-serving-api-54d89bd5fc-jlt5s\" (UID: \"f744a4c1-b285-4540-9a40-228ebdc71d54\") " pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.344921 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.344847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:28.615056 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:28.614982    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jlt5s"]
Sep 11 12:33:28.618628 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:33:28.618600    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf744a4c1_b285_4540_9a40_228ebdc71d54.slice/crio-316fbcf0ffb28665be8cd06b0fb2f9e2646ffd7133f3c34f1eddb5220595ed8a WatchSource:0}: Error finding container 316fbcf0ffb28665be8cd06b0fb2f9e2646ffd7133f3c34f1eddb5220595ed8a: Status 404 returned error can't find the container with id 316fbcf0ffb28665be8cd06b0fb2f9e2646ffd7133f3c34f1eddb5220595ed8a
Sep 11 12:33:29.613135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:29.613099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s" event={"ID":"f744a4c1-b285-4540-9a40-228ebdc71d54","Type":"ContainerStarted","Data":"316fbcf0ffb28665be8cd06b0fb2f9e2646ffd7133f3c34f1eddb5220595ed8a"}
Sep 11 12:33:32.628596 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:32.628553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s" event={"ID":"f744a4c1-b285-4540-9a40-228ebdc71d54","Type":"ContainerStarted","Data":"09f434ebcf3c97e7b0471646966c0276c20a5ca6fb0fa7af64d44e931699f11c"}
Sep 11 12:33:32.629004 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:32.628629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:32.650596 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:32.650548    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s" podStartSLOduration=1.67501469 podStartE2EDuration="4.65053468s" totalImagesPullingTime="2.97551999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:32.649396817 +0000 UTC m=+413.362399857" watchObservedRunningTime="2026-09-11 12:33:32.65053468 +0000 UTC m=+413.363537718"
Sep 11 12:33:34.800439 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.800401    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"]
Sep 11 12:33:34.803900 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.803877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:34.809442 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.809420    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 12:33:34.809442 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.809422    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 12:33:34.810153 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.810032    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:33:34.810153 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.810050    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 12:33:34.810153 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.810130    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 12:33:34.810510 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.810486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-27lr8\""
Sep 11 12:33:34.818424 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.818399    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"]
Sep 11 12:33:34.917167 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.917124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2355ec8-9e28-4221-b749-8bd99e4d8369-manager-config\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:34.917167 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.917172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86r2n\" (UniqueName: \"kubernetes.io/projected/d2355ec8-9e28-4221-b749-8bd99e4d8369-kube-api-access-86r2n\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:34.917434 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.917220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2355ec8-9e28-4221-b749-8bd99e4d8369-cert\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:34.917434 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:34.917345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2355ec8-9e28-4221-b749-8bd99e4d8369-metrics-cert\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.018310 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.018274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2355ec8-9e28-4221-b749-8bd99e4d8369-manager-config\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.018310 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.018313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86r2n\" (UniqueName: \"kubernetes.io/projected/d2355ec8-9e28-4221-b749-8bd99e4d8369-kube-api-access-86r2n\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.018593 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.018336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2355ec8-9e28-4221-b749-8bd99e4d8369-cert\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.018593 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.018353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2355ec8-9e28-4221-b749-8bd99e4d8369-metrics-cert\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.019070 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.019038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2355ec8-9e28-4221-b749-8bd99e4d8369-manager-config\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.020887 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.020853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2355ec8-9e28-4221-b749-8bd99e4d8369-cert\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.021047 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.021026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2355ec8-9e28-4221-b749-8bd99e4d8369-metrics-cert\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.034024 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.033991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86r2n\" (UniqueName: \"kubernetes.io/projected/d2355ec8-9e28-4221-b749-8bd99e4d8369-kube-api-access-86r2n\") pod \"lws-controller-manager-556b8bb6b-wwwl9\" (UID: \"d2355ec8-9e28-4221-b749-8bd99e4d8369\") " pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.119528 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.119428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:35.315385 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.315334    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"]
Sep 11 12:33:35.326063 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.326033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.331155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.331132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 12:33:35.332121 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.331941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 12:33:35.332262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.332242    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 12:33:35.333260 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.333088    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 12:33:35.333398 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.333274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7qncw\""
Sep 11 12:33:35.335080 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.335059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"]
Sep 11 12:33:35.407475 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.407445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"]
Sep 11 12:33:35.409242 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:33:35.409215    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2355ec8_9e28_4221_b749_8bd99e4d8369.slice/crio-060eb22cf935f5912453e6b162346ba3db07afd14948f86e84cbc4fc54067da7 WatchSource:0}: Error finding container 060eb22cf935f5912453e6b162346ba3db07afd14948f86e84cbc4fc54067da7: Status 404 returned error can't find the container with id 060eb22cf935f5912453e6b162346ba3db07afd14948f86e84cbc4fc54067da7
Sep 11 12:33:35.426749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.426841 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.426841 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.426912 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dksrv\" (UniqueName: \"kubernetes.io/projected/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-kube-api-access-dksrv\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.426956 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.426991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.427034 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.426994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528162 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528162 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dksrv\" (UniqueName: \"kubernetes.io/projected/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-kube-api-access-dksrv\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.528997 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.528973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.530454 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.530437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.531140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.531113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.531219 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.531137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.531219 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.531127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.537076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.537052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.537417 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.537400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dksrv\" (UniqueName: \"kubernetes.io/projected/29a5165b-5c2c-4e0d-a4e4-1d173552d8d5-kube-api-access-dksrv\") pod \"istiod-openshift-gateway-5677ccb49b-zbxmm\" (UID: \"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.636816 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.636789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:35.642974 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.642946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9" event={"ID":"d2355ec8-9e28-4221-b749-8bd99e4d8369","Type":"ContainerStarted","Data":"060eb22cf935f5912453e6b162346ba3db07afd14948f86e84cbc4fc54067da7"}
Sep 11 12:33:35.950672 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:35.950586    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"]
Sep 11 12:33:36.650158 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:36.650123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm" event={"ID":"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5","Type":"ContainerStarted","Data":"4cb506b0bb1f2c16d2de68d278f9c96ff68474e79a1b6435d5710aa6e4f31b2f"}
Sep 11 12:33:37.658795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:37.658729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9" event={"ID":"d2355ec8-9e28-4221-b749-8bd99e4d8369","Type":"ContainerStarted","Data":"89edd3436a1c3f583702c707c45044b6bd5b84e3ac4ce09034c511b06eb454d3"}
Sep 11 12:33:37.659176 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:37.658995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:33:39.389547 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:39.389510    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:33:39.389836 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:39.389575    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:33:39.669882 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:39.669843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm" event={"ID":"29a5165b-5c2c-4e0d-a4e4-1d173552d8d5","Type":"ContainerStarted","Data":"18e0c293c5493d63409be31ad0e5d88185529df4e2e196a223bdaf33129b1e35"}
Sep 11 12:33:39.670042 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:39.669983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:39.696980 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:39.696939    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm" podStartSLOduration=1.260469359 podStartE2EDuration="4.696925339s" totalImagesPullingTime="3.43645598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:39.694963258 +0000 UTC m=+420.407966296" watchObservedRunningTime="2026-09-11 12:33:39.696925339 +0000 UTC m=+420.409928377"
Sep 11 12:33:39.697403 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:39.697381    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9" podStartSLOduration=3.540870138 podStartE2EDuration="5.697374242s" totalImagesPullingTime="2.156504104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:33:37.68567155 +0000 UTC m=+418.398674589" watchObservedRunningTime="2026-09-11 12:33:39.697374242 +0000 UTC m=+420.410377271"
Sep 11 12:33:40.676406 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:40.676379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zbxmm"
Sep 11 12:33:43.637474 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:43.637429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jlt5s"
Sep 11 12:33:48.666386 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:33:48.666333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-556b8bb6b-wwwl9"
Sep 11 12:35:53.448545 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.448463    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:35:53.451891 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.451870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.454598 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.454578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 12:35:53.454753 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.454733    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 12:35:53.454840 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.454820    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 12:35:53.455968 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.455952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-758qr\""
Sep 11 12:35:53.462434 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.462414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:35:53.545604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.545573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:35:53.632926 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.632894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv9c9\" (UniqueName: \"kubernetes.io/projected/96d0e58b-fb5e-4d7d-b7e4-200110a61971-kube-api-access-xv9c9\") pod \"limitador-limitador-8588749977-6fk8d\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") " pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.633082 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.632950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96d0e58b-fb5e-4d7d-b7e4-200110a61971-config-file\") pod \"limitador-limitador-8588749977-6fk8d\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") " pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.733726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.733652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv9c9\" (UniqueName: \"kubernetes.io/projected/96d0e58b-fb5e-4d7d-b7e4-200110a61971-kube-api-access-xv9c9\") pod \"limitador-limitador-8588749977-6fk8d\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") " pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.733726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.733712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96d0e58b-fb5e-4d7d-b7e4-200110a61971-config-file\") pod \"limitador-limitador-8588749977-6fk8d\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") " pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.734408 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.734342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96d0e58b-fb5e-4d7d-b7e4-200110a61971-config-file\") pod \"limitador-limitador-8588749977-6fk8d\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") " pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.743107 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.743086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv9c9\" (UniqueName: \"kubernetes.io/projected/96d0e58b-fb5e-4d7d-b7e4-200110a61971-kube-api-access-xv9c9\") pod \"limitador-limitador-8588749977-6fk8d\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") " pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:53.763077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:53.763053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:54.034012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:54.033986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:35:54.036221 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:35:54.036188    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d0e58b_fb5e_4d7d_b7e4_200110a61971.slice/crio-995ce8f2fd1f12aca514011ad51c750b9a9cca6c57695f42891b889f58cb1284 WatchSource:0}: Error finding container 995ce8f2fd1f12aca514011ad51c750b9a9cca6c57695f42891b889f58cb1284: Status 404 returned error can't find the container with id 995ce8f2fd1f12aca514011ad51c750b9a9cca6c57695f42891b889f58cb1284
Sep 11 12:35:54.255304 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:54.255267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d" event={"ID":"96d0e58b-fb5e-4d7d-b7e4-200110a61971","Type":"ContainerStarted","Data":"995ce8f2fd1f12aca514011ad51c750b9a9cca6c57695f42891b889f58cb1284"}
Sep 11 12:35:57.272008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:57.271971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d" event={"ID":"96d0e58b-fb5e-4d7d-b7e4-200110a61971","Type":"ContainerStarted","Data":"803338384c576a6c77f7abb7cd297216b04971886759ee41193f886ba74ab19a"}
Sep 11 12:35:57.272469 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:57.272034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:35:57.294427 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:35:57.294377    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d" podStartSLOduration=1.908461591 podStartE2EDuration="4.294348286s" totalImagesPullingTime="2.385886695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:35:57.292084913 +0000 UTC m=+558.005087952" watchObservedRunningTime="2026-09-11 12:35:57.294348286 +0000 UTC m=+558.007351368"
Sep 11 12:36:06.537661 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:06.537622    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:36:06.538227 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:06.537809    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d" podUID="96d0e58b-fb5e-4d7d-b7e4-200110a61971" containerName="limitador" containerID="cri-o://803338384c576a6c77f7abb7cd297216b04971886759ee41193f886ba74ab19a" gracePeriod=30
Sep 11 12:36:06.538666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:06.538543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:36:07.317511 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.317480    2563 generic.go:356] "Generic (PLEG): container finished" podID="96d0e58b-fb5e-4d7d-b7e4-200110a61971" containerID="803338384c576a6c77f7abb7cd297216b04971886759ee41193f886ba74ab19a" exitCode=0
Sep 11 12:36:07.317688 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.317564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d" event={"ID":"96d0e58b-fb5e-4d7d-b7e4-200110a61971","Type":"ContainerDied","Data":"803338384c576a6c77f7abb7cd297216b04971886759ee41193f886ba74ab19a"}
Sep 11 12:36:07.479245 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.479214    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:36:07.552413 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.552386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96d0e58b-fb5e-4d7d-b7e4-200110a61971-config-file\") pod \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") "
Sep 11 12:36:07.552745 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.552419    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv9c9\" (UniqueName: \"kubernetes.io/projected/96d0e58b-fb5e-4d7d-b7e4-200110a61971-kube-api-access-xv9c9\") pod \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\" (UID: \"96d0e58b-fb5e-4d7d-b7e4-200110a61971\") "
Sep 11 12:36:07.552822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.552789    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d0e58b-fb5e-4d7d-b7e4-200110a61971-config-file" (OuterVolumeSpecName: "config-file") pod "96d0e58b-fb5e-4d7d-b7e4-200110a61971" (UID: "96d0e58b-fb5e-4d7d-b7e4-200110a61971"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:36:07.554568 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.554551    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d0e58b-fb5e-4d7d-b7e4-200110a61971-kube-api-access-xv9c9" (OuterVolumeSpecName: "kube-api-access-xv9c9") pod "96d0e58b-fb5e-4d7d-b7e4-200110a61971" (UID: "96d0e58b-fb5e-4d7d-b7e4-200110a61971"). InnerVolumeSpecName "kube-api-access-xv9c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:36:07.653049 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.653016    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/96d0e58b-fb5e-4d7d-b7e4-200110a61971-config-file\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:36:07.653049 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:07.653043    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv9c9\" (UniqueName: \"kubernetes.io/projected/96d0e58b-fb5e-4d7d-b7e4-200110a61971-kube-api-access-xv9c9\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:36:08.323028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:08.323003    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d"
Sep 11 12:36:08.323028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:08.323009    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6fk8d" event={"ID":"96d0e58b-fb5e-4d7d-b7e4-200110a61971","Type":"ContainerDied","Data":"995ce8f2fd1f12aca514011ad51c750b9a9cca6c57695f42891b889f58cb1284"}
Sep 11 12:36:08.323256 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:08.323064    2563 scope.go:117] "RemoveContainer" containerID="803338384c576a6c77f7abb7cd297216b04971886759ee41193f886ba74ab19a"
Sep 11 12:36:08.347649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:08.347617    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:36:08.357264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:08.357237    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6fk8d"]
Sep 11 12:36:09.804987 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:09.804950    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d0e58b-fb5e-4d7d-b7e4-200110a61971" path="/var/lib/kubelet/pods/96d0e58b-fb5e-4d7d-b7e4-200110a61971/volumes"
Sep 11 12:36:10.047556 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.047525    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"]
Sep 11 12:36:10.047898 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.047885    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d0e58b-fb5e-4d7d-b7e4-200110a61971" containerName="limitador"
Sep 11 12:36:10.047898 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.047899    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d0e58b-fb5e-4d7d-b7e4-200110a61971" containerName="limitador"
Sep 11 12:36:10.047979 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.047961    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d0e58b-fb5e-4d7d-b7e4-200110a61971" containerName="limitador"
Sep 11 12:36:10.052168 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.052146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.056986 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.056933    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:36:10.057236 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.057215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bzgdq\""
Sep 11 12:36:10.058223 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.058200    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 12:36:10.058307 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.058239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 12:36:10.069217 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.069196    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"]
Sep 11 12:36:10.074820 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.074795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/80e0b938-4068-4587-9d0e-6b2bfc767172-data\") pod \"postgres-69fb4594cf-kr9t6\" (UID: \"80e0b938-4068-4587-9d0e-6b2bfc767172\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.074900 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.074854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrmc\" (UniqueName: \"kubernetes.io/projected/80e0b938-4068-4587-9d0e-6b2bfc767172-kube-api-access-7lrmc\") pod \"postgres-69fb4594cf-kr9t6\" (UID: \"80e0b938-4068-4587-9d0e-6b2bfc767172\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.175789 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.175752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/80e0b938-4068-4587-9d0e-6b2bfc767172-data\") pod \"postgres-69fb4594cf-kr9t6\" (UID: \"80e0b938-4068-4587-9d0e-6b2bfc767172\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.175949 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.175816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrmc\" (UniqueName: \"kubernetes.io/projected/80e0b938-4068-4587-9d0e-6b2bfc767172-kube-api-access-7lrmc\") pod \"postgres-69fb4594cf-kr9t6\" (UID: \"80e0b938-4068-4587-9d0e-6b2bfc767172\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.176135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.176115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/80e0b938-4068-4587-9d0e-6b2bfc767172-data\") pod \"postgres-69fb4594cf-kr9t6\" (UID: \"80e0b938-4068-4587-9d0e-6b2bfc767172\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.185988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.185961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrmc\" (UniqueName: \"kubernetes.io/projected/80e0b938-4068-4587-9d0e-6b2bfc767172-kube-api-access-7lrmc\") pod \"postgres-69fb4594cf-kr9t6\" (UID: \"80e0b938-4068-4587-9d0e-6b2bfc767172\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.363380 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.363273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:10.637184 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:10.637107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"]
Sep 11 12:36:10.640281 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:36:10.640254    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e0b938_4068_4587_9d0e_6b2bfc767172.slice/crio-28fc62592332450a24b57afe8de361ad9446dd16ef19b435748efd143e1ee4d5 WatchSource:0}: Error finding container 28fc62592332450a24b57afe8de361ad9446dd16ef19b435748efd143e1ee4d5: Status 404 returned error can't find the container with id 28fc62592332450a24b57afe8de361ad9446dd16ef19b435748efd143e1ee4d5
Sep 11 12:36:11.341100 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:11.341016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6" event={"ID":"80e0b938-4068-4587-9d0e-6b2bfc767172","Type":"ContainerStarted","Data":"28fc62592332450a24b57afe8de361ad9446dd16ef19b435748efd143e1ee4d5"}
Sep 11 12:36:15.363331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:15.363296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6" event={"ID":"80e0b938-4068-4587-9d0e-6b2bfc767172","Type":"ContainerStarted","Data":"6ed61549ac0f2b900ecef918cb9b9560110f11326caad6f8e515bed7a2aef565"}
Sep 11 12:36:15.363776 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:15.363383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:15.382497 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:15.382448    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6" podStartSLOduration=0.792184576 podStartE2EDuration="5.382432723s" totalImagesPullingTime="4.590248147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:36:15.382057699 +0000 UTC m=+576.095060742" watchObservedRunningTime="2026-09-11 12:36:15.382432723 +0000 UTC m=+576.095435769"
Sep 11 12:36:21.400466 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:21.400329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kr9t6"
Sep 11 12:36:28.536234 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.536170    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-775bfcf6c9-tmbxl"]
Sep 11 12:36:28.554167 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.554137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-775bfcf6c9-tmbxl"]
Sep 11 12:36:28.554331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.554269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.557859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.557657    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 12:36:28.557859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.557721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sd5qx\""
Sep 11 12:36:28.557859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.557806    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 12:36:28.558954 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.558921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 12:36:28.650871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.650833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-metrics-certs\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.651046 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.650886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.651046 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.650984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws8sk\" (UniqueName: \"kubernetes.io/projected/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-kube-api-access-ws8sk\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.713474 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.713440    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd9d877ff-r6ljw"]
Sep 11 12:36:28.715721 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.715701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.731699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.731673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-r6ljw"]
Sep 11 12:36:28.752201 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.752171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-metrics-certs\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.752345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.752215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.752345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.752260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws8sk\" (UniqueName: \"kubernetes.io/projected/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-kube-api-access-ws8sk\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.752470 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:36:28.752412    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 12:36:28.752519 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:36:28.752477    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert podName:2ae99ee9-b337-4ea1-a28c-6d564c7b01b7 nodeName:}" failed. No retries permitted until 2026-09-11 12:36:29.25246163 +0000 UTC m=+589.965464645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert") pod "maas-controller-775bfcf6c9-tmbxl" (UID: "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7") : secret "maas-controller-webhook-cert" not found
Sep 11 12:36:28.754649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.754631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-metrics-certs\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.767891 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.767864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws8sk\" (UniqueName: \"kubernetes.io/projected/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-kube-api-access-ws8sk\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:28.853190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.853107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-webhook-cert\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.853317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.853186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mf7z\" (UniqueName: \"kubernetes.io/projected/7818b3d3-ec31-43be-84de-5684531aba2e-kube-api-access-2mf7z\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.853317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.853267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-metrics-certs\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.954374 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.954336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-webhook-cert\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.954534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.954403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mf7z\" (UniqueName: \"kubernetes.io/projected/7818b3d3-ec31-43be-84de-5684531aba2e-kube-api-access-2mf7z\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.954534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.954462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-metrics-certs\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.956916 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.956883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-webhook-cert\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.957039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.956919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-metrics-certs\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:28.963790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:28.963763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mf7z\" (UniqueName: \"kubernetes.io/projected/7818b3d3-ec31-43be-84de-5684531aba2e-kube-api-access-2mf7z\") pod \"maas-controller-dd9d877ff-r6ljw\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") " pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:29.025684 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.025655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:29.257053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.257021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:29.259401 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.259381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert\") pod \"maas-controller-775bfcf6c9-tmbxl\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") " pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:29.297052 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.297016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-r6ljw"]
Sep 11 12:36:29.299220 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:36:29.299193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7818b3d3_ec31_43be_84de_5684531aba2e.slice/crio-28d1b2e77e0cdaba167ffc420ae8237a43d3fbe748bb7202a277070586ece8d7 WatchSource:0}: Error finding container 28d1b2e77e0cdaba167ffc420ae8237a43d3fbe748bb7202a277070586ece8d7: Status 404 returned error can't find the container with id 28d1b2e77e0cdaba167ffc420ae8237a43d3fbe748bb7202a277070586ece8d7
Sep 11 12:36:29.430559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.430525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-r6ljw" event={"ID":"7818b3d3-ec31-43be-84de-5684531aba2e","Type":"ContainerStarted","Data":"28d1b2e77e0cdaba167ffc420ae8237a43d3fbe748bb7202a277070586ece8d7"}
Sep 11 12:36:29.464915 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.464893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:29.735332 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:29.735304    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-775bfcf6c9-tmbxl"]
Sep 11 12:36:29.737754 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:36:29.737727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae99ee9_b337_4ea1_a28c_6d564c7b01b7.slice/crio-caa5ccd88bf1f2ce306d5be322659eef274d7b29a0ac5194a3e4d3dea2449ca1 WatchSource:0}: Error finding container caa5ccd88bf1f2ce306d5be322659eef274d7b29a0ac5194a3e4d3dea2449ca1: Status 404 returned error can't find the container with id caa5ccd88bf1f2ce306d5be322659eef274d7b29a0ac5194a3e4d3dea2449ca1
Sep 11 12:36:30.441407 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:30.441347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl" event={"ID":"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7","Type":"ContainerStarted","Data":"caa5ccd88bf1f2ce306d5be322659eef274d7b29a0ac5194a3e4d3dea2449ca1"}
Sep 11 12:36:32.452953 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:32.452919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-r6ljw" event={"ID":"7818b3d3-ec31-43be-84de-5684531aba2e","Type":"ContainerStarted","Data":"356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a"}
Sep 11 12:36:32.453528 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:32.453031    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:32.454517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:32.454496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl" event={"ID":"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7","Type":"ContainerStarted","Data":"9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734"}
Sep 11 12:36:32.454637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:32.454625    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:32.484886 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:32.484845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dd9d877ff-r6ljw" podStartSLOduration=1.9327890760000002 podStartE2EDuration="4.484831824s" totalImagesPullingTime="2.552042748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:36:32.4823853 +0000 UTC m=+593.195388336" watchObservedRunningTime="2026-09-11 12:36:32.484831824 +0000 UTC m=+593.197834846"
Sep 11 12:36:32.527776 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:32.527724    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl" podStartSLOduration=2.410913841 podStartE2EDuration="4.527708631s" totalImagesPullingTime="2.11679479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:36:32.525783972 +0000 UTC m=+593.238787012" watchObservedRunningTime="2026-09-11 12:36:32.527708631 +0000 UTC m=+593.240711668"
Sep 11 12:36:39.764167 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:39.764135    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:36:39.764621 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:39.764388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:36:39.767520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:39.767500    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:36:39.767917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:39.767899    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:36:43.461354 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.461320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:43.461822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.461514    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:36:43.527766 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.527734    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-775bfcf6c9-tmbxl"]
Sep 11 12:36:43.527952 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.527929    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl" podUID="2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" containerName="manager" containerID="cri-o://9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734" gracePeriod=30
Sep 11 12:36:43.781031 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.781001    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:43.892336 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.892304    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws8sk\" (UniqueName: \"kubernetes.io/projected/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-kube-api-access-ws8sk\") pod \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") "
Sep 11 12:36:43.892513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.892347    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert\") pod \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") "
Sep 11 12:36:43.892513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.892411    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-metrics-certs\") pod \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\" (UID: \"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7\") "
Sep 11 12:36:43.894648 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.894617    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" (UID: "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:36:43.894790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.894695    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" (UID: "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:36:43.894790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.894755    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-kube-api-access-ws8sk" (OuterVolumeSpecName: "kube-api-access-ws8sk") pod "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" (UID: "2ae99ee9-b337-4ea1-a28c-6d564c7b01b7"). InnerVolumeSpecName "kube-api-access-ws8sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:36:43.993774 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.993735    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws8sk\" (UniqueName: \"kubernetes.io/projected/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-kube-api-access-ws8sk\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:36:43.993774 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.993766    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-webhook-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:36:43.993774 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:43.993780    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:36:44.514915 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.514877    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" containerID="9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734" exitCode=0
Sep 11 12:36:44.515292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.514928    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl"
Sep 11 12:36:44.515292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.514959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl" event={"ID":"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7","Type":"ContainerDied","Data":"9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734"}
Sep 11 12:36:44.515292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.515010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775bfcf6c9-tmbxl" event={"ID":"2ae99ee9-b337-4ea1-a28c-6d564c7b01b7","Type":"ContainerDied","Data":"caa5ccd88bf1f2ce306d5be322659eef274d7b29a0ac5194a3e4d3dea2449ca1"}
Sep 11 12:36:44.515292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.515034    2563 scope.go:117] "RemoveContainer" containerID="9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734"
Sep 11 12:36:44.523570 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.523553    2563 scope.go:117] "RemoveContainer" containerID="9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734"
Sep 11 12:36:44.523918 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:36:44.523901    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734\": container with ID starting with 9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734 not found: ID does not exist" containerID="9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734"
Sep 11 12:36:44.523974 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.523925    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734"} err="failed to get container status \"9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734\": rpc error: code = NotFound desc = could not find container \"9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734\": container with ID starting with 9eebc4b480dcb4d3501bfe738149c30fe9c540d368e2a9b7986a58d811d2f734 not found: ID does not exist"
Sep 11 12:36:44.536336 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.536307    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-775bfcf6c9-tmbxl"]
Sep 11 12:36:44.539856 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:44.539835    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-775bfcf6c9-tmbxl"]
Sep 11 12:36:45.805324 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:36:45.805288    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" path="/var/lib/kubelet/pods/2ae99ee9-b337-4ea1-a28c-6d564c7b01b7/volumes"
Sep 11 12:37:06.521282 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.521248    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"]
Sep 11 12:37:06.521777 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.521643    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" containerName="manager"
Sep 11 12:37:06.521777 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.521658    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" containerName="manager"
Sep 11 12:37:06.521777 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.521722    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ae99ee9-b337-4ea1-a28c-6d564c7b01b7" containerName="manager"
Sep 11 12:37:06.527574 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.527554    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.530600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.530576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 12:37:06.530730 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.530631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 12:37:06.530730 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.530675    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v6tqs\""
Sep 11 12:37:06.535814 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.535794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"]
Sep 11 12:37:06.585924 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.585889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-maas-api-tls\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.586076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.585927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-metrics-certs\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.586076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.585964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed8a4d0-4f1b-429b-83b0-45b603060112-openshift-service-ca\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.586076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.586059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmfcf\" (UniqueName: \"kubernetes.io/projected/5ed8a4d0-4f1b-429b-83b0-45b603060112-kube-api-access-nmfcf\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.686579 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.686549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-maas-api-tls\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.686579 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.686580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-metrics-certs\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.686795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.686608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed8a4d0-4f1b-429b-83b0-45b603060112-openshift-service-ca\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.686795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.686655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmfcf\" (UniqueName: \"kubernetes.io/projected/5ed8a4d0-4f1b-429b-83b0-45b603060112-kube-api-access-nmfcf\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.687339 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.687314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed8a4d0-4f1b-429b-83b0-45b603060112-openshift-service-ca\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.689067 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.689043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-maas-api-tls\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.689155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.689078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-metrics-certs\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.694879 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.694859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmfcf\" (UniqueName: \"kubernetes.io/projected/5ed8a4d0-4f1b-429b-83b0-45b603060112-kube-api-access-nmfcf\") pod \"maas-api-78cdb675f8-7nvnf\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") " pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:06.839601 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:06.839521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:07.121970 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.121897    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"]
Sep 11 12:37:07.125488 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.125470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.128340 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.128319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wj8cl\""
Sep 11 12:37:07.128899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.128881    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 12:37:07.134995 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.134959    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"]
Sep 11 12:37:07.138561 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:37:07.138537    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed8a4d0_4f1b_429b_83b0_45b603060112.slice/crio-cc35d5fbab4f8dc9c41e1778b727a9410698e68f35914cdac5f8f6ce30bc8c60 WatchSource:0}: Error finding container cc35d5fbab4f8dc9c41e1778b727a9410698e68f35914cdac5f8f6ce30bc8c60: Status 404 returned error can't find the container with id cc35d5fbab4f8dc9c41e1778b727a9410698e68f35914cdac5f8f6ce30bc8c60
Sep 11 12:37:07.138854 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.138834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"]
Sep 11 12:37:07.191759 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.191726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45tjf\" (UniqueName: \"kubernetes.io/projected/c5319f2a-4387-49f5-93a8-e76154944cc3-kube-api-access-45tjf\") pod \"payload-pre-processing-59fbc47bf8-kwsw6\" (UID: \"c5319f2a-4387-49f5-93a8-e76154944cc3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.191925 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.191786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5319f2a-4387-49f5-93a8-e76154944cc3-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kwsw6\" (UID: \"c5319f2a-4387-49f5-93a8-e76154944cc3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.293252 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.293212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5319f2a-4387-49f5-93a8-e76154944cc3-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kwsw6\" (UID: \"c5319f2a-4387-49f5-93a8-e76154944cc3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.293434 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.293283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45tjf\" (UniqueName: \"kubernetes.io/projected/c5319f2a-4387-49f5-93a8-e76154944cc3-kube-api-access-45tjf\") pod \"payload-pre-processing-59fbc47bf8-kwsw6\" (UID: \"c5319f2a-4387-49f5-93a8-e76154944cc3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.294007 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.293984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5319f2a-4387-49f5-93a8-e76154944cc3-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kwsw6\" (UID: \"c5319f2a-4387-49f5-93a8-e76154944cc3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.301992 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.301967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45tjf\" (UniqueName: \"kubernetes.io/projected/c5319f2a-4387-49f5-93a8-e76154944cc3-kube-api-access-45tjf\") pod \"payload-pre-processing-59fbc47bf8-kwsw6\" (UID: \"c5319f2a-4387-49f5-93a8-e76154944cc3\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.438648 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.438613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:07.622285 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.622243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf" event={"ID":"5ed8a4d0-4f1b-429b-83b0-45b603060112","Type":"ContainerStarted","Data":"cc35d5fbab4f8dc9c41e1778b727a9410698e68f35914cdac5f8f6ce30bc8c60"}
Sep 11 12:37:07.715758 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:07.715649    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"]
Sep 11 12:37:07.718557 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:37:07.718532    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5319f2a_4387_49f5_93a8_e76154944cc3.slice/crio-b37bd2f931541a315b68c12a8547a703c7ed9d54eb8b6ce742447645eb049a4c WatchSource:0}: Error finding container b37bd2f931541a315b68c12a8547a703c7ed9d54eb8b6ce742447645eb049a4c: Status 404 returned error can't find the container with id b37bd2f931541a315b68c12a8547a703c7ed9d54eb8b6ce742447645eb049a4c
Sep 11 12:37:08.634222 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:08.634150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6" event={"ID":"c5319f2a-4387-49f5-93a8-e76154944cc3","Type":"ContainerStarted","Data":"b37bd2f931541a315b68c12a8547a703c7ed9d54eb8b6ce742447645eb049a4c"}
Sep 11 12:37:09.640629 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:09.640591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6" event={"ID":"c5319f2a-4387-49f5-93a8-e76154944cc3","Type":"ContainerStarted","Data":"1ff86673a13330b505dee86750f188735a77bd4995a6d1b0292b14e8ed5abfba"}
Sep 11 12:37:09.641144 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:09.640728    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:09.642294 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:09.642267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf" event={"ID":"5ed8a4d0-4f1b-429b-83b0-45b603060112","Type":"ContainerStarted","Data":"cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e"}
Sep 11 12:37:09.642424 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:09.642412    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:09.659063 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:09.659017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6" podStartSLOduration=0.953424385 podStartE2EDuration="2.659001443s" totalImagesPullingTime="1.705577058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:37:09.658323232 +0000 UTC m=+630.371326284" watchObservedRunningTime="2026-09-11 12:37:09.659001443 +0000 UTC m=+630.372004525"
Sep 11 12:37:09.681187 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:09.681095    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf" podStartSLOduration=1.401375716 podStartE2EDuration="3.681078825s" totalImagesPullingTime="2.279703109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:37:09.679633242 +0000 UTC m=+630.392636270" watchObservedRunningTime="2026-09-11 12:37:09.681078825 +0000 UTC m=+630.394081862"
Sep 11 12:37:15.652012 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:15.651975    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 12:37:20.649318 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:20.649286    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kwsw6"
Sep 11 12:37:29.786803 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.786769    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"]
Sep 11 12:37:29.790266 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.790247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.793767 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.793742    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-67t6s\""
Sep 11 12:37:29.794676 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.794661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 12:37:29.795411 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.795390    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 12:37:29.795509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.795397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 12:37:29.805221 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.805199    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"]
Sep 11 12:37:29.809733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.809710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.809866 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.809761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.809866 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.809791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9qgx\" (UniqueName: \"kubernetes.io/projected/69679f84-6f92-44b0-b764-741178b1073a-kube-api-access-f9qgx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.809866 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.809822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.809995 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.809926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.810089 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.809994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69679f84-6f92-44b0-b764-741178b1073a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.910902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.910866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.910914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.910941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9qgx\" (UniqueName: \"kubernetes.io/projected/69679f84-6f92-44b0-b764-741178b1073a-kube-api-access-f9qgx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.910972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911266 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.911137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911266 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.911210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69679f84-6f92-44b0-b764-741178b1073a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.911327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911449 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.911356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.911515 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.911496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.913279 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.913258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69679f84-6f92-44b0-b764-741178b1073a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.913760 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.913735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69679f84-6f92-44b0-b764-741178b1073a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:29.921212 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:29.921187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9qgx\" (UniqueName: \"kubernetes.io/projected/69679f84-6f92-44b0-b764-741178b1073a-kube-api-access-f9qgx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42\" (UID: \"69679f84-6f92-44b0-b764-741178b1073a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:30.103812 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:30.103722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:30.376392 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:30.376346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"]
Sep 11 12:37:30.378505 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:37:30.378475    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69679f84_6f92_44b0_b764_741178b1073a.slice/crio-daec4eac4ad3577c825240e2d1438e54c6661cc17bca4eef1b83725bc239f35b WatchSource:0}: Error finding container daec4eac4ad3577c825240e2d1438e54c6661cc17bca4eef1b83725bc239f35b: Status 404 returned error can't find the container with id daec4eac4ad3577c825240e2d1438e54c6661cc17bca4eef1b83725bc239f35b
Sep 11 12:37:30.379859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:30.379842    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:37:30.749520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:30.749478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42" event={"ID":"69679f84-6f92-44b0-b764-741178b1073a","Type":"ContainerStarted","Data":"daec4eac4ad3577c825240e2d1438e54c6661cc17bca4eef1b83725bc239f35b"}
Sep 11 12:37:31.756532 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:31.756433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42" event={"ID":"69679f84-6f92-44b0-b764-741178b1073a","Type":"ContainerStarted","Data":"26b20303ea6f38d3066eec0320bb3490437cf3000335b7680bf5b865732fae4d"}
Sep 11 12:37:31.777829 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:31.777772    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42" podStartSLOduration=1.7021315320000001 podStartE2EDuration="2.777754691s" totalImagesPullingTime="1.075623159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:37:31.776781207 +0000 UTC m=+652.489784245" watchObservedRunningTime="2026-09-11 12:37:31.777754691 +0000 UTC m=+652.490757728"
Sep 11 12:37:40.104323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:40.104224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:40.104323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:40.104290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:40.116937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:40.116907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:40.809297 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:40.809265    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42"
Sep 11 12:37:42.973618 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:42.973581    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"]
Sep 11 12:37:42.982170 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:42.982146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:42.985035 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:42.985009    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 12:37:42.991130 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:42.991101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"]
Sep 11 12:37:43.032576 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.032541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.032751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.032580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sx4z\" (UniqueName: \"kubernetes.io/projected/63d30551-c232-4cf4-9921-afe1f510aad9-kube-api-access-9sx4z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.032751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.032603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.032751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.032666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63d30551-c232-4cf4-9921-afe1f510aad9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.032751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.032702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.032751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.032722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.133955 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.133914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.133955 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.133954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sx4z\" (UniqueName: \"kubernetes.io/projected/63d30551-c232-4cf4-9921-afe1f510aad9-kube-api-access-9sx4z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.133989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.134036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63d30551-c232-4cf4-9921-afe1f510aad9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.134092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.134125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134657 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.134550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134805 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.134779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.134892 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.134873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.136728 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.136700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63d30551-c232-4cf4-9921-afe1f510aad9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.136902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.136879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63d30551-c232-4cf4-9921-afe1f510aad9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.145295 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.145272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sx4z\" (UniqueName: \"kubernetes.io/projected/63d30551-c232-4cf4-9921-afe1f510aad9-kube-api-access-9sx4z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4vf9h\" (UID: \"63d30551-c232-4cf4-9921-afe1f510aad9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.293160 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.293063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:43.569934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.569895    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"]
Sep 11 12:37:43.571855 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:37:43.571826    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d30551_c232_4cf4_9921_afe1f510aad9.slice/crio-6ccd002004823663897bd2bff920b028bebf7b519747c6a1bd03940131304ecf WatchSource:0}: Error finding container 6ccd002004823663897bd2bff920b028bebf7b519747c6a1bd03940131304ecf: Status 404 returned error can't find the container with id 6ccd002004823663897bd2bff920b028bebf7b519747c6a1bd03940131304ecf
Sep 11 12:37:43.812911 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:43.812881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h" event={"ID":"63d30551-c232-4cf4-9921-afe1f510aad9","Type":"ContainerStarted","Data":"6ccd002004823663897bd2bff920b028bebf7b519747c6a1bd03940131304ecf"}
Sep 11 12:37:44.819439 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:44.819404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h" event={"ID":"63d30551-c232-4cf4-9921-afe1f510aad9","Type":"ContainerStarted","Data":"4658b59ead1c4662777c2bc32ed97dbfe16d243a6e0796b07b8bacc0e36b48fb"}
Sep 11 12:37:44.841827 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:44.841724    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h" podStartSLOduration=2.625706717 podStartE2EDuration="2.841700544s" totalImagesPullingTime="215.993827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:37:44.837714813 +0000 UTC m=+665.550717850" watchObservedRunningTime="2026-09-11 12:37:44.841700544 +0000 UTC m=+665.554703582"
Sep 11 12:37:53.293512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:53.293473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:53.293971 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:53.293544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:53.305899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:53.305869    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:37:53.872518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:37:53.872489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4vf9h"
Sep 11 12:38:26.988949 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:26.988913    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"]
Sep 11 12:38:26.992757 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:26.992735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:26.996355 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:26.996333    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 12:38:27.003173 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.003151    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"]
Sep 11 12:38:27.050297 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.050262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.050479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.050307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.050479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.050424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.050479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.050443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce89ad9a-a151-47ed-a5de-74b03a973128-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.050479 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.050473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84kns\" (UniqueName: \"kubernetes.io/projected/ce89ad9a-a151-47ed-a5de-74b03a973128-kube-api-access-84kns\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.050654 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.050545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151235 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151235 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce89ad9a-a151-47ed-a5de-74b03a973128-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84kns\" (UniqueName: \"kubernetes.io/projected/ce89ad9a-a151-47ed-a5de-74b03a973128-kube-api-access-84kns\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151756 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151896 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.151952 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.151904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.153737 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.153710    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce89ad9a-a151-47ed-a5de-74b03a973128-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.154176 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.154154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce89ad9a-a151-47ed-a5de-74b03a973128-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.160113 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.160091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84kns\" (UniqueName: \"kubernetes.io/projected/ce89ad9a-a151-47ed-a5de-74b03a973128-kube-api-access-84kns\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7r9tp\" (UID: \"ce89ad9a-a151-47ed-a5de-74b03a973128\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.304795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.304693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:27.581985 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:27.581963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"]
Sep 11 12:38:27.584181 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:38:27.584151    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce89ad9a_a151_47ed_a5de_74b03a973128.slice/crio-0db2bef2019390bbe365b6b9e0235e5194180168691db01d5d3717e013461c55 WatchSource:0}: Error finding container 0db2bef2019390bbe365b6b9e0235e5194180168691db01d5d3717e013461c55: Status 404 returned error can't find the container with id 0db2bef2019390bbe365b6b9e0235e5194180168691db01d5d3717e013461c55
Sep 11 12:38:28.027732 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:28.027701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp" event={"ID":"ce89ad9a-a151-47ed-a5de-74b03a973128","Type":"ContainerStarted","Data":"a94e1ded8558abdd7a743bcbe64b084e2352962beda0fd1dcc9a457f02b848a5"}
Sep 11 12:38:28.028093 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:28.027753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp" event={"ID":"ce89ad9a-a151-47ed-a5de-74b03a973128","Type":"ContainerStarted","Data":"0db2bef2019390bbe365b6b9e0235e5194180168691db01d5d3717e013461c55"}
Sep 11 12:38:28.048707 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:28.048659    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp" podStartSLOduration=1.84351965 podStartE2EDuration="2.048645418s" totalImagesPullingTime="205.125768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:38:28.047059105 +0000 UTC m=+708.760062145" watchObservedRunningTime="2026-09-11 12:38:28.048645418 +0000 UTC m=+708.761648456"
Sep 11 12:38:37.305397 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:37.305293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:37.305831 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:37.305400    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:37.317870 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:37.317850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:38:38.087195 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:38:38.087164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7r9tp"
Sep 11 12:40:07.927659 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.927622    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"]
Sep 11 12:40:07.931195 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.931172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:07.935266 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.935237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-edce0b-serving-cert\""
Sep 11 12:40:07.945464 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.945440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"]
Sep 11 12:40:07.977064 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.977026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fkw9\" (UniqueName: \"kubernetes.io/projected/45e8cce2-9e90-402b-9940-fefb975a3c36-kube-api-access-2fkw9\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:07.977246 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.977134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:07.977246 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.977182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45e8cce2-9e90-402b-9940-fefb975a3c36-openshift-service-ca\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:07.977246 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:07.977234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-metrics-certs\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.078032 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.077993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fkw9\" (UniqueName: \"kubernetes.io/projected/45e8cce2-9e90-402b-9940-fefb975a3c36-kube-api-access-2fkw9\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.078234 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.078058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.078234 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.078090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45e8cce2-9e90-402b-9940-fefb975a3c36-openshift-service-ca\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.078234 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.078129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-metrics-certs\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.078839 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.078815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45e8cce2-9e90-402b-9940-fefb975a3c36-openshift-service-ca\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.080771 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.080747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-maas-api-tls\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.080771 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.080758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-metrics-certs\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.095032 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.095000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fkw9\" (UniqueName: \"kubernetes.io/projected/45e8cce2-9e90-402b-9940-fefb975a3c36-kube-api-access-2fkw9\") pod \"maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.242182 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.242104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:08.517040 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.517018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"]
Sep 11 12:40:08.519707 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:40:08.519677    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e8cce2_9e90_402b_9940_fefb975a3c36.slice/crio-d2f183de9f96c7ba772d499685c5a7e2a500e39c117075b4cbe215aa8852715e WatchSource:0}: Error finding container d2f183de9f96c7ba772d499685c5a7e2a500e39c117075b4cbe215aa8852715e: Status 404 returned error can't find the container with id d2f183de9f96c7ba772d499685c5a7e2a500e39c117075b4cbe215aa8852715e
Sep 11 12:40:08.735957 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.735919    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"]
Sep 11 12:40:08.741495 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.741472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:08.747171 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.747151    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-edce0b-dockercfg-n4mx5\""
Sep 11 12:40:08.748293 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.748270    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-edce0b\""
Sep 11 12:40:08.754023 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.753963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"]
Sep 11 12:40:08.785373 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.785290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4qzg\" (UniqueName: \"kubernetes.io/projected/23d75d73-4573-4fa2-89bf-fef6390f720b-kube-api-access-n4qzg\") pod \"payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:08.785373 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.785342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d75d73-4573-4fa2-89bf-fef6390f720b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:08.886807 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.886775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4qzg\" (UniqueName: \"kubernetes.io/projected/23d75d73-4573-4fa2-89bf-fef6390f720b-kube-api-access-n4qzg\") pod \"payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:08.886991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.886829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d75d73-4573-4fa2-89bf-fef6390f720b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:08.887839 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.887794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d75d73-4573-4fa2-89bf-fef6390f720b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:08.896580 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:08.896555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4qzg\" (UniqueName: \"kubernetes.io/projected/23d75d73-4573-4fa2-89bf-fef6390f720b-kube-api-access-n4qzg\") pod \"payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:09.053584 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.053509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:09.344349 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.344325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"]
Sep 11 12:40:09.346524 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:40:09.346496    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d75d73_4573_4fa2_89bf_fef6390f720b.slice/crio-5d3df6d4d8195d47815bbacef3e816b96108dc9f48523b823b134f0b7f5de6df WatchSource:0}: Error finding container 5d3df6d4d8195d47815bbacef3e816b96108dc9f48523b823b134f0b7f5de6df: Status 404 returned error can't find the container with id 5d3df6d4d8195d47815bbacef3e816b96108dc9f48523b823b134f0b7f5de6df
Sep 11 12:40:09.519721 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.519676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9" event={"ID":"45e8cce2-9e90-402b-9940-fefb975a3c36","Type":"ContainerStarted","Data":"4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f"}
Sep 11 12:40:09.519883 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.519739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9" event={"ID":"45e8cce2-9e90-402b-9940-fefb975a3c36","Type":"ContainerStarted","Data":"d2f183de9f96c7ba772d499685c5a7e2a500e39c117075b4cbe215aa8852715e"}
Sep 11 12:40:09.519883 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.519776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:09.521490 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.521466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6" event={"ID":"23d75d73-4573-4fa2-89bf-fef6390f720b","Type":"ContainerStarted","Data":"a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85"}
Sep 11 12:40:09.521594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.521510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:09.521594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.521527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6" event={"ID":"23d75d73-4573-4fa2-89bf-fef6390f720b","Type":"ContainerStarted","Data":"5d3df6d4d8195d47815bbacef3e816b96108dc9f48523b823b134f0b7f5de6df"}
Sep 11 12:40:09.540283 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.540230    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9" podStartSLOduration=1.9848101219999998 podStartE2EDuration="2.540211226s" totalImagesPullingTime="555.401104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:09.537125509 +0000 UTC m=+810.250128559" watchObservedRunningTime="2026-09-11 12:40:09.540211226 +0000 UTC m=+810.253214267"
Sep 11 12:40:09.554714 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:09.554670    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6" podStartSLOduration=1.554655917 podStartE2EDuration="1.554655917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:09.553909463 +0000 UTC m=+810.266912501" watchObservedRunningTime="2026-09-11 12:40:09.554655917 +0000 UTC m=+810.267658956"
Sep 11 12:40:15.526304 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.526268    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"]
Sep 11 12:40:15.529994 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.529967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.532483 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.532460    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:40:15.533086 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.533059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0d7de9d8-serving-cert\""
Sep 11 12:40:15.544491 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.544469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"]
Sep 11 12:40:15.648955 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.648907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc844c-f096-41fd-8703-55d362d032da-openshift-service-ca\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.649133 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.649057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d486r\" (UniqueName: \"kubernetes.io/projected/28cc844c-f096-41fd-8703-55d362d032da-kube-api-access-d486r\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.649133 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.649084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-metrics-certs\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.649502 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.649475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-maas-api-tls\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.750094 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.750046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d486r\" (UniqueName: \"kubernetes.io/projected/28cc844c-f096-41fd-8703-55d362d032da-kube-api-access-d486r\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.750283 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.750117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-metrics-certs\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.750283 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.750243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-maas-api-tls\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.750443 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.750322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc844c-f096-41fd-8703-55d362d032da-openshift-service-ca\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.751157 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.751129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc844c-f096-41fd-8703-55d362d032da-openshift-service-ca\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.753783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.753194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-metrics-certs\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.754843 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.754817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-maas-api-tls\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.763484 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.763456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d486r\" (UniqueName: \"kubernetes.io/projected/28cc844c-f096-41fd-8703-55d362d032da-kube-api-access-d486r\") pod \"maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:15.843169 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:15.843071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:16.136083 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:16.136041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"]
Sep 11 12:40:16.142598 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:40:16.142572    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cc844c_f096_41fd_8703_55d362d032da.slice/crio-a730c53326e0967118285eda14dbe3e5cf8ae4457e8c99eee35816e1b78050ec WatchSource:0}: Error finding container a730c53326e0967118285eda14dbe3e5cf8ae4457e8c99eee35816e1b78050ec: Status 404 returned error can't find the container with id a730c53326e0967118285eda14dbe3e5cf8ae4457e8c99eee35816e1b78050ec
Sep 11 12:40:16.560238 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:16.560202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4" event={"ID":"28cc844c-f096-41fd-8703-55d362d032da","Type":"ContainerStarted","Data":"a730c53326e0967118285eda14dbe3e5cf8ae4457e8c99eee35816e1b78050ec"}
Sep 11 12:40:17.505649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.505611    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"]
Sep 11 12:40:17.509471 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.509449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.521216 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.521194    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-9878a9-serving-cert\""
Sep 11 12:40:17.532493 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.532467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"]
Sep 11 12:40:17.569614 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.569570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4" event={"ID":"28cc844c-f096-41fd-8703-55d362d032da","Type":"ContainerStarted","Data":"8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66"}
Sep 11 12:40:17.569967 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.569720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:17.572298 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.572276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf2lf\" (UniqueName: \"kubernetes.io/projected/ecdf65b3-3b98-443e-a864-7696542a8c50-kube-api-access-rf2lf\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.572355 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.572326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.572430 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.572381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-metrics-certs\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.572476 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.572426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecdf65b3-3b98-443e-a864-7696542a8c50-openshift-service-ca\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.644337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.644289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4" podStartSLOduration=2.27421276 podStartE2EDuration="2.644273438s" totalImagesPullingTime="370.060678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:17.642969813 +0000 UTC m=+818.355972852" watchObservedRunningTime="2026-09-11 12:40:17.644273438 +0000 UTC m=+818.357276476"
Sep 11 12:40:17.673601 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.673565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecdf65b3-3b98-443e-a864-7696542a8c50-openshift-service-ca\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.673768 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.673677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf2lf\" (UniqueName: \"kubernetes.io/projected/ecdf65b3-3b98-443e-a864-7696542a8c50-kube-api-access-rf2lf\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.673768 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.673731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.673912 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.673859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-metrics-certs\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.674059 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:40:17.674040    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-serving-cert: secret "maas-api-e2e-autores-9878a9-serving-cert" not found
Sep 11 12:40:17.674149 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:40:17.674093    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls podName:ecdf65b3-3b98-443e-a864-7696542a8c50 nodeName:}" failed. No retries permitted until 2026-09-11 12:40:18.17407834 +0000 UTC m=+818.887081356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls") pod "maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" (UID: "ecdf65b3-3b98-443e-a864-7696542a8c50") : secret "maas-api-e2e-autores-9878a9-serving-cert" not found
Sep 11 12:40:17.674490 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.674465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecdf65b3-3b98-443e-a864-7696542a8c50-openshift-service-ca\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.676448 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.676428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-metrics-certs\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:17.689211 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:17.689185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf2lf\" (UniqueName: \"kubernetes.io/projected/ecdf65b3-3b98-443e-a864-7696542a8c50-kube-api-access-rf2lf\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:18.180140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:18.180106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:18.182750 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:18.182725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls\") pod \"maas-api-e2e-autores-9878a9-7cf94d994b-msvtm\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:18.419850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:18.419815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:18.702043 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:18.702021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"]
Sep 11 12:40:18.703958 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:40:18.703929    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdf65b3_3b98_443e_a864_7696542a8c50.slice/crio-a007ea07c45cff1d323636ffe8f289013aff97b794740c7bda7d8e41cb1c1dd9 WatchSource:0}: Error finding container a007ea07c45cff1d323636ffe8f289013aff97b794740c7bda7d8e41cb1c1dd9: Status 404 returned error can't find the container with id a007ea07c45cff1d323636ffe8f289013aff97b794740c7bda7d8e41cb1c1dd9
Sep 11 12:40:19.581531 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:19.581494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" event={"ID":"ecdf65b3-3b98-443e-a864-7696542a8c50","Type":"ContainerStarted","Data":"4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299"}
Sep 11 12:40:19.581831 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:19.581803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" event={"ID":"ecdf65b3-3b98-443e-a864-7696542a8c50","Type":"ContainerStarted","Data":"a007ea07c45cff1d323636ffe8f289013aff97b794740c7bda7d8e41cb1c1dd9"}
Sep 11 12:40:19.582252 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:19.582231    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:19.602009 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:19.601965    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" podStartSLOduration=2.177078165 podStartE2EDuration="2.601950676s" totalImagesPullingTime="424.872511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:19.601088804 +0000 UTC m=+820.314091843" watchObservedRunningTime="2026-09-11 12:40:19.601950676 +0000 UTC m=+820.314953713"
Sep 11 12:40:20.528866 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:20.528835    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:40:23.580807 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:23.580779    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:40:25.592375 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:25.592334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:40:37.421420 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.421386    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"]
Sep 11 12:40:37.425164 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.425143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.428761 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.428741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f06aba-serving-cert\""
Sep 11 12:40:37.442116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.442096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"]
Sep 11 12:40:37.571269 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.571219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vs4\" (UniqueName: \"kubernetes.io/projected/86d566e1-8ef3-4d2d-8960-0ab391d76811-kube-api-access-62vs4\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.571269 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.571274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-metrics-certs\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.571544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.571378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d566e1-8ef3-4d2d-8960-0ab391d76811-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.571544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.571520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-maas-api-tls\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.672643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.672526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d566e1-8ef3-4d2d-8960-0ab391d76811-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.672809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.672662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-maas-api-tls\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.672809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.672688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vs4\" (UniqueName: \"kubernetes.io/projected/86d566e1-8ef3-4d2d-8960-0ab391d76811-kube-api-access-62vs4\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.672809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.672709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-metrics-certs\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.673252 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.673226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d566e1-8ef3-4d2d-8960-0ab391d76811-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.675091 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.675070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-metrics-certs\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.675325 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.675307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-maas-api-tls\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.685321 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.685295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vs4\" (UniqueName: \"kubernetes.io/projected/86d566e1-8ef3-4d2d-8960-0ab391d76811-kube-api-access-62vs4\") pod \"maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:37.736401 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:37.736353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:38.016564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.016535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"]
Sep 11 12:40:38.017975 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:40:38.017948    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d566e1_8ef3_4d2d_8960_0ab391d76811.slice/crio-2d71ac37ac1aad1c3a28f00bba1ed8f619400436394d1afc179f38c7730c0f4d WatchSource:0}: Error finding container 2d71ac37ac1aad1c3a28f00bba1ed8f619400436394d1afc179f38c7730c0f4d: Status 404 returned error can't find the container with id 2d71ac37ac1aad1c3a28f00bba1ed8f619400436394d1afc179f38c7730c0f4d
Sep 11 12:40:38.493326 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.493298    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"]
Sep 11 12:40:38.497597 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.497582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:38.500859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.500834    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-f06aba\""
Sep 11 12:40:38.501211 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.501194    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-f06aba-dockercfg-q9vst\""
Sep 11 12:40:38.510857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.510832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"]
Sep 11 12:40:38.683622 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.683592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d136e872-95f1-4380-9f2d-1d70952080e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:38.683818 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.683783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khtkh\" (UniqueName: \"kubernetes.io/projected/d136e872-95f1-4380-9f2d-1d70952080e8-kube-api-access-khtkh\") pod \"payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:38.689740 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.689716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9" event={"ID":"86d566e1-8ef3-4d2d-8960-0ab391d76811","Type":"ContainerStarted","Data":"5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3"}
Sep 11 12:40:38.689883 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.689759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9" event={"ID":"86d566e1-8ef3-4d2d-8960-0ab391d76811","Type":"ContainerStarted","Data":"2d71ac37ac1aad1c3a28f00bba1ed8f619400436394d1afc179f38c7730c0f4d"}
Sep 11 12:40:38.689883 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.689863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:38.720135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.720085    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9" podStartSLOduration=1.247080899 podStartE2EDuration="1.720066492s" totalImagesPullingTime="472.985593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:38.718724845 +0000 UTC m=+839.431727883" watchObservedRunningTime="2026-09-11 12:40:38.720066492 +0000 UTC m=+839.433069531"
Sep 11 12:40:38.784790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.784720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khtkh\" (UniqueName: \"kubernetes.io/projected/d136e872-95f1-4380-9f2d-1d70952080e8-kube-api-access-khtkh\") pod \"payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:38.785036 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.785015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d136e872-95f1-4380-9f2d-1d70952080e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:38.785701 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.785684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d136e872-95f1-4380-9f2d-1d70952080e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:38.811988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:38.811962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khtkh\" (UniqueName: \"kubernetes.io/projected/d136e872-95f1-4380-9f2d-1d70952080e8-kube-api-access-khtkh\") pod \"payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:39.111966 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:39.111883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:39.386500 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:39.386476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"]
Sep 11 12:40:39.388276 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:40:39.388245    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd136e872_95f1_4380_9f2d_1d70952080e8.slice/crio-e494d136ae46e99ea08061c5d28f0ac1bff952dc309a4b915514ac5a6c00df68 WatchSource:0}: Error finding container e494d136ae46e99ea08061c5d28f0ac1bff952dc309a4b915514ac5a6c00df68: Status 404 returned error can't find the container with id e494d136ae46e99ea08061c5d28f0ac1bff952dc309a4b915514ac5a6c00df68
Sep 11 12:40:39.696556 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:39.696520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj" event={"ID":"d136e872-95f1-4380-9f2d-1d70952080e8","Type":"ContainerStarted","Data":"e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7"}
Sep 11 12:40:39.697005 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:39.696582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj" event={"ID":"d136e872-95f1-4380-9f2d-1d70952080e8","Type":"ContainerStarted","Data":"e494d136ae46e99ea08061c5d28f0ac1bff952dc309a4b915514ac5a6c00df68"}
Sep 11 12:40:39.697005 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:39.696764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:40:39.719134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:39.719091    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj" podStartSLOduration=1.7190750540000002 podStartE2EDuration="1.719075054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:40:39.717249291 +0000 UTC m=+840.430252332" watchObservedRunningTime="2026-09-11 12:40:39.719075054 +0000 UTC m=+840.432078092"
Sep 11 12:40:44.702977 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:44.702947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:40:50.704301 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:40:50.704269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:41:16.398231 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.398194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"]
Sep 11 12:41:16.399198 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.399130    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4" podUID="28cc844c-f096-41fd-8703-55d362d032da" containerName="maas-api" containerID="cri-o://8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66" gracePeriod=30
Sep 11 12:41:16.649312 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.649252    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:41:16.759725 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.759691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-maas-api-tls\") pod \"28cc844c-f096-41fd-8703-55d362d032da\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") "
Sep 11 12:41:16.759917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.759761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d486r\" (UniqueName: \"kubernetes.io/projected/28cc844c-f096-41fd-8703-55d362d032da-kube-api-access-d486r\") pod \"28cc844c-f096-41fd-8703-55d362d032da\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") "
Sep 11 12:41:16.759917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.759853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-metrics-certs\") pod \"28cc844c-f096-41fd-8703-55d362d032da\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") "
Sep 11 12:41:16.759917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.759908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc844c-f096-41fd-8703-55d362d032da-openshift-service-ca\") pod \"28cc844c-f096-41fd-8703-55d362d032da\" (UID: \"28cc844c-f096-41fd-8703-55d362d032da\") "
Sep 11 12:41:16.760602 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.760548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28cc844c-f096-41fd-8703-55d362d032da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28cc844c-f096-41fd-8703-55d362d032da" (UID: "28cc844c-f096-41fd-8703-55d362d032da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:16.762585 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.762557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28cc844c-f096-41fd-8703-55d362d032da-kube-api-access-d486r" (OuterVolumeSpecName: "kube-api-access-d486r") pod "28cc844c-f096-41fd-8703-55d362d032da" (UID: "28cc844c-f096-41fd-8703-55d362d032da"). InnerVolumeSpecName "kube-api-access-d486r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:16.763727 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.763697    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "28cc844c-f096-41fd-8703-55d362d032da" (UID: "28cc844c-f096-41fd-8703-55d362d032da"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:41:16.763810 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.763750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28cc844c-f096-41fd-8703-55d362d032da" (UID: "28cc844c-f096-41fd-8703-55d362d032da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:41:16.861566 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.861523    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc844c-f096-41fd-8703-55d362d032da-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:16.861566 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.861556    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:16.861566 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.861567    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d486r\" (UniqueName: \"kubernetes.io/projected/28cc844c-f096-41fd-8703-55d362d032da-kube-api-access-d486r\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:16.861566 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.861575    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28cc844c-f096-41fd-8703-55d362d032da-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:16.897612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.897575    2563 generic.go:356] "Generic (PLEG): container finished" podID="28cc844c-f096-41fd-8703-55d362d032da" containerID="8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66" exitCode=0
Sep 11 12:41:16.897783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.897625    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"
Sep 11 12:41:16.897783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.897645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4" event={"ID":"28cc844c-f096-41fd-8703-55d362d032da","Type":"ContainerDied","Data":"8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66"}
Sep 11 12:41:16.897783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.897706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4" event={"ID":"28cc844c-f096-41fd-8703-55d362d032da","Type":"ContainerDied","Data":"a730c53326e0967118285eda14dbe3e5cf8ae4457e8c99eee35816e1b78050ec"}
Sep 11 12:41:16.897783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.897731    2563 scope.go:117] "RemoveContainer" containerID="8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66"
Sep 11 12:41:16.908331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.908312    2563 scope.go:117] "RemoveContainer" containerID="8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66"
Sep 11 12:41:16.908642 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:41:16.908622    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66\": container with ID starting with 8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66 not found: ID does not exist" containerID="8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66"
Sep 11 12:41:16.908692 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.908652    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66"} err="failed to get container status \"8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66\": rpc error: code = NotFound desc = could not find container \"8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66\": container with ID starting with 8270998d726e5094cbcc652e85203e675c3d4ba594d9ba5cfb20165f7eeafc66 not found: ID does not exist"
Sep 11 12:41:16.924115 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.924084    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"]
Sep 11 12:41:16.929189 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:16.929163    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0d7de9d8-6c5dcdbc5b-qhsp4"]
Sep 11 12:41:17.807631 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:17.807184    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28cc844c-f096-41fd-8703-55d362d032da" path="/var/lib/kubelet/pods/28cc844c-f096-41fd-8703-55d362d032da/volumes"
Sep 11 12:41:20.119224 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.119192    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"]
Sep 11 12:41:20.119658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.119644    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28cc844c-f096-41fd-8703-55d362d032da" containerName="maas-api"
Sep 11 12:41:20.119658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.119659    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28cc844c-f096-41fd-8703-55d362d032da" containerName="maas-api"
Sep 11 12:41:20.119751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.119741    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28cc844c-f096-41fd-8703-55d362d032da" containerName="maas-api"
Sep 11 12:41:20.123323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.123308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.126981 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.126958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-47131dfa-serving-cert\""
Sep 11 12:41:20.139323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.139296    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"]
Sep 11 12:41:20.196115 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.196067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ec612b-488a-48e9-a482-a8964c03354f-openshift-service-ca\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.196287 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.196157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-metrics-certs\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.196287 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.196240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmv9\" (UniqueName: \"kubernetes.io/projected/70ec612b-488a-48e9-a482-a8964c03354f-kube-api-access-9qmv9\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.196471 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.196293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-maas-api-tls\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.297450 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.297418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ec612b-488a-48e9-a482-a8964c03354f-openshift-service-ca\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.297614 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.297482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-metrics-certs\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.297614 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.297543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmv9\" (UniqueName: \"kubernetes.io/projected/70ec612b-488a-48e9-a482-a8964c03354f-kube-api-access-9qmv9\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.297614 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.297574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-maas-api-tls\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.298053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.298026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ec612b-488a-48e9-a482-a8964c03354f-openshift-service-ca\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.299936 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.299911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-metrics-certs\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.300051 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.300038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-maas-api-tls\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.306467 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.306440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmv9\" (UniqueName: \"kubernetes.io/projected/70ec612b-488a-48e9-a482-a8964c03354f-kube-api-access-9qmv9\") pod \"maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.433945 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.433914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:20.711991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.711963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"]
Sep 11 12:41:20.714093 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:41:20.714067    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ec612b_488a_48e9_a482_a8964c03354f.slice/crio-8e5d2973e8d6124257935a607681e63df61033909e1b43746144d580cdde85a6 WatchSource:0}: Error finding container 8e5d2973e8d6124257935a607681e63df61033909e1b43746144d580cdde85a6: Status 404 returned error can't find the container with id 8e5d2973e8d6124257935a607681e63df61033909e1b43746144d580cdde85a6
Sep 11 12:41:20.919176 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.919145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl" event={"ID":"70ec612b-488a-48e9-a482-a8964c03354f","Type":"ContainerStarted","Data":"8e5d2973e8d6124257935a607681e63df61033909e1b43746144d580cdde85a6"}
Sep 11 12:41:20.947509 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.947482    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"]
Sep 11 12:41:20.952512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.952490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:20.955328 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.955307    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-47131dfa-dockercfg-zh9sl\""
Sep 11 12:41:20.955440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.955393    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-47131dfa\""
Sep 11 12:41:20.960682 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:20.960628    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"]
Sep 11 12:41:21.003377 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.003326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9ftg\" (UniqueName: \"kubernetes.io/projected/158f7b34-e699-485d-aa58-4af9bb985c56-kube-api-access-m9ftg\") pod \"payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") " pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.003559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.003472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158f7b34-e699-485d-aa58-4af9bb985c56-plugins-config-volume\") pod \"payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") " pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.104798 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.104756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158f7b34-e699-485d-aa58-4af9bb985c56-plugins-config-volume\") pod \"payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") " pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.104974 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.104862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9ftg\" (UniqueName: \"kubernetes.io/projected/158f7b34-e699-485d-aa58-4af9bb985c56-kube-api-access-m9ftg\") pod \"payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") " pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.105504 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.105485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158f7b34-e699-485d-aa58-4af9bb985c56-plugins-config-volume\") pod \"payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") " pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.113517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.113488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9ftg\" (UniqueName: \"kubernetes.io/projected/158f7b34-e699-485d-aa58-4af9bb985c56-kube-api-access-m9ftg\") pod \"payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") " pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.264994 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.264897    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.545218 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.545194    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"]
Sep 11 12:41:21.547286 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:41:21.547261    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158f7b34_e699_485d_aa58_4af9bb985c56.slice/crio-8428f957c68bea7da5007597ad68a53d058d7e6cb2a77fe1cacef22674f98046 WatchSource:0}: Error finding container 8428f957c68bea7da5007597ad68a53d058d7e6cb2a77fe1cacef22674f98046: Status 404 returned error can't find the container with id 8428f957c68bea7da5007597ad68a53d058d7e6cb2a77fe1cacef22674f98046
Sep 11 12:41:21.925390 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.925333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj" event={"ID":"158f7b34-e699-485d-aa58-4af9bb985c56","Type":"ContainerStarted","Data":"2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b"}
Sep 11 12:41:21.925588 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.925423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:21.925588 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.925452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj" event={"ID":"158f7b34-e699-485d-aa58-4af9bb985c56","Type":"ContainerStarted","Data":"8428f957c68bea7da5007597ad68a53d058d7e6cb2a77fe1cacef22674f98046"}
Sep 11 12:41:21.926998 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.926976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl" event={"ID":"70ec612b-488a-48e9-a482-a8964c03354f","Type":"ContainerStarted","Data":"6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0"}
Sep 11 12:41:21.927105 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.927044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:21.946856 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.946813    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj" podStartSLOduration=1.946798477 podStartE2EDuration="1.946798477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:21.945765188 +0000 UTC m=+882.658768238" watchObservedRunningTime="2026-09-11 12:41:21.946798477 +0000 UTC m=+882.659801514"
Sep 11 12:41:21.967807 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:21.967763    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl" podStartSLOduration=1.539881296 podStartE2EDuration="1.967747639s" totalImagesPullingTime="427.866343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:21.965838229 +0000 UTC m=+882.678841267" watchObservedRunningTime="2026-09-11 12:41:21.967747639 +0000 UTC m=+882.680750677"
Sep 11 12:41:27.938291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:27.938259    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:32.935254 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:32.935157    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:39.800833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:39.800801    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:41:39.802173 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:39.802138    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:41:39.805112 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:39.805091    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:41:39.806434 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:39.806413    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:41:51.494726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.494689    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"]
Sep 11 12:41:51.495348 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.494933    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl" podUID="70ec612b-488a-48e9-a482-a8964c03354f" containerName="maas-api" containerID="cri-o://6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0" gracePeriod=30
Sep 11 12:41:51.550094 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.550063    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"]
Sep 11 12:41:51.550320 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.550294    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj" podUID="158f7b34-e699-485d-aa58-4af9bb985c56" containerName="payload-processing" containerID="cri-o://2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b" gracePeriod=30
Sep 11 12:41:51.809471 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.809444    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:51.840635 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.840612    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:51.918135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.918103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qmv9\" (UniqueName: \"kubernetes.io/projected/70ec612b-488a-48e9-a482-a8964c03354f-kube-api-access-9qmv9\") pod \"70ec612b-488a-48e9-a482-a8964c03354f\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") "
Sep 11 12:41:51.918310 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.918198    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-metrics-certs\") pod \"70ec612b-488a-48e9-a482-a8964c03354f\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") "
Sep 11 12:41:51.918310 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.918254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ec612b-488a-48e9-a482-a8964c03354f-openshift-service-ca\") pod \"70ec612b-488a-48e9-a482-a8964c03354f\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") "
Sep 11 12:41:51.918310 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.918292    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-maas-api-tls\") pod \"70ec612b-488a-48e9-a482-a8964c03354f\" (UID: \"70ec612b-488a-48e9-a482-a8964c03354f\") "
Sep 11 12:41:51.918619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.918595    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70ec612b-488a-48e9-a482-a8964c03354f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70ec612b-488a-48e9-a482-a8964c03354f" (UID: "70ec612b-488a-48e9-a482-a8964c03354f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:51.918699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.918678    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70ec612b-488a-48e9-a482-a8964c03354f-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:51.920300 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.920270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "70ec612b-488a-48e9-a482-a8964c03354f" (UID: "70ec612b-488a-48e9-a482-a8964c03354f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:41:51.920793 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.920767    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70ec612b-488a-48e9-a482-a8964c03354f" (UID: "70ec612b-488a-48e9-a482-a8964c03354f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:41:51.920900 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:51.920768    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ec612b-488a-48e9-a482-a8964c03354f-kube-api-access-9qmv9" (OuterVolumeSpecName: "kube-api-access-9qmv9") pod "70ec612b-488a-48e9-a482-a8964c03354f" (UID: "70ec612b-488a-48e9-a482-a8964c03354f"). InnerVolumeSpecName "kube-api-access-9qmv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:52.022025 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.021950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158f7b34-e699-485d-aa58-4af9bb985c56-plugins-config-volume\") pod \"158f7b34-e699-485d-aa58-4af9bb985c56\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") "
Sep 11 12:41:52.022025 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.021999    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9ftg\" (UniqueName: \"kubernetes.io/projected/158f7b34-e699-485d-aa58-4af9bb985c56-kube-api-access-m9ftg\") pod \"158f7b34-e699-485d-aa58-4af9bb985c56\" (UID: \"158f7b34-e699-485d-aa58-4af9bb985c56\") "
Sep 11 12:41:52.022315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.022295    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qmv9\" (UniqueName: \"kubernetes.io/projected/70ec612b-488a-48e9-a482-a8964c03354f-kube-api-access-9qmv9\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:52.022315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.022314    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:52.022523 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.022323    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70ec612b-488a-48e9-a482-a8964c03354f-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:52.022523 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.022353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/158f7b34-e699-485d-aa58-4af9bb985c56-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "158f7b34-e699-485d-aa58-4af9bb985c56" (UID: "158f7b34-e699-485d-aa58-4af9bb985c56"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:41:52.024644 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.024599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158f7b34-e699-485d-aa58-4af9bb985c56-kube-api-access-m9ftg" (OuterVolumeSpecName: "kube-api-access-m9ftg") pod "158f7b34-e699-485d-aa58-4af9bb985c56" (UID: "158f7b34-e699-485d-aa58-4af9bb985c56"). InnerVolumeSpecName "kube-api-access-m9ftg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:41:52.083908 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.083874    2563 generic.go:356] "Generic (PLEG): container finished" podID="158f7b34-e699-485d-aa58-4af9bb985c56" containerID="2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b" exitCode=0
Sep 11 12:41:52.084076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.083923    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"
Sep 11 12:41:52.084076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.083962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj" event={"ID":"158f7b34-e699-485d-aa58-4af9bb985c56","Type":"ContainerDied","Data":"2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b"}
Sep 11 12:41:52.084076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.084016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj" event={"ID":"158f7b34-e699-485d-aa58-4af9bb985c56","Type":"ContainerDied","Data":"8428f957c68bea7da5007597ad68a53d058d7e6cb2a77fe1cacef22674f98046"}
Sep 11 12:41:52.084076 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.084037    2563 scope.go:117] "RemoveContainer" containerID="2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b"
Sep 11 12:41:52.085401 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.085374    2563 generic.go:356] "Generic (PLEG): container finished" podID="70ec612b-488a-48e9-a482-a8964c03354f" containerID="6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0" exitCode=0
Sep 11 12:41:52.085513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.085410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl" event={"ID":"70ec612b-488a-48e9-a482-a8964c03354f","Type":"ContainerDied","Data":"6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0"}
Sep 11 12:41:52.085513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.085476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl" event={"ID":"70ec612b-488a-48e9-a482-a8964c03354f","Type":"ContainerDied","Data":"8e5d2973e8d6124257935a607681e63df61033909e1b43746144d580cdde85a6"}
Sep 11 12:41:52.085513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.085429    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"
Sep 11 12:41:52.094662 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.094625    2563 scope.go:117] "RemoveContainer" containerID="2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b"
Sep 11 12:41:52.098586 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:41:52.098310    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b\": container with ID starting with 2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b not found: ID does not exist" containerID="2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b"
Sep 11 12:41:52.098586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.098348    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b"} err="failed to get container status \"2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b\": rpc error: code = NotFound desc = could not find container \"2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b\": container with ID starting with 2786ea0db854309804ba0f6e978ffe608aa1beb6ea7fcac1158b17d2d80e290b not found: ID does not exist"
Sep 11 12:41:52.098586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.098409    2563 scope.go:117] "RemoveContainer" containerID="6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0"
Sep 11 12:41:52.107442 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.107422    2563 scope.go:117] "RemoveContainer" containerID="6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0"
Sep 11 12:41:52.107719 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:41:52.107702    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0\": container with ID starting with 6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0 not found: ID does not exist" containerID="6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0"
Sep 11 12:41:52.107789 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.107729    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0"} err="failed to get container status \"6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0\": rpc error: code = NotFound desc = could not find container \"6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0\": container with ID starting with 6c5bf8fe28839f97252928a94f7537b920d97da1310a2b8aae564015c8d94ed0 not found: ID does not exist"
Sep 11 12:41:52.117247 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.117225    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"]
Sep 11 12:41:52.120774 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.120754    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-47131dfa-9b6fcc9f8-gknrj"]
Sep 11 12:41:52.122729 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.122713    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/158f7b34-e699-485d-aa58-4af9bb985c56-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:52.122790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.122732    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9ftg\" (UniqueName: \"kubernetes.io/projected/158f7b34-e699-485d-aa58-4af9bb985c56-kube-api-access-m9ftg\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:41:52.133040 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.133020    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"]
Sep 11 12:41:52.137306 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:52.137287    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-47131dfa-6698b85ccf-swbgl"]
Sep 11 12:41:53.805672 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:53.805636    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158f7b34-e699-485d-aa58-4af9bb985c56" path="/var/lib/kubelet/pods/158f7b34-e699-485d-aa58-4af9bb985c56/volumes"
Sep 11 12:41:53.806058 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:53.806044    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70ec612b-488a-48e9-a482-a8964c03354f" path="/var/lib/kubelet/pods/70ec612b-488a-48e9-a482-a8964c03354f/volumes"
Sep 11 12:41:56.247313 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.247277    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"]
Sep 11 12:41:56.248001 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.247980    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ec612b-488a-48e9-a482-a8964c03354f" containerName="maas-api"
Sep 11 12:41:56.248075 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.248005    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ec612b-488a-48e9-a482-a8964c03354f" containerName="maas-api"
Sep 11 12:41:56.248075 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.248036    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="158f7b34-e699-485d-aa58-4af9bb985c56" containerName="payload-processing"
Sep 11 12:41:56.248075 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.248044    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="158f7b34-e699-485d-aa58-4af9bb985c56" containerName="payload-processing"
Sep 11 12:41:56.248226 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.248176    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="158f7b34-e699-485d-aa58-4af9bb985c56" containerName="payload-processing"
Sep 11 12:41:56.248226 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.248197    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="70ec612b-488a-48e9-a482-a8964c03354f" containerName="maas-api"
Sep 11 12:41:56.252928 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.252905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.255692 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.255670    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bdb1ecfc-serving-cert\""
Sep 11 12:41:56.263158 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.263132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcgt4\" (UniqueName: \"kubernetes.io/projected/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-kube-api-access-bcgt4\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.263295 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.263215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-metrics-certs\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.263295 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.263267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.263295 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.263291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-openshift-service-ca\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.265516 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.265496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"]
Sep 11 12:41:56.364980 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.364942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcgt4\" (UniqueName: \"kubernetes.io/projected/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-kube-api-access-bcgt4\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.365202 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.365017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-metrics-certs\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.365202 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.365059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.365202 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.365074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-openshift-service-ca\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.365202 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:41:56.365185    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-serving-cert: secret "maas-api-e2e-ait-bdb1ecfc-serving-cert" not found
Sep 11 12:41:56.365460 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:41:56.365251    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls podName:4af14c66-46a0-4b1b-8a8f-bd669f8f3685 nodeName:}" failed. No retries permitted until 2026-09-11 12:41:56.86523165 +0000 UTC m=+917.578234670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls") pod "maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" (UID: "4af14c66-46a0-4b1b-8a8f-bd669f8f3685") : secret "maas-api-e2e-ait-bdb1ecfc-serving-cert" not found
Sep 11 12:41:56.365918 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.365898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-openshift-service-ca\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.367755 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.367737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-metrics-certs\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.377927 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.377904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcgt4\" (UniqueName: \"kubernetes.io/projected/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-kube-api-access-bcgt4\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.869871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.869839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.872199 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.872165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls\") pod \"maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:56.900379 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.900336    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"]
Sep 11 12:41:56.904007 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.903985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:56.907126 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.907076    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-bdb1ecfc\""
Sep 11 12:41:56.907126 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.907137    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-bdb1ecfc-dockercfg-p2b84\""
Sep 11 12:41:56.918922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.918898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"]
Sep 11 12:41:56.970898 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.970866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bead7c3-63b7-4929-9164-2cd823b58284-plugins-config-volume\") pod \"payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") " pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:56.971078 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:56.971022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmz7m\" (UniqueName: \"kubernetes.io/projected/8bead7c3-63b7-4929-9164-2cd823b58284-kube-api-access-vmz7m\") pod \"payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") " pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:57.072233 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.072196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmz7m\" (UniqueName: \"kubernetes.io/projected/8bead7c3-63b7-4929-9164-2cd823b58284-kube-api-access-vmz7m\") pod \"payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") " pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:57.072467 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.072268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bead7c3-63b7-4929-9164-2cd823b58284-plugins-config-volume\") pod \"payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") " pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:57.073014 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.072992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bead7c3-63b7-4929-9164-2cd823b58284-plugins-config-volume\") pod \"payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") " pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:57.088420 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.088392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmz7m\" (UniqueName: \"kubernetes.io/projected/8bead7c3-63b7-4929-9164-2cd823b58284-kube-api-access-vmz7m\") pod \"payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") " pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:57.164458 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.164427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:57.218580 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.218549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:57.443344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.443312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"]
Sep 11 12:41:57.445024 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:41:57.444996    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af14c66_46a0_4b1b_8a8f_bd669f8f3685.slice/crio-81712f417f6b0d96ceba2e1bd6cb64275966327df3b28f1c9977bde766bda3e6 WatchSource:0}: Error finding container 81712f417f6b0d96ceba2e1bd6cb64275966327df3b28f1c9977bde766bda3e6: Status 404 returned error can't find the container with id 81712f417f6b0d96ceba2e1bd6cb64275966327df3b28f1c9977bde766bda3e6
Sep 11 12:41:57.506949 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:57.506919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"]
Sep 11 12:41:57.508833 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:41:57.508787    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bead7c3_63b7_4929_9164_2cd823b58284.slice/crio-a7dcd0b2c84914407ff300174de11f9e7758840807c697bd941a692cd2eaae56 WatchSource:0}: Error finding container a7dcd0b2c84914407ff300174de11f9e7758840807c697bd941a692cd2eaae56: Status 404 returned error can't find the container with id a7dcd0b2c84914407ff300174de11f9e7758840807c697bd941a692cd2eaae56
Sep 11 12:41:58.121466 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.121426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq" event={"ID":"8bead7c3-63b7-4929-9164-2cd823b58284","Type":"ContainerStarted","Data":"b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52"}
Sep 11 12:41:58.121726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.121481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq" event={"ID":"8bead7c3-63b7-4929-9164-2cd823b58284","Type":"ContainerStarted","Data":"a7dcd0b2c84914407ff300174de11f9e7758840807c697bd941a692cd2eaae56"}
Sep 11 12:41:58.121726 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.121537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:41:58.123265 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.123232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" event={"ID":"4af14c66-46a0-4b1b-8a8f-bd669f8f3685","Type":"ContainerStarted","Data":"7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb"}
Sep 11 12:41:58.123391 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.123284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" event={"ID":"4af14c66-46a0-4b1b-8a8f-bd669f8f3685","Type":"ContainerStarted","Data":"81712f417f6b0d96ceba2e1bd6cb64275966327df3b28f1c9977bde766bda3e6"}
Sep 11 12:41:58.123391 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.123328    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:41:58.139821 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.139773    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq" podStartSLOduration=2.139759653 podStartE2EDuration="2.139759653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:58.137997966 +0000 UTC m=+918.851001009" watchObservedRunningTime="2026-09-11 12:41:58.139759653 +0000 UTC m=+918.852762682"
Sep 11 12:41:58.161049 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:41:58.160992    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" podStartSLOduration=1.710186878 podStartE2EDuration="2.160972105s" totalImagesPullingTime="450.785227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:41:58.157608876 +0000 UTC m=+918.870611916" watchObservedRunningTime="2026-09-11 12:41:58.160972105 +0000 UTC m=+918.873975144"
Sep 11 12:42:04.134685 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:04.134656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:42:09.130543 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:09.130512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:42:26.808159 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:26.808117    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"]
Sep 11 12:42:26.808752 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:26.808374    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" podUID="4af14c66-46a0-4b1b-8a8f-bd669f8f3685" containerName="maas-api" containerID="cri-o://7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb" gracePeriod=30
Sep 11 12:42:26.864612 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:26.864578    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"]
Sep 11 12:42:26.864866 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:26.864833    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq" podUID="8bead7c3-63b7-4929-9164-2cd823b58284" containerName="payload-processing" containerID="cri-o://b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52" gracePeriod=30
Sep 11 12:42:27.136222 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.136196    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:42:27.165813 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.165789    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:42:27.180841 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.180814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcgt4\" (UniqueName: \"kubernetes.io/projected/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-kube-api-access-bcgt4\") pod \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") "
Sep 11 12:42:27.181005 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.180886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-metrics-certs\") pod \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") "
Sep 11 12:42:27.181171 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.181014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls\") pod \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") "
Sep 11 12:42:27.181171 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.181038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmz7m\" (UniqueName: \"kubernetes.io/projected/8bead7c3-63b7-4929-9164-2cd823b58284-kube-api-access-vmz7m\") pod \"8bead7c3-63b7-4929-9164-2cd823b58284\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") "
Sep 11 12:42:27.181171 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.181059    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bead7c3-63b7-4929-9164-2cd823b58284-plugins-config-volume\") pod \"8bead7c3-63b7-4929-9164-2cd823b58284\" (UID: \"8bead7c3-63b7-4929-9164-2cd823b58284\") "
Sep 11 12:42:27.181171 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.181102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-openshift-service-ca\") pod \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\" (UID: \"4af14c66-46a0-4b1b-8a8f-bd669f8f3685\") "
Sep 11 12:42:27.181840 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.181759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4af14c66-46a0-4b1b-8a8f-bd669f8f3685" (UID: "4af14c66-46a0-4b1b-8a8f-bd669f8f3685"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:42:27.181951 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.181831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bead7c3-63b7-4929-9164-2cd823b58284-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8bead7c3-63b7-4929-9164-2cd823b58284" (UID: "8bead7c3-63b7-4929-9164-2cd823b58284"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:42:27.184637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.183976    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4af14c66-46a0-4b1b-8a8f-bd669f8f3685" (UID: "4af14c66-46a0-4b1b-8a8f-bd669f8f3685"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:42:27.184637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.184441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4af14c66-46a0-4b1b-8a8f-bd669f8f3685" (UID: "4af14c66-46a0-4b1b-8a8f-bd669f8f3685"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:42:27.184637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.184588    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-kube-api-access-bcgt4" (OuterVolumeSpecName: "kube-api-access-bcgt4") pod "4af14c66-46a0-4b1b-8a8f-bd669f8f3685" (UID: "4af14c66-46a0-4b1b-8a8f-bd669f8f3685"). InnerVolumeSpecName "kube-api-access-bcgt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:42:27.185853 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.185822    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bead7c3-63b7-4929-9164-2cd823b58284-kube-api-access-vmz7m" (OuterVolumeSpecName: "kube-api-access-vmz7m") pod "8bead7c3-63b7-4929-9164-2cd823b58284" (UID: "8bead7c3-63b7-4929-9164-2cd823b58284"). InnerVolumeSpecName "kube-api-access-vmz7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:42:27.279861 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.279828    2563 generic.go:356] "Generic (PLEG): container finished" podID="8bead7c3-63b7-4929-9164-2cd823b58284" containerID="b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52" exitCode=0
Sep 11 12:42:27.280060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.279881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"
Sep 11 12:42:27.280060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.279914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq" event={"ID":"8bead7c3-63b7-4929-9164-2cd823b58284","Type":"ContainerDied","Data":"b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52"}
Sep 11 12:42:27.280060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.279969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq" event={"ID":"8bead7c3-63b7-4929-9164-2cd823b58284","Type":"ContainerDied","Data":"a7dcd0b2c84914407ff300174de11f9e7758840807c697bd941a692cd2eaae56"}
Sep 11 12:42:27.280060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.279992    2563 scope.go:117] "RemoveContainer" containerID="b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52"
Sep 11 12:42:27.281395 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.281339    2563 generic.go:356] "Generic (PLEG): container finished" podID="4af14c66-46a0-4b1b-8a8f-bd669f8f3685" containerID="7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb" exitCode=0
Sep 11 12:42:27.281517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.281401    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"
Sep 11 12:42:27.281517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.281400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" event={"ID":"4af14c66-46a0-4b1b-8a8f-bd669f8f3685","Type":"ContainerDied","Data":"7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb"}
Sep 11 12:42:27.281517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.281456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f" event={"ID":"4af14c66-46a0-4b1b-8a8f-bd669f8f3685","Type":"ContainerDied","Data":"81712f417f6b0d96ceba2e1bd6cb64275966327df3b28f1c9977bde766bda3e6"}
Sep 11 12:42:27.282258 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.282241    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:42:27.282301 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.282266    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmz7m\" (UniqueName: \"kubernetes.io/projected/8bead7c3-63b7-4929-9164-2cd823b58284-kube-api-access-vmz7m\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:42:27.282301 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.282282    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bead7c3-63b7-4929-9164-2cd823b58284-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:42:27.282301 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.282297    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:42:27.282430 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.282311    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcgt4\" (UniqueName: \"kubernetes.io/projected/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-kube-api-access-bcgt4\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:42:27.282430 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.282325    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4af14c66-46a0-4b1b-8a8f-bd669f8f3685-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:42:27.290722 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.290705    2563 scope.go:117] "RemoveContainer" containerID="b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52"
Sep 11 12:42:27.291061 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:42:27.291043    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52\": container with ID starting with b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52 not found: ID does not exist" containerID="b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52"
Sep 11 12:42:27.291140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.291074    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52"} err="failed to get container status \"b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52\": rpc error: code = NotFound desc = could not find container \"b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52\": container with ID starting with b77d5d3fc126de56dd4e56d61f5d70b873970838441cbb19498ba14b2cf47a52 not found: ID does not exist"
Sep 11 12:42:27.291140 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.291099    2563 scope.go:117] "RemoveContainer" containerID="7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb"
Sep 11 12:42:27.300594 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.300568    2563 scope.go:117] "RemoveContainer" containerID="7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb"
Sep 11 12:42:27.300883 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:42:27.300865    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb\": container with ID starting with 7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb not found: ID does not exist" containerID="7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb"
Sep 11 12:42:27.300947 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.300894    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb"} err="failed to get container status \"7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb\": rpc error: code = NotFound desc = could not find container \"7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb\": container with ID starting with 7199031cb7be4d866f3a44e33fe6ab7bec5a724d49659151be170696bd3abefb not found: ID does not exist"
Sep 11 12:42:27.302602 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.302582    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"]
Sep 11 12:42:27.306624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.306603    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-bdb1ecfc-7cf6959987-v59rq"]
Sep 11 12:42:27.319934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.319914    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"]
Sep 11 12:42:27.321787 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.321739    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bdb1ecfc-5d4bc475cf-9rm6f"]
Sep 11 12:42:27.805538 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.805499    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af14c66-46a0-4b1b-8a8f-bd669f8f3685" path="/var/lib/kubelet/pods/4af14c66-46a0-4b1b-8a8f-bd669f8f3685/volumes"
Sep 11 12:42:27.805895 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:27.805882    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bead7c3-63b7-4929-9164-2cd823b58284" path="/var/lib/kubelet/pods/8bead7c3-63b7-4929-9164-2cd823b58284/volumes"
Sep 11 12:42:32.450668 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.450633    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"]
Sep 11 12:42:32.451373 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.451342    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bead7c3-63b7-4929-9164-2cd823b58284" containerName="payload-processing"
Sep 11 12:42:32.451446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.451380    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bead7c3-63b7-4929-9164-2cd823b58284" containerName="payload-processing"
Sep 11 12:42:32.451446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.451413    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af14c66-46a0-4b1b-8a8f-bd669f8f3685" containerName="maas-api"
Sep 11 12:42:32.451446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.451422    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af14c66-46a0-4b1b-8a8f-bd669f8f3685" containerName="maas-api"
Sep 11 12:42:32.451575 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.451533    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bead7c3-63b7-4929-9164-2cd823b58284" containerName="payload-processing"
Sep 11 12:42:32.451575 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.451546    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af14c66-46a0-4b1b-8a8f-bd669f8f3685" containerName="maas-api"
Sep 11 12:42:32.456599 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.456577    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.459333 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.459307    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d76886ba-serving-cert\""
Sep 11 12:42:32.464685 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.464653    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"]
Sep 11 12:42:32.536901 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.536859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdd5\" (UniqueName: \"kubernetes.io/projected/c530eee0-5ecd-445c-b513-c1b166094acf-kube-api-access-hzdd5\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.537075 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.536920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c530eee0-5ecd-445c-b513-c1b166094acf-openshift-service-ca\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.537075 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.537005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-metrics-certs\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.537075 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.537057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.638039 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.637997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-metrics-certs\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.638214 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.638052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.638214 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.638116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdd5\" (UniqueName: \"kubernetes.io/projected/c530eee0-5ecd-445c-b513-c1b166094acf-kube-api-access-hzdd5\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.638214 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.638157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c530eee0-5ecd-445c-b513-c1b166094acf-openshift-service-ca\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.638320 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:42:32.638227    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-serving-cert: secret "maas-api-e2e-derive-d76886ba-serving-cert" not found
Sep 11 12:42:32.638320 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:42:32.638312    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls podName:c530eee0-5ecd-445c-b513-c1b166094acf nodeName:}" failed. No retries permitted until 2026-09-11 12:42:33.138291172 +0000 UTC m=+953.851294188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls") pod "maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" (UID: "c530eee0-5ecd-445c-b513-c1b166094acf") : secret "maas-api-e2e-derive-d76886ba-serving-cert" not found
Sep 11 12:42:32.638878 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.638845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c530eee0-5ecd-445c-b513-c1b166094acf-openshift-service-ca\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.640489 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.640466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-metrics-certs\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:32.647091 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:32.647066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdd5\" (UniqueName: \"kubernetes.io/projected/c530eee0-5ecd-445c-b513-c1b166094acf-kube-api-access-hzdd5\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:33.091460 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.091423    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"]
Sep 11 12:42:33.095418 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.095398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.098399 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.098378    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d76886ba\""
Sep 11 12:42:33.105428 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.105402    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"]
Sep 11 12:42:33.143220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.143182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.143416 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.143379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:33.143485 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.143413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dscm7\" (UniqueName: \"kubernetes.io/projected/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-kube-api-access-dscm7\") pod \"payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.145833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.145806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls\") pod \"maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:33.244546 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.244503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dscm7\" (UniqueName: \"kubernetes.io/projected/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-kube-api-access-dscm7\") pod \"payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.244753 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.244607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.245309 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.245286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.253788 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.253756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dscm7\" (UniqueName: \"kubernetes.io/projected/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-kube-api-access-dscm7\") pod \"payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.371418 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.371292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:33.408519 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.408486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:33.660613 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.660581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"]
Sep 11 12:42:33.662160 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:42:33.662127    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc530eee0_5ecd_445c_b513_c1b166094acf.slice/crio-c5bed8972d2d4b76ba68a494d73dd5e0f1bc8e7d6536fe72d269bada859aab9d WatchSource:0}: Error finding container c5bed8972d2d4b76ba68a494d73dd5e0f1bc8e7d6536fe72d269bada859aab9d: Status 404 returned error can't find the container with id c5bed8972d2d4b76ba68a494d73dd5e0f1bc8e7d6536fe72d269bada859aab9d
Sep 11 12:42:33.663517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.663498    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:42:33.690161 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:33.690135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"]
Sep 11 12:42:33.692213 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:42:33.692184    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde140201_6f0f_4e8c_8e8f_8317e0f91a7b.slice/crio-1c8c05d8d4547ca728c32742b820e94487cc6497a826d916fcef599c8ad19136 WatchSource:0}: Error finding container 1c8c05d8d4547ca728c32742b820e94487cc6497a826d916fcef599c8ad19136: Status 404 returned error can't find the container with id 1c8c05d8d4547ca728c32742b820e94487cc6497a826d916fcef599c8ad19136
Sep 11 12:42:34.323868 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.323736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp" event={"ID":"de140201-6f0f-4e8c-8e8f-8317e0f91a7b","Type":"ContainerStarted","Data":"63fbda43f63cbe98eccf38656730e0d524ca4694e19129ee6ee19ab422de807e"}
Sep 11 12:42:34.323868 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.323828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp" event={"ID":"de140201-6f0f-4e8c-8e8f-8317e0f91a7b","Type":"ContainerStarted","Data":"1c8c05d8d4547ca728c32742b820e94487cc6497a826d916fcef599c8ad19136"}
Sep 11 12:42:34.324095 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.323938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:42:34.325269 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.325247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" event={"ID":"c530eee0-5ecd-445c-b513-c1b166094acf","Type":"ContainerStarted","Data":"7fd7faa367c437ec5dce80083f5af718370cb292d716166408b9e94ac023514a"}
Sep 11 12:42:34.325337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.325289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" event={"ID":"c530eee0-5ecd-445c-b513-c1b166094acf","Type":"ContainerStarted","Data":"c5bed8972d2d4b76ba68a494d73dd5e0f1bc8e7d6536fe72d269bada859aab9d"}
Sep 11 12:42:34.325401 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.325385    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:34.342693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.342648    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp" podStartSLOduration=1.342633751 podStartE2EDuration="1.342633751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:42:34.340110967 +0000 UTC m=+955.053114014" watchObservedRunningTime="2026-09-11 12:42:34.342633751 +0000 UTC m=+955.055636786"
Sep 11 12:42:34.356481 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:34.356421    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" podStartSLOduration=1.952318545 podStartE2EDuration="2.356400807s" totalImagesPullingTime="404.082262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:42:34.356233562 +0000 UTC m=+955.069236604" watchObservedRunningTime="2026-09-11 12:42:34.356400807 +0000 UTC m=+955.069403850"
Sep 11 12:42:40.336853 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:40.336824    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:42:45.333250 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:42:45.333219    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:43:01.749147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:01.749074    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"]
Sep 11 12:43:01.749629 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:01.749324    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" podUID="ecdf65b3-3b98-443e-a864-7696542a8c50" containerName="maas-api" containerID="cri-o://4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299" gracePeriod=30
Sep 11 12:43:02.014586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.014530    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:43:02.146671 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.146638    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls\") pod \"ecdf65b3-3b98-443e-a864-7696542a8c50\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") "
Sep 11 12:43:02.146857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.146699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf2lf\" (UniqueName: \"kubernetes.io/projected/ecdf65b3-3b98-443e-a864-7696542a8c50-kube-api-access-rf2lf\") pod \"ecdf65b3-3b98-443e-a864-7696542a8c50\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") "
Sep 11 12:43:02.146857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.146739    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-metrics-certs\") pod \"ecdf65b3-3b98-443e-a864-7696542a8c50\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") "
Sep 11 12:43:02.146857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.146760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecdf65b3-3b98-443e-a864-7696542a8c50-openshift-service-ca\") pod \"ecdf65b3-3b98-443e-a864-7696542a8c50\" (UID: \"ecdf65b3-3b98-443e-a864-7696542a8c50\") "
Sep 11 12:43:02.147170 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.147141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecdf65b3-3b98-443e-a864-7696542a8c50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecdf65b3-3b98-443e-a864-7696542a8c50" (UID: "ecdf65b3-3b98-443e-a864-7696542a8c50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:43:02.148876 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.148848    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecdf65b3-3b98-443e-a864-7696542a8c50-kube-api-access-rf2lf" (OuterVolumeSpecName: "kube-api-access-rf2lf") pod "ecdf65b3-3b98-443e-a864-7696542a8c50" (UID: "ecdf65b3-3b98-443e-a864-7696542a8c50"). InnerVolumeSpecName "kube-api-access-rf2lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:02.149002 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.148930    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecdf65b3-3b98-443e-a864-7696542a8c50" (UID: "ecdf65b3-3b98-443e-a864-7696542a8c50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:43:02.149157 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.149130    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ecdf65b3-3b98-443e-a864-7696542a8c50" (UID: "ecdf65b3-3b98-443e-a864-7696542a8c50"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:43:02.248249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.248214    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:02.248249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.248240    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecdf65b3-3b98-443e-a864-7696542a8c50-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:02.248249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.248250    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecdf65b3-3b98-443e-a864-7696542a8c50-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:02.248249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.248259    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf2lf\" (UniqueName: \"kubernetes.io/projected/ecdf65b3-3b98-443e-a864-7696542a8c50-kube-api-access-rf2lf\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:02.478130 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.478096    2563 generic.go:356] "Generic (PLEG): container finished" podID="ecdf65b3-3b98-443e-a864-7696542a8c50" containerID="4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299" exitCode=0
Sep 11 12:43:02.478302 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.478138    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"
Sep 11 12:43:02.478302 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.478145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" event={"ID":"ecdf65b3-3b98-443e-a864-7696542a8c50","Type":"ContainerDied","Data":"4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299"}
Sep 11 12:43:02.478302 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.478188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm" event={"ID":"ecdf65b3-3b98-443e-a864-7696542a8c50","Type":"ContainerDied","Data":"a007ea07c45cff1d323636ffe8f289013aff97b794740c7bda7d8e41cb1c1dd9"}
Sep 11 12:43:02.478302 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.478209    2563 scope.go:117] "RemoveContainer" containerID="4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299"
Sep 11 12:43:02.488155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.488137    2563 scope.go:117] "RemoveContainer" containerID="4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299"
Sep 11 12:43:02.488426 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:43:02.488402    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299\": container with ID starting with 4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299 not found: ID does not exist" containerID="4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299"
Sep 11 12:43:02.488478 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.488436    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299"} err="failed to get container status \"4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299\": rpc error: code = NotFound desc = could not find container \"4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299\": container with ID starting with 4990a559ffb5f6a3dbd9631376e445bfff2a4a0b429bef1ead24efc215d7a299 not found: ID does not exist"
Sep 11 12:43:02.501356 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.501336    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"]
Sep 11 12:43:02.503391 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:02.503352    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-9878a9-7cf94d994b-msvtm"]
Sep 11 12:43:03.279483 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.279440    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"]
Sep 11 12:43:03.279967 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.279689    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" podUID="c530eee0-5ecd-445c-b513-c1b166094acf" containerName="maas-api" containerID="cri-o://7fd7faa367c437ec5dce80083f5af718370cb292d716166408b9e94ac023514a" gracePeriod=30
Sep 11 12:43:03.347495 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.347459    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"]
Sep 11 12:43:03.347728 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.347700    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp" podUID="de140201-6f0f-4e8c-8e8f-8317e0f91a7b" containerName="payload-pre-processing" containerID="cri-o://63fbda43f63cbe98eccf38656730e0d524ca4694e19129ee6ee19ab422de807e" gracePeriod=30
Sep 11 12:43:03.487644 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.487611    2563 generic.go:356] "Generic (PLEG): container finished" podID="de140201-6f0f-4e8c-8e8f-8317e0f91a7b" containerID="63fbda43f63cbe98eccf38656730e0d524ca4694e19129ee6ee19ab422de807e" exitCode=0
Sep 11 12:43:03.487790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.487682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp" event={"ID":"de140201-6f0f-4e8c-8e8f-8317e0f91a7b","Type":"ContainerDied","Data":"63fbda43f63cbe98eccf38656730e0d524ca4694e19129ee6ee19ab422de807e"}
Sep 11 12:43:03.489520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.489435    2563 generic.go:356] "Generic (PLEG): container finished" podID="c530eee0-5ecd-445c-b513-c1b166094acf" containerID="7fd7faa367c437ec5dce80083f5af718370cb292d716166408b9e94ac023514a" exitCode=0
Sep 11 12:43:03.489520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.489505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" event={"ID":"c530eee0-5ecd-445c-b513-c1b166094acf","Type":"ContainerDied","Data":"7fd7faa367c437ec5dce80083f5af718370cb292d716166408b9e94ac023514a"}
Sep 11 12:43:03.627622 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.627594    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:43:03.661711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.661692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls\") pod \"c530eee0-5ecd-445c-b513-c1b166094acf\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") "
Sep 11 12:43:03.661804 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.661731    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-metrics-certs\") pod \"c530eee0-5ecd-445c-b513-c1b166094acf\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") "
Sep 11 12:43:03.661804 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.661796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c530eee0-5ecd-445c-b513-c1b166094acf-openshift-service-ca\") pod \"c530eee0-5ecd-445c-b513-c1b166094acf\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") "
Sep 11 12:43:03.661927 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.661822    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzdd5\" (UniqueName: \"kubernetes.io/projected/c530eee0-5ecd-445c-b513-c1b166094acf-kube-api-access-hzdd5\") pod \"c530eee0-5ecd-445c-b513-c1b166094acf\" (UID: \"c530eee0-5ecd-445c-b513-c1b166094acf\") "
Sep 11 12:43:03.662167 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.662140    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c530eee0-5ecd-445c-b513-c1b166094acf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c530eee0-5ecd-445c-b513-c1b166094acf" (UID: "c530eee0-5ecd-445c-b513-c1b166094acf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:43:03.663945 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.663914    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c530eee0-5ecd-445c-b513-c1b166094acf-kube-api-access-hzdd5" (OuterVolumeSpecName: "kube-api-access-hzdd5") pod "c530eee0-5ecd-445c-b513-c1b166094acf" (UID: "c530eee0-5ecd-445c-b513-c1b166094acf"). InnerVolumeSpecName "kube-api-access-hzdd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:03.664045 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.663962    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c530eee0-5ecd-445c-b513-c1b166094acf" (UID: "c530eee0-5ecd-445c-b513-c1b166094acf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:43:03.664045 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.664006    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c530eee0-5ecd-445c-b513-c1b166094acf" (UID: "c530eee0-5ecd-445c-b513-c1b166094acf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:43:03.669261 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.669240    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:43:03.762555 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762523    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dscm7\" (UniqueName: \"kubernetes.io/projected/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-kube-api-access-dscm7\") pod \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") "
Sep 11 12:43:03.762746 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762602    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-plugins-config-volume\") pod \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\" (UID: \"de140201-6f0f-4e8c-8e8f-8317e0f91a7b\") "
Sep 11 12:43:03.762813 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762795    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c530eee0-5ecd-445c-b513-c1b166094acf-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:03.762813 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762806    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzdd5\" (UniqueName: \"kubernetes.io/projected/c530eee0-5ecd-445c-b513-c1b166094acf-kube-api-access-hzdd5\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:03.762922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762815    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:03.762922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762823    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c530eee0-5ecd-445c-b513-c1b166094acf-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:03.763022 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.762980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de140201-6f0f-4e8c-8e8f-8317e0f91a7b" (UID: "de140201-6f0f-4e8c-8e8f-8317e0f91a7b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:43:03.764735 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.764712    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-kube-api-access-dscm7" (OuterVolumeSpecName: "kube-api-access-dscm7") pod "de140201-6f0f-4e8c-8e8f-8317e0f91a7b" (UID: "de140201-6f0f-4e8c-8e8f-8317e0f91a7b"). InnerVolumeSpecName "kube-api-access-dscm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:43:03.808842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.808756    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecdf65b3-3b98-443e-a864-7696542a8c50" path="/var/lib/kubelet/pods/ecdf65b3-3b98-443e-a864-7696542a8c50/volumes"
Sep 11 12:43:03.863536 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.863503    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dscm7\" (UniqueName: \"kubernetes.io/projected/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-kube-api-access-dscm7\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:03.863536 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:03.863530    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de140201-6f0f-4e8c-8e8f-8317e0f91a7b-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:43:04.496834 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.496800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp" event={"ID":"de140201-6f0f-4e8c-8e8f-8317e0f91a7b","Type":"ContainerDied","Data":"1c8c05d8d4547ca728c32742b820e94487cc6497a826d916fcef599c8ad19136"}
Sep 11 12:43:04.497292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.496812    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"
Sep 11 12:43:04.497292 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.496866    2563 scope.go:117] "RemoveContainer" containerID="63fbda43f63cbe98eccf38656730e0d524ca4694e19129ee6ee19ab422de807e"
Sep 11 12:43:04.498458 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.498439    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"
Sep 11 12:43:04.498550 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.498436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq" event={"ID":"c530eee0-5ecd-445c-b513-c1b166094acf","Type":"ContainerDied","Data":"c5bed8972d2d4b76ba68a494d73dd5e0f1bc8e7d6536fe72d269bada859aab9d"}
Sep 11 12:43:04.505678 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.505662    2563 scope.go:117] "RemoveContainer" containerID="7fd7faa367c437ec5dce80083f5af718370cb292d716166408b9e94ac023514a"
Sep 11 12:43:04.517484 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.517462    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"]
Sep 11 12:43:04.521990 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.521969    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d76886ba-5894f77cc8-qrrkq"]
Sep 11 12:43:04.532627 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.532606    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"]
Sep 11 12:43:04.538433 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:04.538411    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d76886ba-5578b6644b-4czlp"]
Sep 11 12:43:05.805300 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:05.805263    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c530eee0-5ecd-445c-b513-c1b166094acf" path="/var/lib/kubelet/pods/c530eee0-5ecd-445c-b513-c1b166094acf/volumes"
Sep 11 12:43:05.805683 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:05.805671    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de140201-6f0f-4e8c-8e8f-8317e0f91a7b" path="/var/lib/kubelet/pods/de140201-6f0f-4e8c-8e8f-8317e0f91a7b/volumes"
Sep 11 12:43:13.321875 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.321840    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"]
Sep 11 12:43:13.322315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322245    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c530eee0-5ecd-445c-b513-c1b166094acf" containerName="maas-api"
Sep 11 12:43:13.322315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322255    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c530eee0-5ecd-445c-b513-c1b166094acf" containerName="maas-api"
Sep 11 12:43:13.322315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322265    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de140201-6f0f-4e8c-8e8f-8317e0f91a7b" containerName="payload-pre-processing"
Sep 11 12:43:13.322315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322271    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de140201-6f0f-4e8c-8e8f-8317e0f91a7b" containerName="payload-pre-processing"
Sep 11 12:43:13.322315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecdf65b3-3b98-443e-a864-7696542a8c50" containerName="maas-api"
Sep 11 12:43:13.322315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322287    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecdf65b3-3b98-443e-a864-7696542a8c50" containerName="maas-api"
Sep 11 12:43:13.322544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322383    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecdf65b3-3b98-443e-a864-7696542a8c50" containerName="maas-api"
Sep 11 12:43:13.322544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322394    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c530eee0-5ecd-445c-b513-c1b166094acf" containerName="maas-api"
Sep 11 12:43:13.322544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.322399    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="de140201-6f0f-4e8c-8e8f-8317e0f91a7b" containerName="payload-pre-processing"
Sep 11 12:43:13.325600 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.325580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.329907 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.329886    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-b8dbb2-serving-cert\""
Sep 11 12:43:13.337706 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.337680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"]
Sep 11 12:43:13.353028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.353002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e90ef08-9158-4d36-8d8e-5e40edf15681-openshift-service-ca\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.353147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.353050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.353147 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.353111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgr8l\" (UniqueName: \"kubernetes.io/projected/2e90ef08-9158-4d36-8d8e-5e40edf15681-kube-api-access-vgr8l\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.353276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.353185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-metrics-certs\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.453762 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.453723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-metrics-certs\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.453953 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.453778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e90ef08-9158-4d36-8d8e-5e40edf15681-openshift-service-ca\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.453953 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.453808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.453953 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.453838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgr8l\" (UniqueName: \"kubernetes.io/projected/2e90ef08-9158-4d36-8d8e-5e40edf15681-kube-api-access-vgr8l\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.454109 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:43:13.453944    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-serving-cert: secret "maas-api-e2e-explicit-b8dbb2-serving-cert" not found
Sep 11 12:43:13.454109 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:43:13.454022    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls podName:2e90ef08-9158-4d36-8d8e-5e40edf15681 nodeName:}" failed. No retries permitted until 2026-09-11 12:43:13.954004967 +0000 UTC m=+994.667007983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls") pod "maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" (UID: "2e90ef08-9158-4d36-8d8e-5e40edf15681") : secret "maas-api-e2e-explicit-b8dbb2-serving-cert" not found
Sep 11 12:43:13.454538 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.454518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e90ef08-9158-4d36-8d8e-5e40edf15681-openshift-service-ca\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.456246 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.456219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-metrics-certs\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.467088 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.467063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgr8l\" (UniqueName: \"kubernetes.io/projected/2e90ef08-9158-4d36-8d8e-5e40edf15681-kube-api-access-vgr8l\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.959109 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.959070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:13.961504 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:13.961484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls\") pod \"maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:14.239469 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:14.239385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:14.513251 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:14.513167    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"]
Sep 11 12:43:14.516334 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:43:14.516302    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e90ef08_9158_4d36_8d8e_5e40edf15681.slice/crio-d5c5e35ab5c7406bdb839eb1a4c2b5e4d9a6098d7fd26afbdcfd73fa380426e0 WatchSource:0}: Error finding container d5c5e35ab5c7406bdb839eb1a4c2b5e4d9a6098d7fd26afbdcfd73fa380426e0: Status 404 returned error can't find the container with id d5c5e35ab5c7406bdb839eb1a4c2b5e4d9a6098d7fd26afbdcfd73fa380426e0
Sep 11 12:43:14.554801 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:14.554771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" event={"ID":"2e90ef08-9158-4d36-8d8e-5e40edf15681","Type":"ContainerStarted","Data":"d5c5e35ab5c7406bdb839eb1a4c2b5e4d9a6098d7fd26afbdcfd73fa380426e0"}
Sep 11 12:43:15.561784 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:15.561743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" event={"ID":"2e90ef08-9158-4d36-8d8e-5e40edf15681","Type":"ContainerStarted","Data":"fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81"}
Sep 11 12:43:15.562194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:15.561821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:43:15.585582 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:15.585528    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" podStartSLOduration=2.258134069 podStartE2EDuration="2.585510973s" totalImagesPullingTime="327.376904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:43:15.582788233 +0000 UTC m=+996.295791272" watchObservedRunningTime="2026-09-11 12:43:15.585510973 +0000 UTC m=+996.298514056"
Sep 11 12:43:21.573125 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:43:21.573095    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:44:20.816917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:20.816860    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"]
Sep 11 12:44:20.817807 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:20.817774    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" podUID="2e90ef08-9158-4d36-8d8e-5e40edf15681" containerName="maas-api" containerID="cri-o://fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81" gracePeriod=30
Sep 11 12:44:21.063437 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.063411    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:44:21.114285 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.114206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e90ef08-9158-4d36-8d8e-5e40edf15681-openshift-service-ca\") pod \"2e90ef08-9158-4d36-8d8e-5e40edf15681\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") "
Sep 11 12:44:21.114285 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.114252    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-metrics-certs\") pod \"2e90ef08-9158-4d36-8d8e-5e40edf15681\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") "
Sep 11 12:44:21.114544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.114319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls\") pod \"2e90ef08-9158-4d36-8d8e-5e40edf15681\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") "
Sep 11 12:44:21.114544 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.114375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgr8l\" (UniqueName: \"kubernetes.io/projected/2e90ef08-9158-4d36-8d8e-5e40edf15681-kube-api-access-vgr8l\") pod \"2e90ef08-9158-4d36-8d8e-5e40edf15681\" (UID: \"2e90ef08-9158-4d36-8d8e-5e40edf15681\") "
Sep 11 12:44:21.114664 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.114621    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e90ef08-9158-4d36-8d8e-5e40edf15681-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e90ef08-9158-4d36-8d8e-5e40edf15681" (UID: "2e90ef08-9158-4d36-8d8e-5e40edf15681"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:44:21.116506 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.116478    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e90ef08-9158-4d36-8d8e-5e40edf15681-kube-api-access-vgr8l" (OuterVolumeSpecName: "kube-api-access-vgr8l") pod "2e90ef08-9158-4d36-8d8e-5e40edf15681" (UID: "2e90ef08-9158-4d36-8d8e-5e40edf15681"). InnerVolumeSpecName "kube-api-access-vgr8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:44:21.116637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.116516    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e90ef08-9158-4d36-8d8e-5e40edf15681" (UID: "2e90ef08-9158-4d36-8d8e-5e40edf15681"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:44:21.116637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.116584    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2e90ef08-9158-4d36-8d8e-5e40edf15681" (UID: "2e90ef08-9158-4d36-8d8e-5e40edf15681"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:44:21.215498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.215462    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:44:21.215498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.215494    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgr8l\" (UniqueName: \"kubernetes.io/projected/2e90ef08-9158-4d36-8d8e-5e40edf15681-kube-api-access-vgr8l\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:44:21.215498 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.215508    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e90ef08-9158-4d36-8d8e-5e40edf15681-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:44:21.215722 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.215517    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e90ef08-9158-4d36-8d8e-5e40edf15681-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:44:21.897963 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.897926    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e90ef08-9158-4d36-8d8e-5e40edf15681" containerID="fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81" exitCode=0
Sep 11 12:44:21.898392 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.897967    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"
Sep 11 12:44:21.898392 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.898007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" event={"ID":"2e90ef08-9158-4d36-8d8e-5e40edf15681","Type":"ContainerDied","Data":"fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81"}
Sep 11 12:44:21.898392 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.898060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq" event={"ID":"2e90ef08-9158-4d36-8d8e-5e40edf15681","Type":"ContainerDied","Data":"d5c5e35ab5c7406bdb839eb1a4c2b5e4d9a6098d7fd26afbdcfd73fa380426e0"}
Sep 11 12:44:21.898392 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.898082    2563 scope.go:117] "RemoveContainer" containerID="fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81"
Sep 11 12:44:21.907091 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.907076    2563 scope.go:117] "RemoveContainer" containerID="fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81"
Sep 11 12:44:21.907381 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:44:21.907347    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81\": container with ID starting with fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81 not found: ID does not exist" containerID="fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81"
Sep 11 12:44:21.907440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.907393    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81"} err="failed to get container status \"fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81\": rpc error: code = NotFound desc = could not find container \"fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81\": container with ID starting with fa338b022f6e5468c7d3f190b079a7ab360672634eadd9114af828ec6384ec81 not found: ID does not exist"
Sep 11 12:44:21.914788 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.914767    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"]
Sep 11 12:44:21.920673 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:21.920643    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b8dbb2-75b5698545-p6rlq"]
Sep 11 12:44:23.805624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:23.805591    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e90ef08-9158-4d36-8d8e-5e40edf15681" path="/var/lib/kubelet/pods/2e90ef08-9158-4d36-8d8e-5e40edf15681/volumes"
Sep 11 12:44:42.845906 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.845872    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"]
Sep 11 12:44:42.847098 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.847069    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e90ef08-9158-4d36-8d8e-5e40edf15681" containerName="maas-api"
Sep 11 12:44:42.847206 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.847102    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e90ef08-9158-4d36-8d8e-5e40edf15681" containerName="maas-api"
Sep 11 12:44:42.847278 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.847242    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e90ef08-9158-4d36-8d8e-5e40edf15681" containerName="maas-api"
Sep 11 12:44:42.852074 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.852051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:42.855004 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.854985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-54e055b6-serving-cert\""
Sep 11 12:44:42.862646 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.862532    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"]
Sep 11 12:44:42.918063 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.918032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-openshift-service-ca\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:42.918244 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.918151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-maas-api-tls\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:42.918244 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.918207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-metrics-certs\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:42.918398 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:42.918265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22w8\" (UniqueName: \"kubernetes.io/projected/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-kube-api-access-x22w8\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.019487 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.019453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-openshift-service-ca\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.019658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.019536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-maas-api-tls\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.019658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.019561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-metrics-certs\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.019658 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.019596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22w8\" (UniqueName: \"kubernetes.io/projected/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-kube-api-access-x22w8\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.020207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.020179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-openshift-service-ca\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.022004 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.021979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-metrics-certs\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.022117 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.022040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-maas-api-tls\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.028547 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.028529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22w8\" (UniqueName: \"kubernetes.io/projected/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-kube-api-access-x22w8\") pod \"maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.164676 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.164647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:43.440448 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:43.440420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"]
Sep 11 12:44:43.441767 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:44:43.441739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f06dda_7041_4cb0_a0ee_c0b22a9ff90b.slice/crio-0d05f1424990861421ea47509ffb35a36c1eb89e788791c7a15290aa13f04589 WatchSource:0}: Error finding container 0d05f1424990861421ea47509ffb35a36c1eb89e788791c7a15290aa13f04589: Status 404 returned error can't find the container with id 0d05f1424990861421ea47509ffb35a36c1eb89e788791c7a15290aa13f04589
Sep 11 12:44:44.015969 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:44.015921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw" event={"ID":"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b","Type":"ContainerStarted","Data":"2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e"}
Sep 11 12:44:44.016439 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:44.015984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw" event={"ID":"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b","Type":"ContainerStarted","Data":"0d05f1424990861421ea47509ffb35a36c1eb89e788791c7a15290aa13f04589"}
Sep 11 12:44:44.016439 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:44.016134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:44:44.036931 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:44.036887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw" podStartSLOduration=1.579450901 podStartE2EDuration="2.036872958s" totalImagesPullingTime="457.422057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:44:44.035591086 +0000 UTC m=+1084.748594124" watchObservedRunningTime="2026-09-11 12:44:44.036872958 +0000 UTC m=+1084.749875995"
Sep 11 12:44:50.026106 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:44:50.026078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:45:19.850203 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:19.850170    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"]
Sep 11 12:45:19.850666 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:19.850438    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9" podUID="45e8cce2-9e90-402b-9940-fefb975a3c36" containerName="maas-api" containerID="cri-o://4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f" gracePeriod=30
Sep 11 12:45:19.909472 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:19.909429    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"]
Sep 11 12:45:19.909683 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:19.909655    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6" podUID="23d75d73-4573-4fa2-89bf-fef6390f720b" containerName="payload-processing" containerID="cri-o://a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85" gracePeriod=30
Sep 11 12:45:20.163877 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.163853    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:45:20.196011 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.195987    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:45:20.206067 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.206022    2563 generic.go:356] "Generic (PLEG): container finished" podID="45e8cce2-9e90-402b-9940-fefb975a3c36" containerID="4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f" exitCode=0
Sep 11 12:45:20.206205 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.206070    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"
Sep 11 12:45:20.206205 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.206084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9" event={"ID":"45e8cce2-9e90-402b-9940-fefb975a3c36","Type":"ContainerDied","Data":"4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f"}
Sep 11 12:45:20.206205 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.206167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9" event={"ID":"45e8cce2-9e90-402b-9940-fefb975a3c36","Type":"ContainerDied","Data":"d2f183de9f96c7ba772d499685c5a7e2a500e39c117075b4cbe215aa8852715e"}
Sep 11 12:45:20.206388 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.206219    2563 scope.go:117] "RemoveContainer" containerID="4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f"
Sep 11 12:45:20.207875 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.207853    2563 generic.go:356] "Generic (PLEG): container finished" podID="23d75d73-4573-4fa2-89bf-fef6390f720b" containerID="a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85" exitCode=0
Sep 11 12:45:20.207983 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.207884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6" event={"ID":"23d75d73-4573-4fa2-89bf-fef6390f720b","Type":"ContainerDied","Data":"a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85"}
Sep 11 12:45:20.207983 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.207897    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"
Sep 11 12:45:20.207983 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.207929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6" event={"ID":"23d75d73-4573-4fa2-89bf-fef6390f720b","Type":"ContainerDied","Data":"5d3df6d4d8195d47815bbacef3e816b96108dc9f48523b823b134f0b7f5de6df"}
Sep 11 12:45:20.215822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.215796    2563 scope.go:117] "RemoveContainer" containerID="4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f"
Sep 11 12:45:20.216152 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:20.216126    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f\": container with ID starting with 4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f not found: ID does not exist" containerID="4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f"
Sep 11 12:45:20.216268 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.216162    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f"} err="failed to get container status \"4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f\": rpc error: code = NotFound desc = could not find container \"4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f\": container with ID starting with 4e9c0d7454beb12df99ef57050aa1861d88cd021619c9605fd3072c40a7e603f not found: ID does not exist"
Sep 11 12:45:20.216268 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.216188    2563 scope.go:117] "RemoveContainer" containerID="a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85"
Sep 11 12:45:20.227323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.227306    2563 scope.go:117] "RemoveContainer" containerID="a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85"
Sep 11 12:45:20.227661 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:20.227641    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85\": container with ID starting with a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85 not found: ID does not exist" containerID="a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85"
Sep 11 12:45:20.227742 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.227666    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85"} err="failed to get container status \"a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85\": rpc error: code = NotFound desc = could not find container \"a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85\": container with ID starting with a4287f75e1275d82f446de68840d83029d2e346336c1b8ecc9a5a9410f6a8f85 not found: ID does not exist"
Sep 11 12:45:20.277158 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4qzg\" (UniqueName: \"kubernetes.io/projected/23d75d73-4573-4fa2-89bf-fef6390f720b-kube-api-access-n4qzg\") pod \"23d75d73-4573-4fa2-89bf-fef6390f720b\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") "
Sep 11 12:45:20.277291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277170    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45e8cce2-9e90-402b-9940-fefb975a3c36-openshift-service-ca\") pod \"45e8cce2-9e90-402b-9940-fefb975a3c36\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") "
Sep 11 12:45:20.277291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-maas-api-tls\") pod \"45e8cce2-9e90-402b-9940-fefb975a3c36\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") "
Sep 11 12:45:20.277291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277204    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fkw9\" (UniqueName: \"kubernetes.io/projected/45e8cce2-9e90-402b-9940-fefb975a3c36-kube-api-access-2fkw9\") pod \"45e8cce2-9e90-402b-9940-fefb975a3c36\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") "
Sep 11 12:45:20.277522 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277325    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-metrics-certs\") pod \"45e8cce2-9e90-402b-9940-fefb975a3c36\" (UID: \"45e8cce2-9e90-402b-9940-fefb975a3c36\") "
Sep 11 12:45:20.277522 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d75d73-4573-4fa2-89bf-fef6390f720b-plugins-config-volume\") pod \"23d75d73-4573-4fa2-89bf-fef6390f720b\" (UID: \"23d75d73-4573-4fa2-89bf-fef6390f720b\") "
Sep 11 12:45:20.277621 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e8cce2-9e90-402b-9940-fefb975a3c36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45e8cce2-9e90-402b-9940-fefb975a3c36" (UID: "45e8cce2-9e90-402b-9940-fefb975a3c36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:20.277836 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23d75d73-4573-4fa2-89bf-fef6390f720b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23d75d73-4573-4fa2-89bf-fef6390f720b" (UID: "23d75d73-4573-4fa2-89bf-fef6390f720b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:20.277909 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.277850    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45e8cce2-9e90-402b-9940-fefb975a3c36-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:20.279226 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.279205    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e8cce2-9e90-402b-9940-fefb975a3c36-kube-api-access-2fkw9" (OuterVolumeSpecName: "kube-api-access-2fkw9") pod "45e8cce2-9e90-402b-9940-fefb975a3c36" (UID: "45e8cce2-9e90-402b-9940-fefb975a3c36"). InnerVolumeSpecName "kube-api-access-2fkw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:20.279341 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.279321    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d75d73-4573-4fa2-89bf-fef6390f720b-kube-api-access-n4qzg" (OuterVolumeSpecName: "kube-api-access-n4qzg") pod "23d75d73-4573-4fa2-89bf-fef6390f720b" (UID: "23d75d73-4573-4fa2-89bf-fef6390f720b"). InnerVolumeSpecName "kube-api-access-n4qzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:20.279653 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.279631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "45e8cce2-9e90-402b-9940-fefb975a3c36" (UID: "45e8cce2-9e90-402b-9940-fefb975a3c36"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:20.279745 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.279652    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45e8cce2-9e90-402b-9940-fefb975a3c36" (UID: "45e8cce2-9e90-402b-9940-fefb975a3c36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:20.378711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.378637    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d75d73-4573-4fa2-89bf-fef6390f720b-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:20.378711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.378664    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4qzg\" (UniqueName: \"kubernetes.io/projected/23d75d73-4573-4fa2-89bf-fef6390f720b-kube-api-access-n4qzg\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:20.378711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.378675    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:20.378711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.378684    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fkw9\" (UniqueName: \"kubernetes.io/projected/45e8cce2-9e90-402b-9940-fefb975a3c36-kube-api-access-2fkw9\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:20.378711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.378692    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45e8cce2-9e90-402b-9940-fefb975a3c36-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:20.532398 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.532345    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"]
Sep 11 12:45:20.537108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.537076    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-edce0b-cc665987f-kzwf6"]
Sep 11 12:45:20.548816 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.548793    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"]
Sep 11 12:45:20.554562 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:20.554541    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-edce0b-5ffc86b645-zsbs9"]
Sep 11 12:45:21.805159 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:21.805126    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d75d73-4573-4fa2-89bf-fef6390f720b" path="/var/lib/kubelet/pods/23d75d73-4573-4fa2-89bf-fef6390f720b/volumes"
Sep 11 12:45:21.805597 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:21.805501    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e8cce2-9e90-402b-9940-fefb975a3c36" path="/var/lib/kubelet/pods/45e8cce2-9e90-402b-9940-fefb975a3c36/volumes"
Sep 11 12:45:24.729798 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:24.729769    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"]
Sep 11 12:45:24.730212 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:24.729963    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw" podUID="21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" containerName="maas-api" containerID="cri-o://2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e" gracePeriod=30
Sep 11 12:45:24.977289 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:24.977267    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:45:25.119621 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.119545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-maas-api-tls\") pod \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") "
Sep 11 12:45:25.119757 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.119676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-metrics-certs\") pod \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") "
Sep 11 12:45:25.119757 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.119715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-openshift-service-ca\") pod \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") "
Sep 11 12:45:25.119835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.119761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x22w8\" (UniqueName: \"kubernetes.io/projected/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-kube-api-access-x22w8\") pod \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\" (UID: \"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b\") "
Sep 11 12:45:25.120141 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.120114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" (UID: "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:25.120517 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.120493    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.121914 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.121890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" (UID: "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:25.122000 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.121964    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-kube-api-access-x22w8" (OuterVolumeSpecName: "kube-api-access-x22w8") pod "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" (UID: "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b"). InnerVolumeSpecName "kube-api-access-x22w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:25.122000 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.121978    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" (UID: "21f06dda-7041-4cb0-a0ee-c0b22a9ff90b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:25.221984 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.221954    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.221984 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.221978    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x22w8\" (UniqueName: \"kubernetes.io/projected/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-kube-api-access-x22w8\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.221984 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.221988    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:25.235715 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.235684    2563 generic.go:356] "Generic (PLEG): container finished" podID="21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" containerID="2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e" exitCode=0
Sep 11 12:45:25.235826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.235733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"
Sep 11 12:45:25.235826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.235745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw" event={"ID":"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b","Type":"ContainerDied","Data":"2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e"}
Sep 11 12:45:25.235826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.235786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw" event={"ID":"21f06dda-7041-4cb0-a0ee-c0b22a9ff90b","Type":"ContainerDied","Data":"0d05f1424990861421ea47509ffb35a36c1eb89e788791c7a15290aa13f04589"}
Sep 11 12:45:25.235826 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.235806    2563 scope.go:117] "RemoveContainer" containerID="2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e"
Sep 11 12:45:25.245041 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.245026    2563 scope.go:117] "RemoveContainer" containerID="2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e"
Sep 11 12:45:25.245329 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:25.245307    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e\": container with ID starting with 2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e not found: ID does not exist" containerID="2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e"
Sep 11 12:45:25.245410 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.245337    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e"} err="failed to get container status \"2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e\": rpc error: code = NotFound desc = could not find container \"2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e\": container with ID starting with 2ea6bf7cb8d86968ac74a01619a63027b043ee7898ef420b1ee1fd024cf5744e not found: ID does not exist"
Sep 11 12:45:25.257818 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.257797    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"]
Sep 11 12:45:25.261580 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.261560    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54e055b6-5446957cfd-l7bgw"]
Sep 11 12:45:25.805783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:25.805751    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" path="/var/lib/kubelet/pods/21f06dda-7041-4cb0-a0ee-c0b22a9ff90b/volumes"
Sep 11 12:45:37.433449 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.433410    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"]
Sep 11 12:45:37.433897 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.433617    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9" podUID="86d566e1-8ef3-4d2d-8960-0ab391d76811" containerName="maas-api" containerID="cri-o://5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3" gracePeriod=30
Sep 11 12:45:37.498954 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.498924    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"]
Sep 11 12:45:37.499163 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.499140    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj" podUID="d136e872-95f1-4380-9f2d-1d70952080e8" containerName="payload-pre-processing" containerID="cri-o://e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7" gracePeriod=30
Sep 11 12:45:37.750865 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.750838    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:45:37.780120 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.780092    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:45:37.833449 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.833426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-metrics-certs\") pod \"86d566e1-8ef3-4d2d-8960-0ab391d76811\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") "
Sep 11 12:45:37.833581 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.833485    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62vs4\" (UniqueName: \"kubernetes.io/projected/86d566e1-8ef3-4d2d-8960-0ab391d76811-kube-api-access-62vs4\") pod \"86d566e1-8ef3-4d2d-8960-0ab391d76811\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") "
Sep 11 12:45:37.833581 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.833570    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-maas-api-tls\") pod \"86d566e1-8ef3-4d2d-8960-0ab391d76811\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") "
Sep 11 12:45:37.833677 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.833592    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d566e1-8ef3-4d2d-8960-0ab391d76811-openshift-service-ca\") pod \"86d566e1-8ef3-4d2d-8960-0ab391d76811\" (UID: \"86d566e1-8ef3-4d2d-8960-0ab391d76811\") "
Sep 11 12:45:37.833994 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.833973    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d566e1-8ef3-4d2d-8960-0ab391d76811-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86d566e1-8ef3-4d2d-8960-0ab391d76811" (UID: "86d566e1-8ef3-4d2d-8960-0ab391d76811"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:37.835497 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.835475    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "86d566e1-8ef3-4d2d-8960-0ab391d76811" (UID: "86d566e1-8ef3-4d2d-8960-0ab391d76811"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:37.835596 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.835576    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86d566e1-8ef3-4d2d-8960-0ab391d76811" (UID: "86d566e1-8ef3-4d2d-8960-0ab391d76811"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:45:37.835640 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.835609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d566e1-8ef3-4d2d-8960-0ab391d76811-kube-api-access-62vs4" (OuterVolumeSpecName: "kube-api-access-62vs4") pod "86d566e1-8ef3-4d2d-8960-0ab391d76811" (UID: "86d566e1-8ef3-4d2d-8960-0ab391d76811"). InnerVolumeSpecName "kube-api-access-62vs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:37.934604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khtkh\" (UniqueName: \"kubernetes.io/projected/d136e872-95f1-4380-9f2d-1d70952080e8-kube-api-access-khtkh\") pod \"d136e872-95f1-4380-9f2d-1d70952080e8\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") "
Sep 11 12:45:37.934741 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d136e872-95f1-4380-9f2d-1d70952080e8-plugins-config-volume\") pod \"d136e872-95f1-4380-9f2d-1d70952080e8\" (UID: \"d136e872-95f1-4380-9f2d-1d70952080e8\") "
Sep 11 12:45:37.934820 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934809    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:37.934857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934821    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d566e1-8ef3-4d2d-8960-0ab391d76811-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:37.934857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934834    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86d566e1-8ef3-4d2d-8960-0ab391d76811-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:37.934857 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934847    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62vs4\" (UniqueName: \"kubernetes.io/projected/86d566e1-8ef3-4d2d-8960-0ab391d76811-kube-api-access-62vs4\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:37.934974 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.934954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d136e872-95f1-4380-9f2d-1d70952080e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d136e872-95f1-4380-9f2d-1d70952080e8" (UID: "d136e872-95f1-4380-9f2d-1d70952080e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:45:37.936497 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:37.936466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d136e872-95f1-4380-9f2d-1d70952080e8-kube-api-access-khtkh" (OuterVolumeSpecName: "kube-api-access-khtkh") pod "d136e872-95f1-4380-9f2d-1d70952080e8" (UID: "d136e872-95f1-4380-9f2d-1d70952080e8"). InnerVolumeSpecName "kube-api-access-khtkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:45:38.036314 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.036245    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khtkh\" (UniqueName: \"kubernetes.io/projected/d136e872-95f1-4380-9f2d-1d70952080e8-kube-api-access-khtkh\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:38.036314 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.036271    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d136e872-95f1-4380-9f2d-1d70952080e8-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:45:38.303217 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.303135    2563 generic.go:356] "Generic (PLEG): container finished" podID="d136e872-95f1-4380-9f2d-1d70952080e8" containerID="e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7" exitCode=0
Sep 11 12:45:38.303217 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.303180    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"
Sep 11 12:45:38.303473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.303234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj" event={"ID":"d136e872-95f1-4380-9f2d-1d70952080e8","Type":"ContainerDied","Data":"e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7"}
Sep 11 12:45:38.303473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.303286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj" event={"ID":"d136e872-95f1-4380-9f2d-1d70952080e8","Type":"ContainerDied","Data":"e494d136ae46e99ea08061c5d28f0ac1bff952dc309a4b915514ac5a6c00df68"}
Sep 11 12:45:38.303473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.303312    2563 scope.go:117] "RemoveContainer" containerID="e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7"
Sep 11 12:45:38.304645 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.304625    2563 generic.go:356] "Generic (PLEG): container finished" podID="86d566e1-8ef3-4d2d-8960-0ab391d76811" containerID="5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3" exitCode=0
Sep 11 12:45:38.304715 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.304668    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9" event={"ID":"86d566e1-8ef3-4d2d-8960-0ab391d76811","Type":"ContainerDied","Data":"5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3"}
Sep 11 12:45:38.304759 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.304722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9" event={"ID":"86d566e1-8ef3-4d2d-8960-0ab391d76811","Type":"ContainerDied","Data":"2d71ac37ac1aad1c3a28f00bba1ed8f619400436394d1afc179f38c7730c0f4d"}
Sep 11 12:45:38.304759 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.304680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"
Sep 11 12:45:38.312549 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.312534    2563 scope.go:117] "RemoveContainer" containerID="e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7"
Sep 11 12:45:38.312880 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:38.312862    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7\": container with ID starting with e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7 not found: ID does not exist" containerID="e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7"
Sep 11 12:45:38.312938 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.312887    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7"} err="failed to get container status \"e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7\": rpc error: code = NotFound desc = could not find container \"e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7\": container with ID starting with e6f45da6deb11124ed4f7302eb49fbf5398c7b0cab8982523f438ee3840c3cd7 not found: ID does not exist"
Sep 11 12:45:38.312938 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.312904    2563 scope.go:117] "RemoveContainer" containerID="5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3"
Sep 11 12:45:38.321177 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.321157    2563 scope.go:117] "RemoveContainer" containerID="5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3"
Sep 11 12:45:38.321440 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:38.321425    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3\": container with ID starting with 5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3 not found: ID does not exist" containerID="5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3"
Sep 11 12:45:38.321503 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.321448    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3"} err="failed to get container status \"5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3\": rpc error: code = NotFound desc = could not find container \"5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3\": container with ID starting with 5cb2d93fe4f793f06ea8f2a287ee2908327ab9e0fa98a1a0c748bc11a98cc6e3 not found: ID does not exist"
Sep 11 12:45:38.329093 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.329072    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"]
Sep 11 12:45:38.330922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.330903    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f06aba-5fb5bf47f9-f6zp9"]
Sep 11 12:45:38.343870 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.343847    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"]
Sep 11 12:45:38.350464 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:38.350446    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f06aba-85b6fcb54b-shwtj"]
Sep 11 12:45:39.805680 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:39.805647    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d566e1-8ef3-4d2d-8960-0ab391d76811" path="/var/lib/kubelet/pods/86d566e1-8ef3-4d2d-8960-0ab391d76811/volumes"
Sep 11 12:45:39.806034 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:39.805989    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d136e872-95f1-4380-9f2d-1d70952080e8" path="/var/lib/kubelet/pods/d136e872-95f1-4380-9f2d-1d70952080e8/volumes"
Sep 11 12:45:49.287006 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.286967    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"]
Sep 11 12:45:49.287643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287613    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" containerName="maas-api"
Sep 11 12:45:49.287643 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287638    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287650    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d566e1-8ef3-4d2d-8960-0ab391d76811" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287661    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d566e1-8ef3-4d2d-8960-0ab391d76811" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287679    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d136e872-95f1-4380-9f2d-1d70952080e8" containerName="payload-pre-processing"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287685    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d136e872-95f1-4380-9f2d-1d70952080e8" containerName="payload-pre-processing"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287706    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e8cce2-9e90-402b-9940-fefb975a3c36" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287711    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e8cce2-9e90-402b-9940-fefb975a3c36" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287723    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d75d73-4573-4fa2-89bf-fef6390f720b" containerName="payload-processing"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287730    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d75d73-4573-4fa2-89bf-fef6390f720b" containerName="payload-processing"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287798    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d75d73-4573-4fa2-89bf-fef6390f720b" containerName="payload-processing"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287808    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d566e1-8ef3-4d2d-8960-0ab391d76811" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287815    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e8cce2-9e90-402b-9940-fefb975a3c36" containerName="maas-api"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287821    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d136e872-95f1-4380-9f2d-1d70952080e8" containerName="payload-pre-processing"
Sep 11 12:45:49.287842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.287826    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f06dda-7041-4cb0-a0ee-c0b22a9ff90b" containerName="maas-api"
Sep 11 12:45:49.292691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.292671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.295462 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.295439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-c0bbb3-serving-cert\""
Sep 11 12:45:49.299670 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.299646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"]
Sep 11 12:45:49.336800 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.336766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.336951 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.336820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbv5j\" (UniqueName: \"kubernetes.io/projected/6897758e-801e-4191-91ff-d7873ce1ffac-kube-api-access-tbv5j\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.336951 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.336925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6897758e-801e-4191-91ff-d7873ce1ffac-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.337034 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.336997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.437922 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.437888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6897758e-801e-4191-91ff-d7873ce1ffac-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.438088 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.437967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.438088 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.437998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.438088 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.438022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbv5j\" (UniqueName: \"kubernetes.io/projected/6897758e-801e-4191-91ff-d7873ce1ffac-kube-api-access-tbv5j\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.438274 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:49.438130    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-serving-cert: secret "maas-api-e2e-shared-a-w3-c0bbb3-serving-cert" not found
Sep 11 12:45:49.438274 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:49.438229    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls podName:6897758e-801e-4191-91ff-d7873ce1ffac nodeName:}" failed. No retries permitted until 2026-09-11 12:45:49.938207341 +0000 UTC m=+1150.651210359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls") pod "maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" (UID: "6897758e-801e-4191-91ff-d7873ce1ffac") : secret "maas-api-e2e-shared-a-w3-c0bbb3-serving-cert" not found
Sep 11 12:45:49.438784 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.438743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6897758e-801e-4191-91ff-d7873ce1ffac-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.440656 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.440636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.452118 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.452095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbv5j\" (UniqueName: \"kubernetes.io/projected/6897758e-801e-4191-91ff-d7873ce1ffac-kube-api-access-tbv5j\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.941884 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.941845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.944239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.944211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:49.992735 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.992698    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"]
Sep 11 12:45:49.998913 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:49.998891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.001889 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.001862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-c0bbb3-dockercfg-l8ltg\""
Sep 11 12:45:50.002139 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.001913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-c0bbb3\""
Sep 11 12:45:50.005588 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.005565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"]
Sep 11 12:45:50.043224 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.043199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skpkv\" (UniqueName: \"kubernetes.io/projected/13908e38-0893-48fa-bf0a-e2b0ad3380b9-kube-api-access-skpkv\") pod \"payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.043424 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.043236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13908e38-0893-48fa-bf0a-e2b0ad3380b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.144665 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.144632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skpkv\" (UniqueName: \"kubernetes.io/projected/13908e38-0893-48fa-bf0a-e2b0ad3380b9-kube-api-access-skpkv\") pod \"payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.144665 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.144665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13908e38-0893-48fa-bf0a-e2b0ad3380b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.145320 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.145300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13908e38-0893-48fa-bf0a-e2b0ad3380b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.152744 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.152722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skpkv\" (UniqueName: \"kubernetes.io/projected/13908e38-0893-48fa-bf0a-e2b0ad3380b9-kube-api-access-skpkv\") pod \"payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.205303 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.205242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:50.311717 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.311687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:50.486755 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.486733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"]
Sep 11 12:45:50.489503 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:45:50.489478    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6897758e_801e_4191_91ff_d7873ce1ffac.slice/crio-1dc45e1851e18ffd0a8c71ecb94246c4cb91b41221d978d65ae67702741c09ee WatchSource:0}: Error finding container 1dc45e1851e18ffd0a8c71ecb94246c4cb91b41221d978d65ae67702741c09ee: Status 404 returned error can't find the container with id 1dc45e1851e18ffd0a8c71ecb94246c4cb91b41221d978d65ae67702741c09ee
Sep 11 12:45:50.583862 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.583835    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"]
Sep 11 12:45:50.585991 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:45:50.585967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13908e38_0893_48fa_bf0a_e2b0ad3380b9.slice/crio-68bd4681c3df2bb6056203e338443d001a46f7fe6f07220a8e83dfe6e8554383 WatchSource:0}: Error finding container 68bd4681c3df2bb6056203e338443d001a46f7fe6f07220a8e83dfe6e8554383: Status 404 returned error can't find the container with id 68bd4681c3df2bb6056203e338443d001a46f7fe6f07220a8e83dfe6e8554383
Sep 11 12:45:50.845724 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.845645    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"]
Sep 11 12:45:50.849649 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.849625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:50.853156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.853128    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-ce2636-serving-cert\""
Sep 11 12:45:50.876818 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.876792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"]
Sep 11 12:45:50.953944 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.953906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fb0446-c3a0-441e-a81d-f52a0eff71ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:50.954126 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.954018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:50.954185 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.954148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljwz\" (UniqueName: \"kubernetes.io/projected/22fb0446-c3a0-441e-a81d-f52a0eff71ee-kube-api-access-bljwz\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:50.954185 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:50.954172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.055081 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.055046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.055278 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.055104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljwz\" (UniqueName: \"kubernetes.io/projected/22fb0446-c3a0-441e-a81d-f52a0eff71ee-kube-api-access-bljwz\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.055278 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.055131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.055278 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.055190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fb0446-c3a0-441e-a81d-f52a0eff71ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.055531 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:51.055308    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-serving-cert: secret "maas-api-e2e-shared-a-w2-ce2636-serving-cert" not found
Sep 11 12:45:51.055531 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:45:51.055396    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls podName:22fb0446-c3a0-441e-a81d-f52a0eff71ee nodeName:}" failed. No retries permitted until 2026-09-11 12:45:51.555375829 +0000 UTC m=+1152.268378849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls") pod "maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" (UID: "22fb0446-c3a0-441e-a81d-f52a0eff71ee") : secret "maas-api-e2e-shared-a-w2-ce2636-serving-cert" not found
Sep 11 12:45:51.055983 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.055960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fb0446-c3a0-441e-a81d-f52a0eff71ee-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.058066 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.058044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.066471 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.066443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljwz\" (UniqueName: \"kubernetes.io/projected/22fb0446-c3a0-441e-a81d-f52a0eff71ee-kube-api-access-bljwz\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.376181 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.376142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn" event={"ID":"13908e38-0893-48fa-bf0a-e2b0ad3380b9","Type":"ContainerStarted","Data":"7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311"}
Sep 11 12:45:51.376772 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.376744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:45:51.376902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.376788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn" event={"ID":"13908e38-0893-48fa-bf0a-e2b0ad3380b9","Type":"ContainerStarted","Data":"68bd4681c3df2bb6056203e338443d001a46f7fe6f07220a8e83dfe6e8554383"}
Sep 11 12:45:51.378722 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.378696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" event={"ID":"6897758e-801e-4191-91ff-d7873ce1ffac","Type":"ContainerStarted","Data":"83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8"}
Sep 11 12:45:51.378835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.378751    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:51.378835 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.378782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" event={"ID":"6897758e-801e-4191-91ff-d7873ce1ffac","Type":"ContainerStarted","Data":"1dc45e1851e18ffd0a8c71ecb94246c4cb91b41221d978d65ae67702741c09ee"}
Sep 11 12:45:51.394809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.394759    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn" podStartSLOduration=2.394740351 podStartE2EDuration="2.394740351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:51.393471407 +0000 UTC m=+1152.106474443" watchObservedRunningTime="2026-09-11 12:45:51.394740351 +0000 UTC m=+1152.107743388"
Sep 11 12:45:51.413495 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.413455    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" podStartSLOduration=1.725492648 podStartE2EDuration="2.413441537s" totalImagesPullingTime="687.948889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:51.411151287 +0000 UTC m=+1152.124154328" watchObservedRunningTime="2026-09-11 12:45:51.413441537 +0000 UTC m=+1152.126444570"
Sep 11 12:45:51.496946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.496869    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"]
Sep 11 12:45:51.500602 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.500572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.503332 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.503311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-ce2636\""
Sep 11 12:45:51.503424 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.503311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-ce2636-dockercfg-6n46c\""
Sep 11 12:45:51.514275 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.514257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"]
Sep 11 12:45:51.559655 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.559618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.559818 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.559727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801a3281-dc8b-404e-91ff-38b9339fb69a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.559818 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.559771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4n7\" (UniqueName: \"kubernetes.io/projected/801a3281-dc8b-404e-91ff-38b9339fb69a-kube-api-access-9l4n7\") pod \"payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.562405 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.562379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.660697 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.660663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4n7\" (UniqueName: \"kubernetes.io/projected/801a3281-dc8b-404e-91ff-38b9339fb69a-kube-api-access-9l4n7\") pod \"payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.660866 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.660832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801a3281-dc8b-404e-91ff-38b9339fb69a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.661648 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.661626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801a3281-dc8b-404e-91ff-38b9339fb69a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.670008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.669983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4n7\" (UniqueName: \"kubernetes.io/projected/801a3281-dc8b-404e-91ff-38b9339fb69a-kube-api-access-9l4n7\") pod \"payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:51.761179 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.761100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:51.811725 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:51.811644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:52.033959 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.033937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"]
Sep 11 12:45:52.035990 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:45:52.035941    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fb0446_c3a0_441e_a81d_f52a0eff71ee.slice/crio-a29095e8065b82ff3d8b6b0be66a3cb1ff57c5dcd37d52293486a674c189a755 WatchSource:0}: Error finding container a29095e8065b82ff3d8b6b0be66a3cb1ff57c5dcd37d52293486a674c189a755: Status 404 returned error can't find the container with id a29095e8065b82ff3d8b6b0be66a3cb1ff57c5dcd37d52293486a674c189a755
Sep 11 12:45:52.102623 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.102600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"]
Sep 11 12:45:52.104276 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:45:52.104252    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801a3281_dc8b_404e_91ff_38b9339fb69a.slice/crio-0dca86683730e490997250b5c3b8959c9c194970c738d9c57a3a60ae333d3846 WatchSource:0}: Error finding container 0dca86683730e490997250b5c3b8959c9c194970c738d9c57a3a60ae333d3846: Status 404 returned error can't find the container with id 0dca86683730e490997250b5c3b8959c9c194970c738d9c57a3a60ae333d3846
Sep 11 12:45:52.386586 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.386561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd" event={"ID":"801a3281-dc8b-404e-91ff-38b9339fb69a","Type":"ContainerStarted","Data":"a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9"}
Sep 11 12:45:52.386950 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.386606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd" event={"ID":"801a3281-dc8b-404e-91ff-38b9339fb69a","Type":"ContainerStarted","Data":"0dca86683730e490997250b5c3b8959c9c194970c738d9c57a3a60ae333d3846"}
Sep 11 12:45:52.386950 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.386659    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:45:52.387933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.387905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" event={"ID":"22fb0446-c3a0-441e-a81d-f52a0eff71ee","Type":"ContainerStarted","Data":"a29095e8065b82ff3d8b6b0be66a3cb1ff57c5dcd37d52293486a674c189a755"}
Sep 11 12:45:52.405163 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:52.405121    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd" podStartSLOduration=1.405106827 podStartE2EDuration="1.405106827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:52.403159374 +0000 UTC m=+1153.116162414" watchObservedRunningTime="2026-09-11 12:45:52.405106827 +0000 UTC m=+1153.118109863"
Sep 11 12:45:53.397102 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:53.397060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" event={"ID":"22fb0446-c3a0-441e-a81d-f52a0eff71ee","Type":"ContainerStarted","Data":"5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0"}
Sep 11 12:45:53.397646 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:53.397471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:45:53.415439 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:53.415397    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" podStartSLOduration=3.087218917 podStartE2EDuration="3.415382751s" totalImagesPullingTime="328.163834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:45:53.414544761 +0000 UTC m=+1154.127547798" watchObservedRunningTime="2026-09-11 12:45:53.415382751 +0000 UTC m=+1154.128385791"
Sep 11 12:45:57.393449 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:57.393420    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:45:59.408190 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:45:59.408163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:46:03.399185 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:03.399108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:46:03.399676 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:03.399439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:46:17.557053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.557020    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"]
Sep 11 12:46:17.561161 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.561132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.566228 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.566208    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-1337fa-serving-cert\""
Sep 11 12:46:17.574495 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.574469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"]
Sep 11 12:46:17.703099 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.703063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.703262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.703106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69m4j\" (UniqueName: \"kubernetes.io/projected/f0faa8cb-3eaf-4085-8f36-0a86778fb552-kube-api-access-69m4j\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.703262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.703215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0faa8cb-3eaf-4085-8f36-0a86778fb552-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.703344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.703259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.804771 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.804736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0faa8cb-3eaf-4085-8f36-0a86778fb552-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.805038 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.805018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.805170 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.805155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.805291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.805278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69m4j\" (UniqueName: \"kubernetes.io/projected/f0faa8cb-3eaf-4085-8f36-0a86778fb552-kube-api-access-69m4j\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.806528 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.806504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0faa8cb-3eaf-4085-8f36-0a86778fb552-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.809244 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.809190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.809629 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.809607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.813975 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.813954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69m4j\" (UniqueName: \"kubernetes.io/projected/f0faa8cb-3eaf-4085-8f36-0a86778fb552-kube-api-access-69m4j\") pod \"maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:17.875230 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:17.875199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:18.150134 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:18.150110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"]
Sep 11 12:46:18.153036 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:46:18.153003    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0faa8cb_3eaf_4085_8f36_0a86778fb552.slice/crio-86edd979c6f1e8c7f248b12c36d90291aacd4e690fe4866217040820ef4687d5 WatchSource:0}: Error finding container 86edd979c6f1e8c7f248b12c36d90291aacd4e690fe4866217040820ef4687d5: Status 404 returned error can't find the container with id 86edd979c6f1e8c7f248b12c36d90291aacd4e690fe4866217040820ef4687d5
Sep 11 12:46:18.524155 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:18.524122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs" event={"ID":"f0faa8cb-3eaf-4085-8f36-0a86778fb552","Type":"ContainerStarted","Data":"86edd979c6f1e8c7f248b12c36d90291aacd4e690fe4866217040820ef4687d5"}
Sep 11 12:46:19.531850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:19.531819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs" event={"ID":"f0faa8cb-3eaf-4085-8f36-0a86778fb552","Type":"ContainerStarted","Data":"7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7"}
Sep 11 12:46:19.532213 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:19.531899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:19.553351 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:19.553307    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs" podStartSLOduration=2.211352141 podStartE2EDuration="2.553293158s" totalImagesPullingTime="341.941017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:19.551663836 +0000 UTC m=+1180.264666877" watchObservedRunningTime="2026-09-11 12:46:19.553293158 +0000 UTC m=+1180.266296239"
Sep 11 12:46:25.541904 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:25.541873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:46:39.835852 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:39.835807    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:46:39.838446 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:39.838425    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:46:39.844286 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:39.844263    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:46:39.846818 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:39.846796    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:46:57.476211 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.476154    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"]
Sep 11 12:46:57.480046 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.480028    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.483640 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.483616    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f3fae345\""
Sep 11 12:46:57.492633 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.492607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"]
Sep 11 12:46:57.511946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.511916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"]
Sep 11 12:46:57.515562 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.515542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.519305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.519283    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f3fae345-dockercfg-2lsbn\""
Sep 11 12:46:57.527948 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.527924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"]
Sep 11 12:46:57.604752 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.604719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4fjq\" (UniqueName: \"kubernetes.io/projected/e57ff977-4313-460b-92c9-085d998bde8c-kube-api-access-z4fjq\") pod \"payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") " pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.604957 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.604808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7qxf\" (UniqueName: \"kubernetes.io/projected/a3e14387-ee0a-4c50-b0ba-54429772cd35-kube-api-access-m7qxf\") pod \"payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.604957 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.604923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57ff977-4313-460b-92c9-085d998bde8c-plugins-config-volume\") pod \"payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") " pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.605104 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.604977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e14387-ee0a-4c50-b0ba-54429772cd35-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.706560 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.706520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7qxf\" (UniqueName: \"kubernetes.io/projected/a3e14387-ee0a-4c50-b0ba-54429772cd35-kube-api-access-m7qxf\") pod \"payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.706756 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.706585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57ff977-4313-460b-92c9-085d998bde8c-plugins-config-volume\") pod \"payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") " pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.706756 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.706609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e14387-ee0a-4c50-b0ba-54429772cd35-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.706756 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.706653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4fjq\" (UniqueName: \"kubernetes.io/projected/e57ff977-4313-460b-92c9-085d998bde8c-kube-api-access-z4fjq\") pod \"payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") " pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.707427 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.707402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57ff977-4313-460b-92c9-085d998bde8c-plugins-config-volume\") pod \"payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") " pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.707427 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.707420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e14387-ee0a-4c50-b0ba-54429772cd35-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.715236 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.715202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7qxf\" (UniqueName: \"kubernetes.io/projected/a3e14387-ee0a-4c50-b0ba-54429772cd35-kube-api-access-m7qxf\") pod \"payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.715386 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.715331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4fjq\" (UniqueName: \"kubernetes.io/projected/e57ff977-4313-460b-92c9-085d998bde8c-kube-api-access-z4fjq\") pod \"payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") " pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:57.790859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.790774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:57.829528 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:57.829486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:58.066116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.066091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"]
Sep 11 12:46:58.068517 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:46:58.068489    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e14387_ee0a_4c50_b0ba_54429772cd35.slice/crio-edaa129b8997dd8d8770eb61a5798e259d54d002be530e3bc101ee695b2fdc81 WatchSource:0}: Error finding container edaa129b8997dd8d8770eb61a5798e259d54d002be530e3bc101ee695b2fdc81: Status 404 returned error can't find the container with id edaa129b8997dd8d8770eb61a5798e259d54d002be530e3bc101ee695b2fdc81
Sep 11 12:46:58.119265 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.119238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"]
Sep 11 12:46:58.124650 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:46:58.124621    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57ff977_4313_460b_92c9_085d998bde8c.slice/crio-cbcd6618d76e7f9c51e2d535d54f4ae8f595fde1abb3b9764544412043cf53af WatchSource:0}: Error finding container cbcd6618d76e7f9c51e2d535d54f4ae8f595fde1abb3b9764544412043cf53af: Status 404 returned error can't find the container with id cbcd6618d76e7f9c51e2d535d54f4ae8f595fde1abb3b9764544412043cf53af
Sep 11 12:46:58.738095 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.738054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj" event={"ID":"a3e14387-ee0a-4c50-b0ba-54429772cd35","Type":"ContainerStarted","Data":"f8fac238032a3a2b41fb322d448c02f512d434599191dac856d0c1dd6a45a04d"}
Sep 11 12:46:58.738589 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.738161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj" event={"ID":"a3e14387-ee0a-4c50-b0ba-54429772cd35","Type":"ContainerStarted","Data":"edaa129b8997dd8d8770eb61a5798e259d54d002be530e3bc101ee695b2fdc81"}
Sep 11 12:46:58.738589 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.738193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:46:58.739931 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.739906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4" event={"ID":"e57ff977-4313-460b-92c9-085d998bde8c","Type":"ContainerStarted","Data":"9622f6074e64c825822c71ed43bf166878c111bb4136e8f0459ef8451bfa2851"}
Sep 11 12:46:58.740060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.739952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4" event={"ID":"e57ff977-4313-460b-92c9-085d998bde8c","Type":"ContainerStarted","Data":"cbcd6618d76e7f9c51e2d535d54f4ae8f595fde1abb3b9764544412043cf53af"}
Sep 11 12:46:58.740060 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.740000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:46:58.761135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.761079    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj" podStartSLOduration=1.761060739 podStartE2EDuration="1.761060739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:58.760447076 +0000 UTC m=+1219.473450118" watchObservedRunningTime="2026-09-11 12:46:58.761060739 +0000 UTC m=+1219.474063780"
Sep 11 12:46:58.788954 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:46:58.788892    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4" podStartSLOduration=1.7888715849999999 podStartE2EDuration="1.788871585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:46:58.787769757 +0000 UTC m=+1219.500772795" watchObservedRunningTime="2026-09-11 12:46:58.788871585 +0000 UTC m=+1219.501874626"
Sep 11 12:47:09.747733 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:47:09.747696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:47:09.748108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:47:09.747763    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:48:41.140747 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.140708    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"]
Sep 11 12:48:41.141304 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.140965    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4" podUID="e57ff977-4313-460b-92c9-085d998bde8c" containerName="payload-processing" containerID="cri-o://9622f6074e64c825822c71ed43bf166878c111bb4136e8f0459ef8451bfa2851" gracePeriod=30
Sep 11 12:48:41.146233 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.145961    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"]
Sep 11 12:48:41.146233 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.146193    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj" podUID="a3e14387-ee0a-4c50-b0ba-54429772cd35" containerName="payload-pre-processing" containerID="cri-o://f8fac238032a3a2b41fb322d448c02f512d434599191dac856d0c1dd6a45a04d" gracePeriod=30
Sep 11 12:48:41.264513 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.264426    2563 generic.go:356] "Generic (PLEG): container finished" podID="e57ff977-4313-460b-92c9-085d998bde8c" containerID="9622f6074e64c825822c71ed43bf166878c111bb4136e8f0459ef8451bfa2851" exitCode=0
Sep 11 12:48:41.264593 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.264504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4" event={"ID":"e57ff977-4313-460b-92c9-085d998bde8c","Type":"ContainerDied","Data":"9622f6074e64c825822c71ed43bf166878c111bb4136e8f0459ef8451bfa2851"}
Sep 11 12:48:41.266245 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.266222    2563 generic.go:356] "Generic (PLEG): container finished" podID="a3e14387-ee0a-4c50-b0ba-54429772cd35" containerID="f8fac238032a3a2b41fb322d448c02f512d434599191dac856d0c1dd6a45a04d" exitCode=0
Sep 11 12:48:41.266382 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.266297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj" event={"ID":"a3e14387-ee0a-4c50-b0ba-54429772cd35","Type":"ContainerDied","Data":"f8fac238032a3a2b41fb322d448c02f512d434599191dac856d0c1dd6a45a04d"}
Sep 11 12:48:41.424965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.424942    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:48:41.428036 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.428012    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:48:41.471316 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471289    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e14387-ee0a-4c50-b0ba-54429772cd35-plugins-config-volume\") pod \"a3e14387-ee0a-4c50-b0ba-54429772cd35\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") "
Sep 11 12:48:41.471477 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471330    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57ff977-4313-460b-92c9-085d998bde8c-plugins-config-volume\") pod \"e57ff977-4313-460b-92c9-085d998bde8c\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") "
Sep 11 12:48:41.471477 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7qxf\" (UniqueName: \"kubernetes.io/projected/a3e14387-ee0a-4c50-b0ba-54429772cd35-kube-api-access-m7qxf\") pod \"a3e14387-ee0a-4c50-b0ba-54429772cd35\" (UID: \"a3e14387-ee0a-4c50-b0ba-54429772cd35\") "
Sep 11 12:48:41.471477 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471478    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4fjq\" (UniqueName: \"kubernetes.io/projected/e57ff977-4313-460b-92c9-085d998bde8c-kube-api-access-z4fjq\") pod \"e57ff977-4313-460b-92c9-085d998bde8c\" (UID: \"e57ff977-4313-460b-92c9-085d998bde8c\") "
Sep 11 12:48:41.471664 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471644    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e14387-ee0a-4c50-b0ba-54429772cd35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3e14387-ee0a-4c50-b0ba-54429772cd35" (UID: "a3e14387-ee0a-4c50-b0ba-54429772cd35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:48:41.471727 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57ff977-4313-460b-92c9-085d998bde8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e57ff977-4313-460b-92c9-085d998bde8c" (UID: "e57ff977-4313-460b-92c9-085d998bde8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:48:41.471727 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.471714    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e14387-ee0a-4c50-b0ba-54429772cd35-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.473512 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.473486    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3e14387-ee0a-4c50-b0ba-54429772cd35-kube-api-access-m7qxf" (OuterVolumeSpecName: "kube-api-access-m7qxf") pod "a3e14387-ee0a-4c50-b0ba-54429772cd35" (UID: "a3e14387-ee0a-4c50-b0ba-54429772cd35"). InnerVolumeSpecName "kube-api-access-m7qxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:48:41.473648 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.473588    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57ff977-4313-460b-92c9-085d998bde8c-kube-api-access-z4fjq" (OuterVolumeSpecName: "kube-api-access-z4fjq") pod "e57ff977-4313-460b-92c9-085d998bde8c" (UID: "e57ff977-4313-460b-92c9-085d998bde8c"). InnerVolumeSpecName "kube-api-access-z4fjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:48:41.572691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.572656    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7qxf\" (UniqueName: \"kubernetes.io/projected/a3e14387-ee0a-4c50-b0ba-54429772cd35-kube-api-access-m7qxf\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.572691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.572682    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4fjq\" (UniqueName: \"kubernetes.io/projected/e57ff977-4313-460b-92c9-085d998bde8c-kube-api-access-z4fjq\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:48:41.572691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:41.572691    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e57ff977-4313-460b-92c9-085d998bde8c-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:48:42.273005 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.272975    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"
Sep 11 12:48:42.273461 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.273004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj" event={"ID":"a3e14387-ee0a-4c50-b0ba-54429772cd35","Type":"ContainerDied","Data":"edaa129b8997dd8d8770eb61a5798e259d54d002be530e3bc101ee695b2fdc81"}
Sep 11 12:48:42.273461 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.273060    2563 scope.go:117] "RemoveContainer" containerID="f8fac238032a3a2b41fb322d448c02f512d434599191dac856d0c1dd6a45a04d"
Sep 11 12:48:42.274440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.274419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4" event={"ID":"e57ff977-4313-460b-92c9-085d998bde8c","Type":"ContainerDied","Data":"cbcd6618d76e7f9c51e2d535d54f4ae8f595fde1abb3b9764544412043cf53af"}
Sep 11 12:48:42.274529 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.274438    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"
Sep 11 12:48:42.281850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.281835    2563 scope.go:117] "RemoveContainer" containerID="9622f6074e64c825822c71ed43bf166878c111bb4136e8f0459ef8451bfa2851"
Sep 11 12:48:42.291213 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.291190    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"]
Sep 11 12:48:42.295116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.295093    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f3fae345-788899d666-56jdj"]
Sep 11 12:48:42.310621 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.310597    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"]
Sep 11 12:48:42.314557 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:42.314537    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f3fae345-f4f544b45-4nbf4"]
Sep 11 12:48:43.805523 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:43.805489    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3e14387-ee0a-4c50-b0ba-54429772cd35" path="/var/lib/kubelet/pods/a3e14387-ee0a-4c50-b0ba-54429772cd35/volumes"
Sep 11 12:48:43.805900 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:48:43.805855    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57ff977-4313-460b-92c9-085d998bde8c" path="/var/lib/kubelet/pods/e57ff977-4313-460b-92c9-085d998bde8c/volumes"
Sep 11 12:50:37.873902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.873828    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"]
Sep 11 12:50:37.874435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.874300    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57ff977-4313-460b-92c9-085d998bde8c" containerName="payload-processing"
Sep 11 12:50:37.874435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.874313    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57ff977-4313-460b-92c9-085d998bde8c" containerName="payload-processing"
Sep 11 12:50:37.874435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.874326    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e14387-ee0a-4c50-b0ba-54429772cd35" containerName="payload-pre-processing"
Sep 11 12:50:37.874435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.874333    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e14387-ee0a-4c50-b0ba-54429772cd35" containerName="payload-pre-processing"
Sep 11 12:50:37.874435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.874425    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57ff977-4313-460b-92c9-085d998bde8c" containerName="payload-processing"
Sep 11 12:50:37.874435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.874437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e14387-ee0a-4c50-b0ba-54429772cd35" containerName="payload-pre-processing"
Sep 11 12:50:37.877892 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.877868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:37.881174 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.881151    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-1e1e43-dockercfg-j97g7\""
Sep 11 12:50:37.881275 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.881152    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1e1e43\""
Sep 11 12:50:37.890084 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.890065    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"]
Sep 11 12:50:37.919574 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.919547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"]
Sep 11 12:50:37.923195 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.923175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:37.934708 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.934684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"]
Sep 11 12:50:37.950656 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.950633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc9cw\" (UniqueName: \"kubernetes.io/projected/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-kube-api-access-cc9cw\") pod \"payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:37.950761 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.950670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:37.950761 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.950696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmkkx\" (UniqueName: \"kubernetes.io/projected/ab622551-56f5-4b96-b8d7-3feee292072b-kube-api-access-mmkkx\") pod \"payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") " pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:37.950761 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:37.950749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab622551-56f5-4b96-b8d7-3feee292072b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") " pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.051711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.051675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmkkx\" (UniqueName: \"kubernetes.io/projected/ab622551-56f5-4b96-b8d7-3feee292072b-kube-api-access-mmkkx\") pod \"payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") " pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.051902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.051728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab622551-56f5-4b96-b8d7-3feee292072b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") " pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.051902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.051845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc9cw\" (UniqueName: \"kubernetes.io/projected/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-kube-api-access-cc9cw\") pod \"payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:38.051902 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.051877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:38.052640 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.052617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:38.052713 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.052679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab622551-56f5-4b96-b8d7-3feee292072b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") " pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.060486 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.060448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc9cw\" (UniqueName: \"kubernetes.io/projected/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-kube-api-access-cc9cw\") pod \"payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:38.060641 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.060618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmkkx\" (UniqueName: \"kubernetes.io/projected/ab622551-56f5-4b96-b8d7-3feee292072b-kube-api-access-mmkkx\") pod \"payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") " pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.189079 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.189057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:38.234329 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.234296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.462749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.462720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"]
Sep 11 12:50:38.465454 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:50:38.465419    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fd6aa9_c3b9_4efc_91ea_d91d358afc2c.slice/crio-338eec99af846f688f6431e2515977ecb855ed579261d424440cbc7347b07c8f WatchSource:0}: Error finding container 338eec99af846f688f6431e2515977ecb855ed579261d424440cbc7347b07c8f: Status 404 returned error can't find the container with id 338eec99af846f688f6431e2515977ecb855ed579261d424440cbc7347b07c8f
Sep 11 12:50:38.519685 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.519658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"]
Sep 11 12:50:38.522385 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:50:38.522328    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab622551_56f5_4b96_b8d7_3feee292072b.slice/crio-7ba7eaf1bd62931e5425ca083b680fe88a1589496993b9fb42e0bcfd76ffec02 WatchSource:0}: Error finding container 7ba7eaf1bd62931e5425ca083b680fe88a1589496993b9fb42e0bcfd76ffec02: Status 404 returned error can't find the container with id 7ba7eaf1bd62931e5425ca083b680fe88a1589496993b9fb42e0bcfd76ffec02
Sep 11 12:50:38.859485 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.859400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b" event={"ID":"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c","Type":"ContainerStarted","Data":"d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c"}
Sep 11 12:50:38.859485 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.859463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:38.859690 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.859491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b" event={"ID":"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c","Type":"ContainerStarted","Data":"338eec99af846f688f6431e2515977ecb855ed579261d424440cbc7347b07c8f"}
Sep 11 12:50:38.860975 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.860948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb" event={"ID":"ab622551-56f5-4b96-b8d7-3feee292072b","Type":"ContainerStarted","Data":"056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35"}
Sep 11 12:50:38.861090 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.860995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb" event={"ID":"ab622551-56f5-4b96-b8d7-3feee292072b","Type":"ContainerStarted","Data":"7ba7eaf1bd62931e5425ca083b680fe88a1589496993b9fb42e0bcfd76ffec02"}
Sep 11 12:50:38.861090 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.861023    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:50:38.880722 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.880674    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b" podStartSLOduration=1.880655878 podStartE2EDuration="1.880655878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:50:38.878290211 +0000 UTC m=+1439.591293263" watchObservedRunningTime="2026-09-11 12:50:38.880655878 +0000 UTC m=+1439.593658917"
Sep 11 12:50:38.896281 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:38.896231    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb" podStartSLOduration=1.8962210229999998 podStartE2EDuration="1.896221023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:50:38.895095866 +0000 UTC m=+1439.608098903" watchObservedRunningTime="2026-09-11 12:50:38.896221023 +0000 UTC m=+1439.609224092"
Sep 11 12:50:49.868110 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:49.868081    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:50:49.868716 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:50:49.868152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:51:06.604335 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.604300    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"]
Sep 11 12:51:06.608401 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.608355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.611710 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.611691    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1a4a12-serving-cert\""
Sep 11 12:51:06.623249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.623222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"]
Sep 11 12:51:06.725760 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.725729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.725935 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.725797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-openshift-service-ca\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.725935 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.725859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mm8b\" (UniqueName: \"kubernetes.io/projected/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-kube-api-access-6mm8b\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.725935 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.725884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-metrics-certs\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.827350 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.827314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-openshift-service-ca\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.827531 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.827464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mm8b\" (UniqueName: \"kubernetes.io/projected/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-kube-api-access-6mm8b\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.827531 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.827483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-metrics-certs\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.827655 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.827564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.827713 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:51:06.827677    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-serving-cert: secret "maas-api-e2e-api-b-1a4a12-serving-cert" not found
Sep 11 12:51:06.827769 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:51:06.827753    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls podName:c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980 nodeName:}" failed. No retries permitted until 2026-09-11 12:51:07.327732355 +0000 UTC m=+1468.040735372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls") pod "maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" (UID: "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980") : secret "maas-api-e2e-api-b-1a4a12-serving-cert" not found
Sep 11 12:51:06.828087 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.828059    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-openshift-service-ca\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.830009 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.829988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-metrics-certs\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:06.838077 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:06.838054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mm8b\" (UniqueName: \"kubernetes.io/projected/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-kube-api-access-6mm8b\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:07.333127 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:07.333089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:07.335624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:07.335595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls\") pod \"maas-api-e2e-api-b-1a4a12-786c97888d-lc92z\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:07.519065 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:07.519026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:07.795791 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:07.795763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"]
Sep 11 12:51:07.797572 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:51:07.797547    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28e4fb1_b68f_47cd_b9fc_cad4c4bd3980.slice/crio-2f1dfbded813e6979beedaf5023f87b46d54d752401fb3a360729d05a3b9c801 WatchSource:0}: Error finding container 2f1dfbded813e6979beedaf5023f87b46d54d752401fb3a360729d05a3b9c801: Status 404 returned error can't find the container with id 2f1dfbded813e6979beedaf5023f87b46d54d752401fb3a360729d05a3b9c801
Sep 11 12:51:07.798822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:07.798805    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:51:08.010968 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:08.010933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" event={"ID":"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980","Type":"ContainerStarted","Data":"2f1dfbded813e6979beedaf5023f87b46d54d752401fb3a360729d05a3b9c801"}
Sep 11 12:51:09.017982 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:09.017935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" event={"ID":"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980","Type":"ContainerStarted","Data":"1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029"}
Sep 11 12:51:09.018349 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:09.018021    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:09.045072 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:09.045027    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" podStartSLOduration=2.76491262 podStartE2EDuration="3.045013558s" totalImagesPullingTime="280.100938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:51:09.043115078 +0000 UTC m=+1469.756118117" watchObservedRunningTime="2026-09-11 12:51:09.045013558 +0000 UTC m=+1469.758016595"
Sep 11 12:51:15.028977 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:15.028948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:51:39.875315 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:39.875275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:51:39.878703 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:39.878682    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:51:39.878983 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:39.878966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:51:39.890170 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:39.890142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:51:49.271900 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.271867    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"]
Sep 11 12:51:49.272400 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.272099    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b" podUID="25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" containerName="payload-pre-processing" containerID="cri-o://d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c" gracePeriod=30
Sep 11 12:51:49.275213 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.275187    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"]
Sep 11 12:51:49.275473 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.275428    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb" podUID="ab622551-56f5-4b96-b8d7-3feee292072b" containerName="payload-processing" containerID="cri-o://056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35" gracePeriod=30
Sep 11 12:51:49.534884 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.534812    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:51:49.563453 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.563430    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:51:49.644654 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.644617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab622551-56f5-4b96-b8d7-3feee292072b-plugins-config-volume\") pod \"ab622551-56f5-4b96-b8d7-3feee292072b\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") "
Sep 11 12:51:49.644846 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.644718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc9cw\" (UniqueName: \"kubernetes.io/projected/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-kube-api-access-cc9cw\") pod \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") "
Sep 11 12:51:49.644846 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.644758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-plugins-config-volume\") pod \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\" (UID: \"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c\") "
Sep 11 12:51:49.644846 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.644819    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmkkx\" (UniqueName: \"kubernetes.io/projected/ab622551-56f5-4b96-b8d7-3feee292072b-kube-api-access-mmkkx\") pod \"ab622551-56f5-4b96-b8d7-3feee292072b\" (UID: \"ab622551-56f5-4b96-b8d7-3feee292072b\") "
Sep 11 12:51:49.645025 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.644977    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab622551-56f5-4b96-b8d7-3feee292072b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab622551-56f5-4b96-b8d7-3feee292072b" (UID: "ab622551-56f5-4b96-b8d7-3feee292072b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:51:49.645144 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.645117    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" (UID: "25fd6aa9-c3b9-4efc-91ea-d91d358afc2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:51:49.646822 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.646801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-kube-api-access-cc9cw" (OuterVolumeSpecName: "kube-api-access-cc9cw") pod "25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" (UID: "25fd6aa9-c3b9-4efc-91ea-d91d358afc2c"). InnerVolumeSpecName "kube-api-access-cc9cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:51:49.646934 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.646915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab622551-56f5-4b96-b8d7-3feee292072b-kube-api-access-mmkkx" (OuterVolumeSpecName: "kube-api-access-mmkkx") pod "ab622551-56f5-4b96-b8d7-3feee292072b" (UID: "ab622551-56f5-4b96-b8d7-3feee292072b"). InnerVolumeSpecName "kube-api-access-mmkkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:51:49.746604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.746550    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.746604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.746597    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmkkx\" (UniqueName: \"kubernetes.io/projected/ab622551-56f5-4b96-b8d7-3feee292072b-kube-api-access-mmkkx\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.746604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.746607    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab622551-56f5-4b96-b8d7-3feee292072b-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:51:49.746604 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:49.746615    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc9cw\" (UniqueName: \"kubernetes.io/projected/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c-kube-api-access-cc9cw\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:51:50.227790 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.227758    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab622551-56f5-4b96-b8d7-3feee292072b" containerID="056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35" exitCode=0
Sep 11 12:51:50.227960 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.227801    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"
Sep 11 12:51:50.227960 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.227848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb" event={"ID":"ab622551-56f5-4b96-b8d7-3feee292072b","Type":"ContainerDied","Data":"056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35"}
Sep 11 12:51:50.227960 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.227898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb" event={"ID":"ab622551-56f5-4b96-b8d7-3feee292072b","Type":"ContainerDied","Data":"7ba7eaf1bd62931e5425ca083b680fe88a1589496993b9fb42e0bcfd76ffec02"}
Sep 11 12:51:50.227960 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.227925    2563 scope.go:117] "RemoveContainer" containerID="056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35"
Sep 11 12:51:50.229352 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.229326    2563 generic.go:356] "Generic (PLEG): container finished" podID="25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" containerID="d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c" exitCode=0
Sep 11 12:51:50.229518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.229384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"
Sep 11 12:51:50.229518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.229424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b" event={"ID":"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c","Type":"ContainerDied","Data":"d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c"}
Sep 11 12:51:50.229518 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.229485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b" event={"ID":"25fd6aa9-c3b9-4efc-91ea-d91d358afc2c","Type":"ContainerDied","Data":"338eec99af846f688f6431e2515977ecb855ed579261d424440cbc7347b07c8f"}
Sep 11 12:51:50.237031 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.237013    2563 scope.go:117] "RemoveContainer" containerID="056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35"
Sep 11 12:51:50.237277 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:51:50.237261    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35\": container with ID starting with 056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35 not found: ID does not exist" containerID="056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35"
Sep 11 12:51:50.237325 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.237285    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35"} err="failed to get container status \"056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35\": rpc error: code = NotFound desc = could not find container \"056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35\": container with ID starting with 056fd5f1ccdf25194ee3821c8f35ae8dd4a6d7a8e86a940bc49240a459c39f35 not found: ID does not exist"
Sep 11 12:51:50.237325 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.237299    2563 scope.go:117] "RemoveContainer" containerID="d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c"
Sep 11 12:51:50.245084 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.245068    2563 scope.go:117] "RemoveContainer" containerID="d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c"
Sep 11 12:51:50.245374 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:51:50.245339    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c\": container with ID starting with d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c not found: ID does not exist" containerID="d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c"
Sep 11 12:51:50.245434 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.245378    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c"} err="failed to get container status \"d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c\": rpc error: code = NotFound desc = could not find container \"d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c\": container with ID starting with d86c14863310ca34f625425ceb7bfe563f5992f94b5da46e108262c1b58d729c not found: ID does not exist"
Sep 11 12:51:50.248395 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.248374    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"]
Sep 11 12:51:50.252776 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.252756    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1e1e43-79884d4bb6-fcw5b"]
Sep 11 12:51:50.268175 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.268154    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"]
Sep 11 12:51:50.276811 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:50.276789    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1e1e43-6c969bf69c-hzspb"]
Sep 11 12:51:51.806482 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:51.806446    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" path="/var/lib/kubelet/pods/25fd6aa9-c3b9-4efc-91ea-d91d358afc2c/volumes"
Sep 11 12:51:51.806920 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:51:51.806826    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab622551-56f5-4b96-b8d7-3feee292072b" path="/var/lib/kubelet/pods/ab622551-56f5-4b96-b8d7-3feee292072b/volumes"
Sep 11 12:52:13.478598 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.478564    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"]
Sep 11 12:52:13.479056 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.478762    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" podUID="c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" containerName="maas-api" containerID="cri-o://1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029" gracePeriod=30
Sep 11 12:52:13.737863 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.737808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:52:13.779133 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.779105    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mm8b\" (UniqueName: \"kubernetes.io/projected/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-kube-api-access-6mm8b\") pod \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") "
Sep 11 12:52:13.779299 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.779208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls\") pod \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") "
Sep 11 12:52:13.779299 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.779241    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-openshift-service-ca\") pod \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") "
Sep 11 12:52:13.779299 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.779267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-metrics-certs\") pod \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\" (UID: \"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980\") "
Sep 11 12:52:13.779699 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.779668    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" (UID: "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:13.781349 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.781319    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" (UID: "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:13.781467 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.781423    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-kube-api-access-6mm8b" (OuterVolumeSpecName: "kube-api-access-6mm8b") pod "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" (UID: "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980"). InnerVolumeSpecName "kube-api-access-6mm8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:13.781798 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.781783    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" (UID: "c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:13.880910 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.880879    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:13.880910 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.880906    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:13.880910 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.880916    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:13.881135 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:13.880926    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mm8b\" (UniqueName: \"kubernetes.io/projected/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980-kube-api-access-6mm8b\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:14.362173 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.362138    2563 generic.go:356] "Generic (PLEG): container finished" podID="c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" containerID="1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029" exitCode=0
Sep 11 12:52:14.362337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.362179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" event={"ID":"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980","Type":"ContainerDied","Data":"1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029"}
Sep 11 12:52:14.362337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.362191    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"
Sep 11 12:52:14.362337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.362219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z" event={"ID":"c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980","Type":"ContainerDied","Data":"2f1dfbded813e6979beedaf5023f87b46d54d752401fb3a360729d05a3b9c801"}
Sep 11 12:52:14.362337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.362240    2563 scope.go:117] "RemoveContainer" containerID="1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029"
Sep 11 12:52:14.371144 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.371126    2563 scope.go:117] "RemoveContainer" containerID="1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029"
Sep 11 12:52:14.371441 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:52:14.371419    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029\": container with ID starting with 1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029 not found: ID does not exist" containerID="1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029"
Sep 11 12:52:14.371527 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.371449    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029"} err="failed to get container status \"1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029\": rpc error: code = NotFound desc = could not find container \"1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029\": container with ID starting with 1c3c3f72f5218d7e1eb9400f25cb88945e6d207ec403c733eeefad778194d029 not found: ID does not exist"
Sep 11 12:52:14.383210 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.383187    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"]
Sep 11 12:52:14.387057 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:14.387032    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1a4a12-786c97888d-lc92z"]
Sep 11 12:52:15.816187 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:15.816155    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" path="/var/lib/kubelet/pods/c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980/volumes"
Sep 11 12:52:31.838349 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:31.838314    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"]
Sep 11 12:52:31.840827 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:31.838578    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" podUID="22fb0446-c3a0-441e-a81d-f52a0eff71ee" containerName="maas-api" containerID="cri-o://5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0" gracePeriod=30
Sep 11 12:52:31.920981 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:31.920944    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"]
Sep 11 12:52:31.921249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:31.921205    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd" podUID="801a3281-dc8b-404e-91ff-38b9339fb69a" containerName="payload-processing" containerID="cri-o://a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9" gracePeriod=30
Sep 11 12:52:32.184194 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.184167    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:52:32.211317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.210686    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:52:32.261103 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261070    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l4n7\" (UniqueName: \"kubernetes.io/projected/801a3281-dc8b-404e-91ff-38b9339fb69a-kube-api-access-9l4n7\") pod \"801a3281-dc8b-404e-91ff-38b9339fb69a\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") "
Sep 11 12:52:32.261291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801a3281-dc8b-404e-91ff-38b9339fb69a-plugins-config-volume\") pod \"801a3281-dc8b-404e-91ff-38b9339fb69a\" (UID: \"801a3281-dc8b-404e-91ff-38b9339fb69a\") "
Sep 11 12:52:32.261291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261149    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bljwz\" (UniqueName: \"kubernetes.io/projected/22fb0446-c3a0-441e-a81d-f52a0eff71ee-kube-api-access-bljwz\") pod \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") "
Sep 11 12:52:32.261291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261170    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-metrics-certs\") pod \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") "
Sep 11 12:52:32.261291 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261238    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls\") pod \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") "
Sep 11 12:52:32.261555 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261297    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fb0446-c3a0-441e-a81d-f52a0eff71ee-openshift-service-ca\") pod \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\" (UID: \"22fb0446-c3a0-441e-a81d-f52a0eff71ee\") "
Sep 11 12:52:32.261689 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261644    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/801a3281-dc8b-404e-91ff-38b9339fb69a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "801a3281-dc8b-404e-91ff-38b9339fb69a" (UID: "801a3281-dc8b-404e-91ff-38b9339fb69a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:32.261819 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.261708    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fb0446-c3a0-441e-a81d-f52a0eff71ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22fb0446-c3a0-441e-a81d-f52a0eff71ee" (UID: "22fb0446-c3a0-441e-a81d-f52a0eff71ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:52:32.263345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.263322    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801a3281-dc8b-404e-91ff-38b9339fb69a-kube-api-access-9l4n7" (OuterVolumeSpecName: "kube-api-access-9l4n7") pod "801a3281-dc8b-404e-91ff-38b9339fb69a" (UID: "801a3281-dc8b-404e-91ff-38b9339fb69a"). InnerVolumeSpecName "kube-api-access-9l4n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:32.263345 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.263328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "22fb0446-c3a0-441e-a81d-f52a0eff71ee" (UID: "22fb0446-c3a0-441e-a81d-f52a0eff71ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:32.263687 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.263665    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fb0446-c3a0-441e-a81d-f52a0eff71ee-kube-api-access-bljwz" (OuterVolumeSpecName: "kube-api-access-bljwz") pod "22fb0446-c3a0-441e-a81d-f52a0eff71ee" (UID: "22fb0446-c3a0-441e-a81d-f52a0eff71ee"). InnerVolumeSpecName "kube-api-access-bljwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:52:32.263724 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.263697    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22fb0446-c3a0-441e-a81d-f52a0eff71ee" (UID: "22fb0446-c3a0-441e-a81d-f52a0eff71ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:52:32.362029 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.361987    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fb0446-c3a0-441e-a81d-f52a0eff71ee-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:32.362029 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.362020    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l4n7\" (UniqueName: \"kubernetes.io/projected/801a3281-dc8b-404e-91ff-38b9339fb69a-kube-api-access-9l4n7\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:32.362029 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.362030    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/801a3281-dc8b-404e-91ff-38b9339fb69a-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:32.362029 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.362038    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bljwz\" (UniqueName: \"kubernetes.io/projected/22fb0446-c3a0-441e-a81d-f52a0eff71ee-kube-api-access-bljwz\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:32.362298 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.362048    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:32.362298 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.362057    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22fb0446-c3a0-441e-a81d-f52a0eff71ee-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:52:32.463886 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.463850    2563 generic.go:356] "Generic (PLEG): container finished" podID="801a3281-dc8b-404e-91ff-38b9339fb69a" containerID="a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9" exitCode=0
Sep 11 12:52:32.464044 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.463896    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"
Sep 11 12:52:32.464044 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.463933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd" event={"ID":"801a3281-dc8b-404e-91ff-38b9339fb69a","Type":"ContainerDied","Data":"a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9"}
Sep 11 12:52:32.464044 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.463997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd" event={"ID":"801a3281-dc8b-404e-91ff-38b9339fb69a","Type":"ContainerDied","Data":"0dca86683730e490997250b5c3b8959c9c194970c738d9c57a3a60ae333d3846"}
Sep 11 12:52:32.464044 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.464030    2563 scope.go:117] "RemoveContainer" containerID="a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9"
Sep 11 12:52:32.465323 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.465293    2563 generic.go:356] "Generic (PLEG): container finished" podID="22fb0446-c3a0-441e-a81d-f52a0eff71ee" containerID="5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0" exitCode=0
Sep 11 12:52:32.465458 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.465322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" event={"ID":"22fb0446-c3a0-441e-a81d-f52a0eff71ee","Type":"ContainerDied","Data":"5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0"}
Sep 11 12:52:32.465458 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.465334    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"
Sep 11 12:52:32.465551 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.465400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j" event={"ID":"22fb0446-c3a0-441e-a81d-f52a0eff71ee","Type":"ContainerDied","Data":"a29095e8065b82ff3d8b6b0be66a3cb1ff57c5dcd37d52293486a674c189a755"}
Sep 11 12:52:32.473772 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.473752    2563 scope.go:117] "RemoveContainer" containerID="a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9"
Sep 11 12:52:32.474071 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:52:32.474054    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9\": container with ID starting with a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9 not found: ID does not exist" containerID="a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9"
Sep 11 12:52:32.474161 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.474079    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9"} err="failed to get container status \"a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9\": rpc error: code = NotFound desc = could not find container \"a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9\": container with ID starting with a23f69cb48598828f3219efa37aa5abed5405ed00802e43bd51560cdc49c20c9 not found: ID does not exist"
Sep 11 12:52:32.474161 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.474093    2563 scope.go:117] "RemoveContainer" containerID="5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0"
Sep 11 12:52:32.482565 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.482547    2563 scope.go:117] "RemoveContainer" containerID="5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0"
Sep 11 12:52:32.482842 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:52:32.482823    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0\": container with ID starting with 5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0 not found: ID does not exist" containerID="5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0"
Sep 11 12:52:32.482892 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.482848    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0"} err="failed to get container status \"5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0\": rpc error: code = NotFound desc = could not find container \"5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0\": container with ID starting with 5ebbc34ca00124756d906acb0cfffc531b014af13a119f9c24052ad145215ac0 not found: ID does not exist"
Sep 11 12:52:32.491860 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.491838    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"]
Sep 11 12:52:32.495080 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.495057    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-ce2636-686ccd8559-j9vbd"]
Sep 11 12:52:32.506476 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.506455    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"]
Sep 11 12:52:32.510842 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:32.510821    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ce2636-6fdf5b5f97-xrz7j"]
Sep 11 12:52:33.806149 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:33.806115    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fb0446-c3a0-441e-a81d-f52a0eff71ee" path="/var/lib/kubelet/pods/22fb0446-c3a0-441e-a81d-f52a0eff71ee/volumes"
Sep 11 12:52:33.806534 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:52:33.806517    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="801a3281-dc8b-404e-91ff-38b9339fb69a" path="/var/lib/kubelet/pods/801a3281-dc8b-404e-91ff-38b9339fb69a/volumes"
Sep 11 12:53:13.988847 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.988810    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"]
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989215    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" containerName="maas-api"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989227    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" containerName="maas-api"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989243    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab622551-56f5-4b96-b8d7-3feee292072b" containerName="payload-processing"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989249    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab622551-56f5-4b96-b8d7-3feee292072b" containerName="payload-processing"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989264    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="801a3281-dc8b-404e-91ff-38b9339fb69a" containerName="payload-processing"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989270    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="801a3281-dc8b-404e-91ff-38b9339fb69a" containerName="payload-processing"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989277    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" containerName="payload-pre-processing"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989283    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" containerName="payload-pre-processing"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fb0446-c3a0-441e-a81d-f52a0eff71ee" containerName="maas-api"
Sep 11 12:53:13.989317 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989302    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fb0446-c3a0-441e-a81d-f52a0eff71ee" containerName="maas-api"
Sep 11 12:53:13.989675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989353    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fb0446-c3a0-441e-a81d-f52a0eff71ee" containerName="maas-api"
Sep 11 12:53:13.989675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989375    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c28e4fb1-b68f-47cd-b9fc-cad4c4bd3980" containerName="maas-api"
Sep 11 12:53:13.989675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989384    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="801a3281-dc8b-404e-91ff-38b9339fb69a" containerName="payload-processing"
Sep 11 12:53:13.989675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989391    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="25fd6aa9-c3b9-4efc-91ea-d91d358afc2c" containerName="payload-pre-processing"
Sep 11 12:53:13.989675 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.989397    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab622551-56f5-4b96-b8d7-3feee292072b" containerName="payload-processing"
Sep 11 12:53:13.992592 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.992576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:13.995580 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:13.995557    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-c689a2\""
Sep 11 12:53:14.004196 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.004164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"]
Sep 11 12:53:14.017056 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.017034    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"]
Sep 11 12:53:14.020963 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.020944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.023899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.023881    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-c689a2-dockercfg-zfzlr\""
Sep 11 12:53:14.031553 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.031528    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"]
Sep 11 12:53:14.049832 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.049805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e51aa-6540-480d-9dcb-a2c6265bc4e1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.049939 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.049848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvj4z\" (UniqueName: \"kubernetes.io/projected/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-kube-api-access-vvj4z\") pod \"payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.049991 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.049928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.050029 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.050017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgtbh\" (UniqueName: \"kubernetes.io/projected/063e51aa-6540-480d-9dcb-a2c6265bc4e1-kube-api-access-vgtbh\") pod \"payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.151393 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.151339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.151567 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.151467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgtbh\" (UniqueName: \"kubernetes.io/projected/063e51aa-6540-480d-9dcb-a2c6265bc4e1-kube-api-access-vgtbh\") pod \"payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.151567 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.151495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e51aa-6540-480d-9dcb-a2c6265bc4e1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.151567 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.151523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj4z\" (UniqueName: \"kubernetes.io/projected/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-kube-api-access-vvj4z\") pod \"payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.152286 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.152259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.152376 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.152316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e51aa-6540-480d-9dcb-a2c6265bc4e1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.160833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.160811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgtbh\" (UniqueName: \"kubernetes.io/projected/063e51aa-6540-480d-9dcb-a2c6265bc4e1-kube-api-access-vgtbh\") pod \"payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.160950 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.160852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj4z\" (UniqueName: \"kubernetes.io/projected/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-kube-api-access-vvj4z\") pod \"payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.304198 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.304114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.332469 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.332438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.577511 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.577420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"]
Sep 11 12:53:14.609795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.609759    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"]
Sep 11 12:53:14.623536 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:53:14.623509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063e51aa_6540_480d_9dcb_a2c6265bc4e1.slice/crio-61f8d900c71ceca93f0151b3f4acd919306d57e55cd4ef6e68f42c0d61921b7b WatchSource:0}: Error finding container 61f8d900c71ceca93f0151b3f4acd919306d57e55cd4ef6e68f42c0d61921b7b: Status 404 returned error can't find the container with id 61f8d900c71ceca93f0151b3f4acd919306d57e55cd4ef6e68f42c0d61921b7b
Sep 11 12:53:14.682150 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.682117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6" event={"ID":"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4","Type":"ContainerStarted","Data":"abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5"}
Sep 11 12:53:14.682331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.682178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6" event={"ID":"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4","Type":"ContainerStarted","Data":"054fc4020fa2042d6bbd4bdb31445415ce6fc6c7dd8c9e17c3a87e3e194975a9"}
Sep 11 12:53:14.682331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.682228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:14.684049 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.684027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67" event={"ID":"063e51aa-6540-480d-9dcb-a2c6265bc4e1","Type":"ContainerStarted","Data":"dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953"}
Sep 11 12:53:14.684143 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.684069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67" event={"ID":"063e51aa-6540-480d-9dcb-a2c6265bc4e1","Type":"ContainerStarted","Data":"61f8d900c71ceca93f0151b3f4acd919306d57e55cd4ef6e68f42c0d61921b7b"}
Sep 11 12:53:14.684202 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.684156    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:53:14.701165 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.701111    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6" podStartSLOduration=1.7010959140000002 podStartE2EDuration="1.701095914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:14.699475515 +0000 UTC m=+1595.412478555" watchObservedRunningTime="2026-09-11 12:53:14.701095914 +0000 UTC m=+1595.414098951"
Sep 11 12:53:14.719278 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:14.719212    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67" podStartSLOduration=1.719192118 podStartE2EDuration="1.719192118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:53:14.717046547 +0000 UTC m=+1595.430049608" watchObservedRunningTime="2026-09-11 12:53:14.719192118 +0000 UTC m=+1595.432195157"
Sep 11 12:53:25.691389 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:25.691346    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:53:25.691764 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:53:25.691440    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:54:41.922676 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:41.922646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67_063e51aa-6540-480d-9dcb-a2c6265bc4e1/payload-processing/0.log"
Sep 11 12:54:46.890812 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:46.890767    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"]
Sep 11 12:54:46.895383 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:46.895347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:46.898907 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:46.898883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-96a7d1-serving-cert\""
Sep 11 12:54:46.905873 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:46.905851    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"]
Sep 11 12:54:47.018044 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.018011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.018207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.018067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d85713-ffa5-47c4-9eef-835e6873805a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.018207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.018144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t9wz\" (UniqueName: \"kubernetes.io/projected/e6d85713-ffa5-47c4-9eef-835e6873805a-kube-api-access-8t9wz\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.018207 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.018178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.118903 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.118868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.119081 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.118929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d85713-ffa5-47c4-9eef-835e6873805a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.119081 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.118964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t9wz\" (UniqueName: \"kubernetes.io/projected/e6d85713-ffa5-47c4-9eef-835e6873805a-kube-api-access-8t9wz\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.119081 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.118983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.119081 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:54:47.119037    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-serving-cert: secret "maas-api-e2e-ipp-cleanup-96a7d1-serving-cert" not found
Sep 11 12:54:47.119252 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:54:47.119124    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls podName:e6d85713-ffa5-47c4-9eef-835e6873805a nodeName:}" failed. No retries permitted until 2026-09-11 12:54:47.619105611 +0000 UTC m=+1688.332108630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" (UID: "e6d85713-ffa5-47c4-9eef-835e6873805a") : secret "maas-api-e2e-ipp-cleanup-96a7d1-serving-cert" not found
Sep 11 12:54:47.119724 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.119701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d85713-ffa5-47c4-9eef-835e6873805a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.121457 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.121437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.134069 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.134044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t9wz\" (UniqueName: \"kubernetes.io/projected/e6d85713-ffa5-47c4-9eef-835e6873805a-kube-api-access-8t9wz\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.542933 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.542902    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"]
Sep 11 12:54:47.546908 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.546891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.549917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.549897    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-96a7d1-dockercfg-p2jrb\""
Sep 11 12:54:47.550000 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.549936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-96a7d1\""
Sep 11 12:54:47.561028 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.561005    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"]
Sep 11 12:54:47.563038 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.563015    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"]
Sep 11 12:54:47.566899 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.566877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.585011 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.584991    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"]
Sep 11 12:54:47.623569 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.623538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54hx\" (UniqueName: \"kubernetes.io/projected/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-kube-api-access-n54hx\") pod \"payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.623717 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.623654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbhc\" (UniqueName: \"kubernetes.io/projected/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-kube-api-access-jrbhc\") pod \"payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.623717 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.623701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.623793 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.623759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.623828 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.623797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.626217 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.626187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.724693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.724656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54hx\" (UniqueName: \"kubernetes.io/projected/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-kube-api-access-n54hx\") pod \"payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.724859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.724723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbhc\" (UniqueName: \"kubernetes.io/projected/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-kube-api-access-jrbhc\") pod \"payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.724859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.724769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.724859 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.724795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.725735 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.725711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.725830 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.725711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.733420 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.733397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbhc\" (UniqueName: \"kubernetes.io/projected/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-kube-api-access-jrbhc\") pod \"payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:47.733533 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.733454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54hx\" (UniqueName: \"kubernetes.io/projected/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-kube-api-access-n54hx\") pod \"payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.808489 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.808427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:47.857551 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.857506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:47.880344 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:47.880320    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:48.084452 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:48.084426    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"]
Sep 11 12:54:48.085469 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:54:48.085441    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d85713_ffa5_47c4_9eef_835e6873805a.slice/crio-12972b17102911e05f847eb04194fe5f31e965e1a95da2ee0921c7e0f718017e WatchSource:0}: Error finding container 12972b17102911e05f847eb04194fe5f31e965e1a95da2ee0921c7e0f718017e: Status 404 returned error can't find the container with id 12972b17102911e05f847eb04194fe5f31e965e1a95da2ee0921c7e0f718017e
Sep 11 12:54:48.145618 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:48.145587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"]
Sep 11 12:54:48.146776 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:54:48.146751    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea95564a_c985_4d50_9dc3_5c8e8cf7d078.slice/crio-4a8335d6b0db6a795e6f9b088af977056e069d479c30131b999045c3a30c04e2 WatchSource:0}: Error finding container 4a8335d6b0db6a795e6f9b088af977056e069d479c30131b999045c3a30c04e2: Status 404 returned error can't find the container with id 4a8335d6b0db6a795e6f9b088af977056e069d479c30131b999045c3a30c04e2
Sep 11 12:54:48.155312 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:48.155287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g" event={"ID":"ea95564a-c985-4d50-9dc3-5c8e8cf7d078","Type":"ContainerStarted","Data":"4a8335d6b0db6a795e6f9b088af977056e069d479c30131b999045c3a30c04e2"}
Sep 11 12:54:48.156629 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:48.156598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" event={"ID":"e6d85713-ffa5-47c4-9eef-835e6873805a","Type":"ContainerStarted","Data":"12972b17102911e05f847eb04194fe5f31e965e1a95da2ee0921c7e0f718017e"}
Sep 11 12:54:48.165020 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:48.165002    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"]
Sep 11 12:54:48.166721 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:54:48.166694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad460fe_6a6e_41c9_a1f3_0c5d07140c35.slice/crio-c7b48a906a85cb46edb6c459b316bf58ff5e7520774c50728f2a303bceae60d1 WatchSource:0}: Error finding container c7b48a906a85cb46edb6c459b316bf58ff5e7520774c50728f2a303bceae60d1: Status 404 returned error can't find the container with id c7b48a906a85cb46edb6c459b316bf58ff5e7520774c50728f2a303bceae60d1
Sep 11 12:54:49.164783 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.164748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g" event={"ID":"ea95564a-c985-4d50-9dc3-5c8e8cf7d078","Type":"ContainerStarted","Data":"57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4"}
Sep 11 12:54:49.165228 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.164813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:54:49.166530 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.166504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" event={"ID":"e6d85713-ffa5-47c4-9eef-835e6873805a","Type":"ContainerStarted","Data":"e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07"}
Sep 11 12:54:49.166655 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.166580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:54:49.168067 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.168044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p" event={"ID":"aad460fe-6a6e-41c9-a1f3-0c5d07140c35","Type":"ContainerStarted","Data":"a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120"}
Sep 11 12:54:49.168182 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.168079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p" event={"ID":"aad460fe-6a6e-41c9-a1f3-0c5d07140c35","Type":"ContainerStarted","Data":"c7b48a906a85cb46edb6c459b316bf58ff5e7520774c50728f2a303bceae60d1"}
Sep 11 12:54:49.168182 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.168159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:54:49.187770 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.187726    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g" podStartSLOduration=2.187713939 podStartE2EDuration="2.187713939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:54:49.184871481 +0000 UTC m=+1689.897874519" watchObservedRunningTime="2026-09-11 12:54:49.187713939 +0000 UTC m=+1689.900716976"
Sep 11 12:54:49.204589 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.204553    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" podStartSLOduration=2.662346115 podStartE2EDuration="3.204543883s" totalImagesPullingTime="542.197768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:54:49.20396481 +0000 UTC m=+1689.916967851" watchObservedRunningTime="2026-09-11 12:54:49.204543883 +0000 UTC m=+1689.917546920"
Sep 11 12:54:49.230305 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:49.230265    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p" podStartSLOduration=2.230250456 podStartE2EDuration="2.230250456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:54:49.229094107 +0000 UTC m=+1689.942097146" watchObservedRunningTime="2026-09-11 12:54:49.230250456 +0000 UTC m=+1689.943253541"
Sep 11 12:54:55.178833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:54:55.178802    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:55:00.174712 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:00.174675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:55:00.175142 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:00.175084    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:55:17.510996 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.510955    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"]
Sep 11 12:55:17.511510 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.511301    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" podUID="e6d85713-ffa5-47c4-9eef-835e6873805a" containerName="maas-api" containerID="cri-o://e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07" gracePeriod=30
Sep 11 12:55:17.578085 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.578050    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"]
Sep 11 12:55:17.578418 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.578353    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p" podUID="aad460fe-6a6e-41c9-a1f3-0c5d07140c35" containerName="payload-processing" containerID="cri-o://a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120" gracePeriod=30
Sep 11 12:55:17.588823 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.588795    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"]
Sep 11 12:55:17.589086 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.589055    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g" podUID="ea95564a-c985-4d50-9dc3-5c8e8cf7d078" containerName="payload-pre-processing" containerID="cri-o://57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4" gracePeriod=30
Sep 11 12:55:17.875878 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.875749    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:55:17.900938 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.900913    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:55:17.911867 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.911845    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:55:17.917115 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.917095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d85713-ffa5-47c4-9eef-835e6873805a-openshift-service-ca\") pod \"e6d85713-ffa5-47c4-9eef-835e6873805a\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") "
Sep 11 12:55:17.917220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.917128    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t9wz\" (UniqueName: \"kubernetes.io/projected/e6d85713-ffa5-47c4-9eef-835e6873805a-kube-api-access-8t9wz\") pod \"e6d85713-ffa5-47c4-9eef-835e6873805a\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") "
Sep 11 12:55:17.917220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.917186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls\") pod \"e6d85713-ffa5-47c4-9eef-835e6873805a\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") "
Sep 11 12:55:17.917337 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.917227    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-metrics-certs\") pod \"e6d85713-ffa5-47c4-9eef-835e6873805a\" (UID: \"e6d85713-ffa5-47c4-9eef-835e6873805a\") "
Sep 11 12:55:17.917931 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.917472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6d85713-ffa5-47c4-9eef-835e6873805a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6d85713-ffa5-47c4-9eef-835e6873805a" (UID: "e6d85713-ffa5-47c4-9eef-835e6873805a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:17.917931 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.917786    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d85713-ffa5-47c4-9eef-835e6873805a-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:17.919908 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.919872    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6d85713-ffa5-47c4-9eef-835e6873805a-kube-api-access-8t9wz" (OuterVolumeSpecName: "kube-api-access-8t9wz") pod "e6d85713-ffa5-47c4-9eef-835e6873805a" (UID: "e6d85713-ffa5-47c4-9eef-835e6873805a"). InnerVolumeSpecName "kube-api-access-8t9wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:17.920636 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.920607    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6d85713-ffa5-47c4-9eef-835e6873805a" (UID: "e6d85713-ffa5-47c4-9eef-835e6873805a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:55:17.920636 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:17.920620    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6d85713-ffa5-47c4-9eef-835e6873805a" (UID: "e6d85713-ffa5-47c4-9eef-835e6873805a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:55:18.018398 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018310    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-plugins-config-volume\") pod \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") "
Sep 11 12:55:18.018550 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrbhc\" (UniqueName: \"kubernetes.io/projected/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-kube-api-access-jrbhc\") pod \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\" (UID: \"aad460fe-6a6e-41c9-a1f3-0c5d07140c35\") "
Sep 11 12:55:18.018550 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-plugins-config-volume\") pod \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") "
Sep 11 12:55:18.018550 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018518    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n54hx\" (UniqueName: \"kubernetes.io/projected/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-kube-api-access-n54hx\") pod \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\" (UID: \"ea95564a-c985-4d50-9dc3-5c8e8cf7d078\") "
Sep 11 12:55:18.018723 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018675    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aad460fe-6a6e-41c9-a1f3-0c5d07140c35" (UID: "aad460fe-6a6e-41c9-a1f3-0c5d07140c35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:18.018887 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018864    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea95564a-c985-4d50-9dc3-5c8e8cf7d078" (UID: "ea95564a-c985-4d50-9dc3-5c8e8cf7d078"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:18.018968 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018887    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.018968 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018914    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t9wz\" (UniqueName: \"kubernetes.io/projected/e6d85713-ffa5-47c4-9eef-835e6873805a-kube-api-access-8t9wz\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.018968 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018923    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.018968 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.018935    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d85713-ffa5-47c4-9eef-835e6873805a-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.020548 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.020524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-kube-api-access-n54hx" (OuterVolumeSpecName: "kube-api-access-n54hx") pod "ea95564a-c985-4d50-9dc3-5c8e8cf7d078" (UID: "ea95564a-c985-4d50-9dc3-5c8e8cf7d078"). InnerVolumeSpecName "kube-api-access-n54hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:18.020615 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.020555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-kube-api-access-jrbhc" (OuterVolumeSpecName: "kube-api-access-jrbhc") pod "aad460fe-6a6e-41c9-a1f3-0c5d07140c35" (UID: "aad460fe-6a6e-41c9-a1f3-0c5d07140c35"). InnerVolumeSpecName "kube-api-access-jrbhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:18.119576 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.119543    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.119576 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.119567    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n54hx\" (UniqueName: \"kubernetes.io/projected/ea95564a-c985-4d50-9dc3-5c8e8cf7d078-kube-api-access-n54hx\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.119576 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.119577    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrbhc\" (UniqueName: \"kubernetes.io/projected/aad460fe-6a6e-41c9-a1f3-0c5d07140c35-kube-api-access-jrbhc\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:18.314637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.314549    2563 generic.go:356] "Generic (PLEG): container finished" podID="ea95564a-c985-4d50-9dc3-5c8e8cf7d078" containerID="57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4" exitCode=0
Sep 11 12:55:18.314637 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.314589    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"
Sep 11 12:55:18.314868 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.314641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g" event={"ID":"ea95564a-c985-4d50-9dc3-5c8e8cf7d078","Type":"ContainerDied","Data":"57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4"}
Sep 11 12:55:18.314868 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.314688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g" event={"ID":"ea95564a-c985-4d50-9dc3-5c8e8cf7d078","Type":"ContainerDied","Data":"4a8335d6b0db6a795e6f9b088af977056e069d479c30131b999045c3a30c04e2"}
Sep 11 12:55:18.314868 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.314715    2563 scope.go:117] "RemoveContainer" containerID="57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4"
Sep 11 12:55:18.315995 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.315962    2563 generic.go:356] "Generic (PLEG): container finished" podID="e6d85713-ffa5-47c4-9eef-835e6873805a" containerID="e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07" exitCode=0
Sep 11 12:55:18.316063 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.316014    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"
Sep 11 12:55:18.316063 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.316020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" event={"ID":"e6d85713-ffa5-47c4-9eef-835e6873805a","Type":"ContainerDied","Data":"e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07"}
Sep 11 12:55:18.316150 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.316078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g" event={"ID":"e6d85713-ffa5-47c4-9eef-835e6873805a","Type":"ContainerDied","Data":"12972b17102911e05f847eb04194fe5f31e965e1a95da2ee0921c7e0f718017e"}
Sep 11 12:55:18.317731 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.317706    2563 generic.go:356] "Generic (PLEG): container finished" podID="aad460fe-6a6e-41c9-a1f3-0c5d07140c35" containerID="a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120" exitCode=0
Sep 11 12:55:18.317833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.317763    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"
Sep 11 12:55:18.317833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.317772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p" event={"ID":"aad460fe-6a6e-41c9-a1f3-0c5d07140c35","Type":"ContainerDied","Data":"a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120"}
Sep 11 12:55:18.317925 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.317846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p" event={"ID":"aad460fe-6a6e-41c9-a1f3-0c5d07140c35","Type":"ContainerDied","Data":"c7b48a906a85cb46edb6c459b316bf58ff5e7520774c50728f2a303bceae60d1"}
Sep 11 12:55:18.325988 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.325960    2563 scope.go:117] "RemoveContainer" containerID="57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4"
Sep 11 12:55:18.326390 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:55:18.326270    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4\": container with ID starting with 57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4 not found: ID does not exist" containerID="57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4"
Sep 11 12:55:18.326390 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.326298    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4"} err="failed to get container status \"57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4\": rpc error: code = NotFound desc = could not find container \"57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4\": container with ID starting with 57c2d7e419bf75a2f30f8e3bf075179d62b4418c2169e311dc9a44ae38f793e4 not found: ID does not exist"
Sep 11 12:55:18.326390 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.326319    2563 scope.go:117] "RemoveContainer" containerID="e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07"
Sep 11 12:55:18.335037 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.335022    2563 scope.go:117] "RemoveContainer" containerID="e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07"
Sep 11 12:55:18.335285 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:55:18.335266    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07\": container with ID starting with e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07 not found: ID does not exist" containerID="e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07"
Sep 11 12:55:18.335340 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.335291    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07"} err="failed to get container status \"e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07\": rpc error: code = NotFound desc = could not find container \"e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07\": container with ID starting with e8b6434978d61af93d752532df3b4db61d1ede98c42a95f030c784ff4d4efa07 not found: ID does not exist"
Sep 11 12:55:18.335340 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.335313    2563 scope.go:117] "RemoveContainer" containerID="a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120"
Sep 11 12:55:18.342965 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.342946    2563 scope.go:117] "RemoveContainer" containerID="a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120"
Sep 11 12:55:18.343249 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:55:18.343222    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120\": container with ID starting with a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120 not found: ID does not exist" containerID="a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120"
Sep 11 12:55:18.343309 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.343255    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120"} err="failed to get container status \"a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120\": rpc error: code = NotFound desc = could not find container \"a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120\": container with ID starting with a26280ecce3ae1bda7a5ce72850caa7bc75eef08336787fa9327216a6d85a120 not found: ID does not exist"
Sep 11 12:55:18.343817 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.343801    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"]
Sep 11 12:55:18.347854 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.347835    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-96a7d1-784588fbd6-ktf4g"]
Sep 11 12:55:18.360213 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.360194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"]
Sep 11 12:55:18.367252 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.367217    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-96a7d1-776bfd59f5-gjl7p"]
Sep 11 12:55:18.380795 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.380773    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"]
Sep 11 12:55:18.386575 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:18.386553    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-96a7d1-9678d8dc5-s452g"]
Sep 11 12:55:19.806180 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:19.806142    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad460fe-6a6e-41c9-a1f3-0c5d07140c35" path="/var/lib/kubelet/pods/aad460fe-6a6e-41c9-a1f3-0c5d07140c35/volumes"
Sep 11 12:55:19.806564 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:19.806551    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6d85713-ffa5-47c4-9eef-835e6873805a" path="/var/lib/kubelet/pods/e6d85713-ffa5-47c4-9eef-835e6873805a/volumes"
Sep 11 12:55:19.806874 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:19.806861    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea95564a-c985-4d50-9dc3-5c8e8cf7d078" path="/var/lib/kubelet/pods/ea95564a-c985-4d50-9dc3-5c8e8cf7d078/volumes"
Sep 11 12:55:43.740249 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:43.740212    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"]
Sep 11 12:55:43.740723 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:43.740485    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67" podUID="063e51aa-6540-480d-9dcb-a2c6265bc4e1" containerName="payload-processing" containerID="cri-o://dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953" gracePeriod=30
Sep 11 12:55:43.777133 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:43.777106    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"]
Sep 11 12:55:43.777464 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:43.777404    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6" podUID="7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" containerName="payload-pre-processing" containerID="cri-o://abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5" gracePeriod=30
Sep 11 12:55:44.028053 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.028031    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:55:44.077769 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.077740    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:55:44.162754 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.162727    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvj4z\" (UniqueName: \"kubernetes.io/projected/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-kube-api-access-vvj4z\") pod \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") "
Sep 11 12:55:44.162906 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.162830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e51aa-6540-480d-9dcb-a2c6265bc4e1-plugins-config-volume\") pod \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") "
Sep 11 12:55:44.162906 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.162849    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgtbh\" (UniqueName: \"kubernetes.io/projected/063e51aa-6540-480d-9dcb-a2c6265bc4e1-kube-api-access-vgtbh\") pod \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\" (UID: \"063e51aa-6540-480d-9dcb-a2c6265bc4e1\") "
Sep 11 12:55:44.162906 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.162877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-plugins-config-volume\") pod \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\" (UID: \"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4\") "
Sep 11 12:55:44.163280 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.163253    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/063e51aa-6540-480d-9dcb-a2c6265bc4e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "063e51aa-6540-480d-9dcb-a2c6265bc4e1" (UID: "063e51aa-6540-480d-9dcb-a2c6265bc4e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:44.163435 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.163255    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" (UID: "7d4aa3d1-7fa0-4413-8a5a-902b90093bf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:55:44.164901 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.164877    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-kube-api-access-vvj4z" (OuterVolumeSpecName: "kube-api-access-vvj4z") pod "7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" (UID: "7d4aa3d1-7fa0-4413-8a5a-902b90093bf4"). InnerVolumeSpecName "kube-api-access-vvj4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:44.164901 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.164889    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063e51aa-6540-480d-9dcb-a2c6265bc4e1-kube-api-access-vgtbh" (OuterVolumeSpecName: "kube-api-access-vgtbh") pod "063e51aa-6540-480d-9dcb-a2c6265bc4e1" (UID: "063e51aa-6540-480d-9dcb-a2c6265bc4e1"). InnerVolumeSpecName "kube-api-access-vgtbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:55:44.264619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.264528    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvj4z\" (UniqueName: \"kubernetes.io/projected/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-kube-api-access-vvj4z\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.264619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.264561    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/063e51aa-6540-480d-9dcb-a2c6265bc4e1-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.264619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.264573    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgtbh\" (UniqueName: \"kubernetes.io/projected/063e51aa-6540-480d-9dcb-a2c6265bc4e1-kube-api-access-vgtbh\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.264619 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.264584    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:55:44.459749 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.459710    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" containerID="abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5" exitCode=0
Sep 11 12:55:44.459919 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.459758    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"
Sep 11 12:55:44.459919 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.459798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6" event={"ID":"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4","Type":"ContainerDied","Data":"abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5"}
Sep 11 12:55:44.459919 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.459864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6" event={"ID":"7d4aa3d1-7fa0-4413-8a5a-902b90093bf4","Type":"ContainerDied","Data":"054fc4020fa2042d6bbd4bdb31445415ce6fc6c7dd8c9e17c3a87e3e194975a9"}
Sep 11 12:55:44.459919 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.459893    2563 scope.go:117] "RemoveContainer" containerID="abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5"
Sep 11 12:55:44.461221 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.461184    2563 generic.go:356] "Generic (PLEG): container finished" podID="063e51aa-6540-480d-9dcb-a2c6265bc4e1" containerID="dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953" exitCode=0
Sep 11 12:55:44.461221 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.461208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67" event={"ID":"063e51aa-6540-480d-9dcb-a2c6265bc4e1","Type":"ContainerDied","Data":"dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953"}
Sep 11 12:55:44.461394 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.461230    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"
Sep 11 12:55:44.461394 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.461253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67" event={"ID":"063e51aa-6540-480d-9dcb-a2c6265bc4e1","Type":"ContainerDied","Data":"61f8d900c71ceca93f0151b3f4acd919306d57e55cd4ef6e68f42c0d61921b7b"}
Sep 11 12:55:44.470567 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.470551    2563 scope.go:117] "RemoveContainer" containerID="abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5"
Sep 11 12:55:44.470852 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:55:44.470815    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5\": container with ID starting with abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5 not found: ID does not exist" containerID="abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5"
Sep 11 12:55:44.470937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.470864    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5"} err="failed to get container status \"abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5\": rpc error: code = NotFound desc = could not find container \"abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5\": container with ID starting with abf8d45efbdec8cb014e20ed298ae7fcfa9867a112f2ca0826c6e591a322b1a5 not found: ID does not exist"
Sep 11 12:55:44.470937 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.470886    2563 scope.go:117] "RemoveContainer" containerID="dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953"
Sep 11 12:55:44.478538 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.478522    2563 scope.go:117] "RemoveContainer" containerID="dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953"
Sep 11 12:55:44.478791 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:55:44.478771    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953\": container with ID starting with dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953 not found: ID does not exist" containerID="dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953"
Sep 11 12:55:44.478852 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.478802    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953"} err="failed to get container status \"dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953\": rpc error: code = NotFound desc = could not find container \"dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953\": container with ID starting with dabe2b78bcc09a374764699793e971d33a8acde9e9d25ef4e9d21bf017ea5953 not found: ID does not exist"
Sep 11 12:55:44.487481 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.487451    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"]
Sep 11 12:55:44.491423 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.491402    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-c689a2-767f777d-bk8d6"]
Sep 11 12:55:44.503043 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.503011    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"]
Sep 11 12:55:44.505946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:44.505925    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c689a2-74f78d7f79-n4w67"]
Sep 11 12:55:45.805579 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:45.805546    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="063e51aa-6540-480d-9dcb-a2c6265bc4e1" path="/var/lib/kubelet/pods/063e51aa-6540-480d-9dcb-a2c6265bc4e1/volumes"
Sep 11 12:55:45.806029 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:55:45.805900    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" path="/var/lib/kubelet/pods/7d4aa3d1-7fa0-4413-8a5a-902b90093bf4/volumes"
Sep 11 12:56:39.914683 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:56:39.914653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:56:39.918386 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:56:39.918347    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:56:39.919013 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:56:39.918993    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 12:56:39.922567 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:56:39.922549    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 12:57:18.312882 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.312845    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"]
Sep 11 12:57:18.313483 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.313045    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" podUID="6897758e-801e-4191-91ff-d7873ce1ffac" containerName="maas-api" containerID="cri-o://83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8" gracePeriod=30
Sep 11 12:57:18.377024 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.376995    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"]
Sep 11 12:57:18.377254 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.377205    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn" podUID="13908e38-0893-48fa-bf0a-e2b0ad3380b9" containerName="payload-pre-processing" containerID="cri-o://7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311" gracePeriod=30
Sep 11 12:57:18.628624 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.628595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:57:18.664437 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.664413    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:57:18.746711 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.746681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls\") pod \"6897758e-801e-4191-91ff-d7873ce1ffac\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") "
Sep 11 12:57:18.746871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.746738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skpkv\" (UniqueName: \"kubernetes.io/projected/13908e38-0893-48fa-bf0a-e2b0ad3380b9-kube-api-access-skpkv\") pod \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") "
Sep 11 12:57:18.746871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.746818    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13908e38-0893-48fa-bf0a-e2b0ad3380b9-plugins-config-volume\") pod \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\" (UID: \"13908e38-0893-48fa-bf0a-e2b0ad3380b9\") "
Sep 11 12:57:18.746871 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.746852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6897758e-801e-4191-91ff-d7873ce1ffac-openshift-service-ca\") pod \"6897758e-801e-4191-91ff-d7873ce1ffac\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") "
Sep 11 12:57:18.747054 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.746924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbv5j\" (UniqueName: \"kubernetes.io/projected/6897758e-801e-4191-91ff-d7873ce1ffac-kube-api-access-tbv5j\") pod \"6897758e-801e-4191-91ff-d7873ce1ffac\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") "
Sep 11 12:57:18.747054 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.747004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-metrics-certs\") pod \"6897758e-801e-4191-91ff-d7873ce1ffac\" (UID: \"6897758e-801e-4191-91ff-d7873ce1ffac\") "
Sep 11 12:57:18.747255 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.747197    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6897758e-801e-4191-91ff-d7873ce1ffac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6897758e-801e-4191-91ff-d7873ce1ffac" (UID: "6897758e-801e-4191-91ff-d7873ce1ffac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:18.747425 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.747270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13908e38-0893-48fa-bf0a-e2b0ad3380b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13908e38-0893-48fa-bf0a-e2b0ad3380b9" (UID: "13908e38-0893-48fa-bf0a-e2b0ad3380b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:18.747497 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.747481    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13908e38-0893-48fa-bf0a-e2b0ad3380b9-plugins-config-volume\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:18.747562 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.747503    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6897758e-801e-4191-91ff-d7873ce1ffac-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:18.748909 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.748890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6897758e-801e-4191-91ff-d7873ce1ffac" (UID: "6897758e-801e-4191-91ff-d7873ce1ffac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:18.749079 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.749056    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6897758e-801e-4191-91ff-d7873ce1ffac" (UID: "6897758e-801e-4191-91ff-d7873ce1ffac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:18.749273 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.749257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6897758e-801e-4191-91ff-d7873ce1ffac-kube-api-access-tbv5j" (OuterVolumeSpecName: "kube-api-access-tbv5j") pod "6897758e-801e-4191-91ff-d7873ce1ffac" (UID: "6897758e-801e-4191-91ff-d7873ce1ffac"). InnerVolumeSpecName "kube-api-access-tbv5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:18.749333 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.749278    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13908e38-0893-48fa-bf0a-e2b0ad3380b9-kube-api-access-skpkv" (OuterVolumeSpecName: "kube-api-access-skpkv") pod "13908e38-0893-48fa-bf0a-e2b0ad3380b9" (UID: "13908e38-0893-48fa-bf0a-e2b0ad3380b9"). InnerVolumeSpecName "kube-api-access-skpkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:18.848239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.848163    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbv5j\" (UniqueName: \"kubernetes.io/projected/6897758e-801e-4191-91ff-d7873ce1ffac-kube-api-access-tbv5j\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:18.848239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.848190    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:18.848239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.848200    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6897758e-801e-4191-91ff-d7873ce1ffac-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:18.848239 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.848210    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skpkv\" (UniqueName: \"kubernetes.io/projected/13908e38-0893-48fa-bf0a-e2b0ad3380b9-kube-api-access-skpkv\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:18.924751 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.924717    2563 generic.go:356] "Generic (PLEG): container finished" podID="6897758e-801e-4191-91ff-d7873ce1ffac" containerID="83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8" exitCode=0
Sep 11 12:57:18.924917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.924768    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"
Sep 11 12:57:18.924917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.924803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" event={"ID":"6897758e-801e-4191-91ff-d7873ce1ffac","Type":"ContainerDied","Data":"83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8"}
Sep 11 12:57:18.924917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.924856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz" event={"ID":"6897758e-801e-4191-91ff-d7873ce1ffac","Type":"ContainerDied","Data":"1dc45e1851e18ffd0a8c71ecb94246c4cb91b41221d978d65ae67702741c09ee"}
Sep 11 12:57:18.924917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.924887    2563 scope.go:117] "RemoveContainer" containerID="83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8"
Sep 11 12:57:18.926289 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.926265    2563 generic.go:356] "Generic (PLEG): container finished" podID="13908e38-0893-48fa-bf0a-e2b0ad3380b9" containerID="7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311" exitCode=0
Sep 11 12:57:18.926400 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.926310    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"
Sep 11 12:57:18.926400 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.926316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn" event={"ID":"13908e38-0893-48fa-bf0a-e2b0ad3380b9","Type":"ContainerDied","Data":"7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311"}
Sep 11 12:57:18.926400 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.926352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn" event={"ID":"13908e38-0893-48fa-bf0a-e2b0ad3380b9","Type":"ContainerDied","Data":"68bd4681c3df2bb6056203e338443d001a46f7fe6f07220a8e83dfe6e8554383"}
Sep 11 12:57:18.934696 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.934676    2563 scope.go:117] "RemoveContainer" containerID="83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8"
Sep 11 12:57:18.935015 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:57:18.934996    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8\": container with ID starting with 83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8 not found: ID does not exist" containerID="83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8"
Sep 11 12:57:18.935069 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.935023    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8"} err="failed to get container status \"83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8\": rpc error: code = NotFound desc = could not find container \"83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8\": container with ID starting with 83c303378398b011030ed495fd1904180003db5a540ee62ee96b978267f23fe8 not found: ID does not exist"
Sep 11 12:57:18.935069 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.935043    2563 scope.go:117] "RemoveContainer" containerID="7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311"
Sep 11 12:57:18.942770 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.942754    2563 scope.go:117] "RemoveContainer" containerID="7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311"
Sep 11 12:57:18.943011 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:57:18.942994    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311\": container with ID starting with 7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311 not found: ID does not exist" containerID="7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311"
Sep 11 12:57:18.943056 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.943018    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311"} err="failed to get container status \"7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311\": rpc error: code = NotFound desc = could not find container \"7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311\": container with ID starting with 7a9a7861284ca6801461b009a4f1a2b1e18ac6dfc1d8818ee4ff6b9d553ee311 not found: ID does not exist"
Sep 11 12:57:18.950676 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.950655    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"]
Sep 11 12:57:18.954872 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.954851    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c0bbb3-78cdb4d778-kstwn"]
Sep 11 12:57:18.966026 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.966005    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"]
Sep 11 12:57:18.969797 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:18.969777    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c0bbb3-674f85665c-sskgz"]
Sep 11 12:57:19.806043 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:19.806008    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13908e38-0893-48fa-bf0a-e2b0ad3380b9" path="/var/lib/kubelet/pods/13908e38-0893-48fa-bf0a-e2b0ad3380b9/volumes"
Sep 11 12:57:19.806452 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:19.806438    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6897758e-801e-4191-91ff-d7873ce1ffac" path="/var/lib/kubelet/pods/6897758e-801e-4191-91ff-d7873ce1ffac/volumes"
Sep 11 12:57:36.417691 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.417660    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"]
Sep 11 12:57:36.420116 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.417852    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs" podUID="f0faa8cb-3eaf-4085-8f36-0a86778fb552" containerName="maas-api" containerID="cri-o://7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7" gracePeriod=30
Sep 11 12:57:36.675032 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.674976    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:57:36.817679 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.817650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-metrics-certs\") pod \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") "
Sep 11 12:57:36.817853 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.817718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-maas-api-tls\") pod \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") "
Sep 11 12:57:36.817853 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.817764    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69m4j\" (UniqueName: \"kubernetes.io/projected/f0faa8cb-3eaf-4085-8f36-0a86778fb552-kube-api-access-69m4j\") pod \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") "
Sep 11 12:57:36.817853 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.817820    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0faa8cb-3eaf-4085-8f36-0a86778fb552-openshift-service-ca\") pod \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\" (UID: \"f0faa8cb-3eaf-4085-8f36-0a86778fb552\") "
Sep 11 12:57:36.818273 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.818244    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0faa8cb-3eaf-4085-8f36-0a86778fb552-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0faa8cb-3eaf-4085-8f36-0a86778fb552" (UID: "f0faa8cb-3eaf-4085-8f36-0a86778fb552"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:36.819946 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.819909    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0faa8cb-3eaf-4085-8f36-0a86778fb552-kube-api-access-69m4j" (OuterVolumeSpecName: "kube-api-access-69m4j") pod "f0faa8cb-3eaf-4085-8f36-0a86778fb552" (UID: "f0faa8cb-3eaf-4085-8f36-0a86778fb552"). InnerVolumeSpecName "kube-api-access-69m4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:36.820046 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.819972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0faa8cb-3eaf-4085-8f36-0a86778fb552" (UID: "f0faa8cb-3eaf-4085-8f36-0a86778fb552"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:36.820175 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.820155    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0faa8cb-3eaf-4085-8f36-0a86778fb552" (UID: "f0faa8cb-3eaf-4085-8f36-0a86778fb552"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:36.919809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.919721    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:36.919809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.919754    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0faa8cb-3eaf-4085-8f36-0a86778fb552-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:36.919809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.919769    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69m4j\" (UniqueName: \"kubernetes.io/projected/f0faa8cb-3eaf-4085-8f36-0a86778fb552-kube-api-access-69m4j\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:36.919809 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:36.919783    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0faa8cb-3eaf-4085-8f36-0a86778fb552-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:37.015920 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.015837    2563 generic.go:356] "Generic (PLEG): container finished" podID="f0faa8cb-3eaf-4085-8f36-0a86778fb552" containerID="7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7" exitCode=0
Sep 11 12:57:37.015920 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.015886    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"
Sep 11 12:57:37.016108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.015921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs" event={"ID":"f0faa8cb-3eaf-4085-8f36-0a86778fb552","Type":"ContainerDied","Data":"7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7"}
Sep 11 12:57:37.016108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.015979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs" event={"ID":"f0faa8cb-3eaf-4085-8f36-0a86778fb552","Type":"ContainerDied","Data":"86edd979c6f1e8c7f248b12c36d90291aacd4e690fe4866217040820ef4687d5"}
Sep 11 12:57:37.016108 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.016006    2563 scope.go:117] "RemoveContainer" containerID="7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7"
Sep 11 12:57:37.025156 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.025104    2563 scope.go:117] "RemoveContainer" containerID="7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7"
Sep 11 12:57:37.025408 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:57:37.025388    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7\": container with ID starting with 7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7 not found: ID does not exist" containerID="7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7"
Sep 11 12:57:37.025477 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.025417    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7"} err="failed to get container status \"7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7\": rpc error: code = NotFound desc = could not find container \"7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7\": container with ID starting with 7ac770dbdbc027e08d6d4160f308a281a7c520ddfd9d4f7a2c4ee31c98566ad7 not found: ID does not exist"
Sep 11 12:57:37.053220 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.053145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"]
Sep 11 12:57:37.063546 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.063524    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-1337fa-58445d955f-ftpxs"]
Sep 11 12:57:37.805121 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:37.805088    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0faa8cb-3eaf-4085-8f36-0a86778fb552" path="/var/lib/kubelet/pods/f0faa8cb-3eaf-4085-8f36-0a86778fb552/volumes"
Sep 11 12:57:46.521262 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.521207    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-r6ljw"]
Sep 11 12:57:46.521834 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.521495    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dd9d877ff-r6ljw" podUID="7818b3d3-ec31-43be-84de-5684531aba2e" containerName="manager" containerID="cri-o://356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a" gracePeriod=30
Sep 11 12:57:46.767833 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.767809    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:57:46.813969 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.813872    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-webhook-cert\") pod \"7818b3d3-ec31-43be-84de-5684531aba2e\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") "
Sep 11 12:57:46.813969 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.813931    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-metrics-certs\") pod \"7818b3d3-ec31-43be-84de-5684531aba2e\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") "
Sep 11 12:57:46.814209 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.814157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mf7z\" (UniqueName: \"kubernetes.io/projected/7818b3d3-ec31-43be-84de-5684531aba2e-kube-api-access-2mf7z\") pod \"7818b3d3-ec31-43be-84de-5684531aba2e\" (UID: \"7818b3d3-ec31-43be-84de-5684531aba2e\") "
Sep 11 12:57:46.816288 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.816256    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7818b3d3-ec31-43be-84de-5684531aba2e-kube-api-access-2mf7z" (OuterVolumeSpecName: "kube-api-access-2mf7z") pod "7818b3d3-ec31-43be-84de-5684531aba2e" (UID: "7818b3d3-ec31-43be-84de-5684531aba2e"). InnerVolumeSpecName "kube-api-access-2mf7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:46.816516 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.816495    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7818b3d3-ec31-43be-84de-5684531aba2e" (UID: "7818b3d3-ec31-43be-84de-5684531aba2e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:46.816584 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.816564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7818b3d3-ec31-43be-84de-5684531aba2e" (UID: "7818b3d3-ec31-43be-84de-5684531aba2e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:46.914976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.914937    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:46.914976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.914971    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mf7z\" (UniqueName: \"kubernetes.io/projected/7818b3d3-ec31-43be-84de-5684531aba2e-kube-api-access-2mf7z\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:46.914976 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:46.914982    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7818b3d3-ec31-43be-84de-5684531aba2e-webhook-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:57:47.067276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.067184    2563 generic.go:356] "Generic (PLEG): container finished" podID="7818b3d3-ec31-43be-84de-5684531aba2e" containerID="356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a" exitCode=0
Sep 11 12:57:47.067276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.067234    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-r6ljw"
Sep 11 12:57:47.067276 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.067260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-r6ljw" event={"ID":"7818b3d3-ec31-43be-84de-5684531aba2e","Type":"ContainerDied","Data":"356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a"}
Sep 11 12:57:47.067520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.067316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-r6ljw" event={"ID":"7818b3d3-ec31-43be-84de-5684531aba2e","Type":"ContainerDied","Data":"28d1b2e77e0cdaba167ffc420ae8237a43d3fbe748bb7202a277070586ece8d7"}
Sep 11 12:57:47.067520 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.067338    2563 scope.go:117] "RemoveContainer" containerID="356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a"
Sep 11 12:57:47.076760 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.076740    2563 scope.go:117] "RemoveContainer" containerID="356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a"
Sep 11 12:57:47.077043 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:57:47.077024    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a\": container with ID starting with 356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a not found: ID does not exist" containerID="356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a"
Sep 11 12:57:47.077111 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.077049    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a"} err="failed to get container status \"356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a\": rpc error: code = NotFound desc = could not find container \"356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a\": container with ID starting with 356e813ee366fb544989bbd5bfac515c9f8c34bde5a872512eb5f7720e70217a not found: ID does not exist"
Sep 11 12:57:47.094233 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.094203    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-r6ljw"]
Sep 11 12:57:47.101046 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.101026    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-r6ljw"]
Sep 11 12:57:47.805310 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:57:47.805275    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7818b3d3-ec31-43be-84de-5684531aba2e" path="/var/lib/kubelet/pods/7818b3d3-ec31-43be-84de-5684531aba2e/volumes"
Sep 11 12:58:47.890990 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.890958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd9d877ff-lph5c"]
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891328    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7818b3d3-ec31-43be-84de-5684531aba2e" containerName="manager"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891341    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7818b3d3-ec31-43be-84de-5684531aba2e" containerName="manager"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891355    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063e51aa-6540-480d-9dcb-a2c6265bc4e1" containerName="payload-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891375    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="063e51aa-6540-480d-9dcb-a2c6265bc4e1" containerName="payload-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891382    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad460fe-6a6e-41c9-a1f3-0c5d07140c35" containerName="payload-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891388    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad460fe-6a6e-41c9-a1f3-0c5d07140c35" containerName="payload-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891398    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6897758e-801e-4191-91ff-d7873ce1ffac" containerName="maas-api"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891404    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6897758e-801e-4191-91ff-d7873ce1ffac" containerName="maas-api"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891413    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea95564a-c985-4d50-9dc3-5c8e8cf7d078" containerName="payload-pre-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891418    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea95564a-c985-4d50-9dc3-5c8e8cf7d078" containerName="payload-pre-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891428    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" containerName="payload-pre-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891433    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" containerName="payload-pre-processing"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891439    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0faa8cb-3eaf-4085-8f36-0a86778fb552" containerName="maas-api"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891443    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0faa8cb-3eaf-4085-8f36-0a86778fb552" containerName="maas-api"
Sep 11 12:58:47.891447 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891454    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13908e38-0893-48fa-bf0a-e2b0ad3380b9" containerName="payload-pre-processing"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891459    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13908e38-0893-48fa-bf0a-e2b0ad3380b9" containerName="payload-pre-processing"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891469    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d85713-ffa5-47c4-9eef-835e6873805a" containerName="maas-api"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891474    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d85713-ffa5-47c4-9eef-835e6873805a" containerName="maas-api"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891525    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4aa3d1-7fa0-4413-8a5a-902b90093bf4" containerName="payload-pre-processing"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891535    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6d85713-ffa5-47c4-9eef-835e6873805a" containerName="maas-api"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891542    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13908e38-0893-48fa-bf0a-e2b0ad3380b9" containerName="payload-pre-processing"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891549    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7818b3d3-ec31-43be-84de-5684531aba2e" containerName="manager"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad460fe-6a6e-41c9-a1f3-0c5d07140c35" containerName="payload-processing"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891559    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0faa8cb-3eaf-4085-8f36-0a86778fb552" containerName="maas-api"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891565    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6897758e-801e-4191-91ff-d7873ce1ffac" containerName="maas-api"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891571    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea95564a-c985-4d50-9dc3-5c8e8cf7d078" containerName="payload-pre-processing"
Sep 11 12:58:47.892008 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.891576    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="063e51aa-6540-480d-9dcb-a2c6265bc4e1" containerName="payload-processing"
Sep 11 12:58:47.894634 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.894617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:47.899123 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.899100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 12:58:47.899240 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.899132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 12:58:47.899240 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.899106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sd5qx\""
Sep 11 12:58:47.899240 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.899197    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 12:58:47.906804 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.906781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-lph5c"]
Sep 11 12:58:47.959582 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.959558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-metrics-certs\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:47.959719 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.959596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-webhook-cert\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:47.959719 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:47.959628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl9l4\" (UniqueName: \"kubernetes.io/projected/97034213-a8bb-47ce-8eae-d3eebfcb4789-kube-api-access-dl9l4\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.060454 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.060428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-metrics-certs\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.060613 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.060465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-webhook-cert\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.060613 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.060492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl9l4\" (UniqueName: \"kubernetes.io/projected/97034213-a8bb-47ce-8eae-d3eebfcb4789-kube-api-access-dl9l4\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.062773 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.062749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-webhook-cert\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.062888 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.062807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-metrics-certs\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.070477 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.070454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl9l4\" (UniqueName: \"kubernetes.io/projected/97034213-a8bb-47ce-8eae-d3eebfcb4789-kube-api-access-dl9l4\") pod \"maas-controller-dd9d877ff-lph5c\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") " pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.206339 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.206314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:48.480103 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.480074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-lph5c"]
Sep 11 12:58:48.482500 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:58:48.482467    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97034213_a8bb_47ce_8eae_d3eebfcb4789.slice/crio-dcc26bcca3e5b6e7cd56653be07342fbf772be14f91c34b9cacc09b8e8a3119f WatchSource:0}: Error finding container dcc26bcca3e5b6e7cd56653be07342fbf772be14f91c34b9cacc09b8e8a3119f: Status 404 returned error can't find the container with id dcc26bcca3e5b6e7cd56653be07342fbf772be14f91c34b9cacc09b8e8a3119f
Sep 11 12:58:48.483850 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:48.483830    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:58:49.362219 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:49.362141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-lph5c" event={"ID":"97034213-a8bb-47ce-8eae-d3eebfcb4789","Type":"ContainerStarted","Data":"b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c"}
Sep 11 12:58:49.362219 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:49.362190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-lph5c" event={"ID":"97034213-a8bb-47ce-8eae-d3eebfcb4789","Type":"ContainerStarted","Data":"dcc26bcca3e5b6e7cd56653be07342fbf772be14f91c34b9cacc09b8e8a3119f"}
Sep 11 12:58:49.362641 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:49.362262    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:58:49.390331 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:58:49.386201    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dd9d877ff-lph5c" podStartSLOduration=1.783474094 podStartE2EDuration="2.386167455s" totalImagesPullingTime="602.693361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:58:49.382872417 +0000 UTC m=+1930.095875457" watchObservedRunningTime="2026-09-11 12:58:49.386167455 +0000 UTC m=+1930.099170494"
Sep 11 12:59:00.368947 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:00.368910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:59:09.755917 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:09.755879    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-lph5c"]
Sep 11 12:59:09.756488 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:09.756080    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dd9d877ff-lph5c" podUID="97034213-a8bb-47ce-8eae-d3eebfcb4789" containerName="manager" containerID="cri-o://b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c" gracePeriod=30
Sep 11 12:59:10.001657 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.001626    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:59:10.169462 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.169429    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-webhook-cert\") pod \"97034213-a8bb-47ce-8eae-d3eebfcb4789\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") "
Sep 11 12:59:10.169462 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.169468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-metrics-certs\") pod \"97034213-a8bb-47ce-8eae-d3eebfcb4789\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") "
Sep 11 12:59:10.169725 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.169539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl9l4\" (UniqueName: \"kubernetes.io/projected/97034213-a8bb-47ce-8eae-d3eebfcb4789-kube-api-access-dl9l4\") pod \"97034213-a8bb-47ce-8eae-d3eebfcb4789\" (UID: \"97034213-a8bb-47ce-8eae-d3eebfcb4789\") "
Sep 11 12:59:10.171693 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.171648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "97034213-a8bb-47ce-8eae-d3eebfcb4789" (UID: "97034213-a8bb-47ce-8eae-d3eebfcb4789"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:59:10.171810 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.171688    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "97034213-a8bb-47ce-8eae-d3eebfcb4789" (UID: "97034213-a8bb-47ce-8eae-d3eebfcb4789"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:59:10.171810 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.171729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97034213-a8bb-47ce-8eae-d3eebfcb4789-kube-api-access-dl9l4" (OuterVolumeSpecName: "kube-api-access-dl9l4") pod "97034213-a8bb-47ce-8eae-d3eebfcb4789" (UID: "97034213-a8bb-47ce-8eae-d3eebfcb4789"). InnerVolumeSpecName "kube-api-access-dl9l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:59:10.270264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.270232    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl9l4\" (UniqueName: \"kubernetes.io/projected/97034213-a8bb-47ce-8eae-d3eebfcb4789-kube-api-access-dl9l4\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:59:10.270264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.270261    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-webhook-cert\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:59:10.270264 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.270272    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97034213-a8bb-47ce-8eae-d3eebfcb4789-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 12:59:10.466186 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.466097    2563 generic.go:356] "Generic (PLEG): container finished" podID="97034213-a8bb-47ce-8eae-d3eebfcb4789" containerID="b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c" exitCode=0
Sep 11 12:59:10.466186 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.466149    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-lph5c"
Sep 11 12:59:10.466440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.466180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-lph5c" event={"ID":"97034213-a8bb-47ce-8eae-d3eebfcb4789","Type":"ContainerDied","Data":"b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c"}
Sep 11 12:59:10.466440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.466257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-lph5c" event={"ID":"97034213-a8bb-47ce-8eae-d3eebfcb4789","Type":"ContainerDied","Data":"dcc26bcca3e5b6e7cd56653be07342fbf772be14f91c34b9cacc09b8e8a3119f"}
Sep 11 12:59:10.466440 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.466290    2563 scope.go:117] "RemoveContainer" containerID="b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c"
Sep 11 12:59:10.475210 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.475190    2563 scope.go:117] "RemoveContainer" containerID="b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c"
Sep 11 12:59:10.475523 ip-10-0-133-121 kubenswrapper[2563]: E0911 12:59:10.475504    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c\": container with ID starting with b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c not found: ID does not exist" containerID="b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c"
Sep 11 12:59:10.475570 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.475532    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c"} err="failed to get container status \"b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c\": rpc error: code = NotFound desc = could not find container \"b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c\": container with ID starting with b44b98382e46826a43f684a839f03f47eb20647b37ca2d8bfb27315596138d8c not found: ID does not exist"
Sep 11 12:59:10.489742 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.489717    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-lph5c"]
Sep 11 12:59:10.494556 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:10.494535    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-lph5c"]
Sep 11 12:59:11.249846 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.249808    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd9d877ff-z9b7z"]
Sep 11 12:59:11.250388 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.250341    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97034213-a8bb-47ce-8eae-d3eebfcb4789" containerName="manager"
Sep 11 12:59:11.250388 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.250377    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97034213-a8bb-47ce-8eae-d3eebfcb4789" containerName="manager"
Sep 11 12:59:11.250538 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.250524    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="97034213-a8bb-47ce-8eae-d3eebfcb4789" containerName="manager"
Sep 11 12:59:11.255064 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.255043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.262258 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.262049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 12:59:11.263120 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.262868    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sd5qx\""
Sep 11 12:59:11.263120 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.262938    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 12:59:11.263120 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.262875    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 12:59:11.264921 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.264898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-z9b7z"]
Sep 11 12:59:11.379767 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.379737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da727657-4d0b-4b9a-985f-dba0c19d66f3-webhook-cert\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.379930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.379809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da727657-4d0b-4b9a-985f-dba0c19d66f3-metrics-certs\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.379930 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.379863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrtxj\" (UniqueName: \"kubernetes.io/projected/da727657-4d0b-4b9a-985f-dba0c19d66f3-kube-api-access-zrtxj\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.480734 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.480703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da727657-4d0b-4b9a-985f-dba0c19d66f3-webhook-cert\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.480912 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.480767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da727657-4d0b-4b9a-985f-dba0c19d66f3-metrics-certs\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.480912 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.480807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrtxj\" (UniqueName: \"kubernetes.io/projected/da727657-4d0b-4b9a-985f-dba0c19d66f3-kube-api-access-zrtxj\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.483313 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.483286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da727657-4d0b-4b9a-985f-dba0c19d66f3-metrics-certs\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.483429 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.483286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da727657-4d0b-4b9a-985f-dba0c19d66f3-webhook-cert\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.489951 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.489930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrtxj\" (UniqueName: \"kubernetes.io/projected/da727657-4d0b-4b9a-985f-dba0c19d66f3-kube-api-access-zrtxj\") pod \"maas-controller-dd9d877ff-z9b7z\" (UID: \"da727657-4d0b-4b9a-985f-dba0c19d66f3\") " pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.567225 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.567149    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:11.805559 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.805530    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97034213-a8bb-47ce-8eae-d3eebfcb4789" path="/var/lib/kubelet/pods/97034213-a8bb-47ce-8eae-d3eebfcb4789/volumes"
Sep 11 12:59:11.840199 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:11.840178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd9d877ff-z9b7z"]
Sep 11 12:59:11.842439 ip-10-0-133-121 kubenswrapper[2563]: W0911 12:59:11.842410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda727657_4d0b_4b9a_985f_dba0c19d66f3.slice/crio-93d015c2841589446bd2c465cdf4dc77a6b0ec56dfe531a6f29e4ceb119edc31 WatchSource:0}: Error finding container 93d015c2841589446bd2c465cdf4dc77a6b0ec56dfe531a6f29e4ceb119edc31: Status 404 returned error can't find the container with id 93d015c2841589446bd2c465cdf4dc77a6b0ec56dfe531a6f29e4ceb119edc31
Sep 11 12:59:12.478174 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:12.478139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-z9b7z" event={"ID":"da727657-4d0b-4b9a-985f-dba0c19d66f3","Type":"ContainerStarted","Data":"4b792f05e95398790c92933d9ef3a5a48d50247e3c00cc22b2003f0fb176b535"}
Sep 11 12:59:12.478677 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:12.478192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd9d877ff-z9b7z" event={"ID":"da727657-4d0b-4b9a-985f-dba0c19d66f3","Type":"ContainerStarted","Data":"93d015c2841589446bd2c465cdf4dc77a6b0ec56dfe531a6f29e4ceb119edc31"}
Sep 11 12:59:12.478677 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:12.478213    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 12:59:12.497785 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:12.497734    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dd9d877ff-z9b7z" podStartSLOduration=0.955566494 podStartE2EDuration="1.497716801s" totalImagesPullingTime="542.150307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:59:12.495655269 +0000 UTC m=+1953.208658307" watchObservedRunningTime="2026-09-11 12:59:12.497716801 +0000 UTC m=+1953.210719838"
Sep 11 12:59:23.486084 ip-10-0-133-121 kubenswrapper[2563]: I0911 12:59:23.486052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd9d877ff-z9b7z"
Sep 11 13:01:39.948011 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:01:39.947982    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 13:01:39.951462 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:01:39.951439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 13:01:39.951698 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:01:39.951672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 13:01:39.955255 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:01:39.955235    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5sslb_3bd31588-602d-455d-99f2-abb5353ae7d0/ovn-acl-logging/0.log"
Sep 11 13:03:04.834794 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.834759    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"]
Sep 11 13:03:04.838143 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.838127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:04.849032 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.849004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"]
Sep 11 13:03:04.928739 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.928704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3de53039-4e16-428f-b263-1c2e9d6a4a4a-openshift-service-ca\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:04.928739 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.928739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3de53039-4e16-428f-b263-1c2e9d6a4a4a-maas-api-tls\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:04.928952 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.928871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3de53039-4e16-428f-b263-1c2e9d6a4a4a-metrics-certs\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:04.928952 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:04.928934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmb7n\" (UniqueName: \"kubernetes.io/projected/3de53039-4e16-428f-b263-1c2e9d6a4a4a-kube-api-access-mmb7n\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.030498 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.030452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3de53039-4e16-428f-b263-1c2e9d6a4a4a-openshift-service-ca\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.030498 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.030501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3de53039-4e16-428f-b263-1c2e9d6a4a4a-maas-api-tls\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.030721 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.030617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3de53039-4e16-428f-b263-1c2e9d6a4a4a-metrics-certs\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.030721 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.030675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmb7n\" (UniqueName: \"kubernetes.io/projected/3de53039-4e16-428f-b263-1c2e9d6a4a4a-kube-api-access-mmb7n\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.031234 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.031211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3de53039-4e16-428f-b263-1c2e9d6a4a4a-openshift-service-ca\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.033059 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.033034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3de53039-4e16-428f-b263-1c2e9d6a4a4a-maas-api-tls\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.033211 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.033187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3de53039-4e16-428f-b263-1c2e9d6a4a4a-metrics-certs\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.039584 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.039563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmb7n\" (UniqueName: \"kubernetes.io/projected/3de53039-4e16-428f-b263-1c2e9d6a4a4a-kube-api-access-mmb7n\") pod \"maas-api-6664b7b778-k22xp\" (UID: \"3de53039-4e16-428f-b263-1c2e9d6a4a4a\") " pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.149224 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.149131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:05.426491 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.426466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"]
Sep 11 13:03:05.428907 ip-10-0-133-121 kubenswrapper[2563]: W0911 13:03:05.428878    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de53039_4e16_428f_b263_1c2e9d6a4a4a.slice/crio-44ebf4ccebcf80372cf6bc635f4c944a422e6850da76d4018940238cc3042f20 WatchSource:0}: Error finding container 44ebf4ccebcf80372cf6bc635f4c944a422e6850da76d4018940238cc3042f20: Status 404 returned error can't find the container with id 44ebf4ccebcf80372cf6bc635f4c944a422e6850da76d4018940238cc3042f20
Sep 11 13:03:05.605756 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:05.605723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp" event={"ID":"3de53039-4e16-428f-b263-1c2e9d6a4a4a","Type":"ContainerStarted","Data":"44ebf4ccebcf80372cf6bc635f4c944a422e6850da76d4018940238cc3042f20"}
Sep 11 13:03:06.613465 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:06.613413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp" event={"ID":"3de53039-4e16-428f-b263-1c2e9d6a4a4a","Type":"ContainerStarted","Data":"55c7150465a7202caddf3660a00b86cb7b116d1f8996fc6a5d15c971b8401e62"}
Sep 11 13:03:06.613866 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:06.613646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:06.635374 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:06.635324    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp" podStartSLOduration=2.081538609 podStartE2EDuration="2.635310406s" totalImagesPullingTime="553.771797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:06.633420244 +0000 UTC m=+2187.346423283" watchObservedRunningTime="2026-09-11 13:03:06.635310406 +0000 UTC m=+2187.348313445"
Sep 11 13:03:12.624659 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:12.624630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6664b7b778-k22xp"
Sep 11 13:03:12.682286 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:12.682245    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"]
Sep 11 13:03:12.682513 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:12.682485    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf" podUID="5ed8a4d0-4f1b-429b-83b0-45b603060112" containerName="maas-api" containerID="cri-o://cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e" gracePeriod=30
Sep 11 13:03:13.921800 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:13.921774    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 13:03:14.017940 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.017863    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed8a4d0-4f1b-429b-83b0-45b603060112-openshift-service-ca\") pod \"5ed8a4d0-4f1b-429b-83b0-45b603060112\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") "
Sep 11 13:03:14.017940 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.017911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-maas-api-tls\") pod \"5ed8a4d0-4f1b-429b-83b0-45b603060112\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") "
Sep 11 13:03:14.018163 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.017956    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-metrics-certs\") pod \"5ed8a4d0-4f1b-429b-83b0-45b603060112\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") "
Sep 11 13:03:14.018163 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.018041    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmfcf\" (UniqueName: \"kubernetes.io/projected/5ed8a4d0-4f1b-429b-83b0-45b603060112-kube-api-access-nmfcf\") pod \"5ed8a4d0-4f1b-429b-83b0-45b603060112\" (UID: \"5ed8a4d0-4f1b-429b-83b0-45b603060112\") "
Sep 11 13:03:14.018283 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.018219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed8a4d0-4f1b-429b-83b0-45b603060112-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ed8a4d0-4f1b-429b-83b0-45b603060112" (UID: "5ed8a4d0-4f1b-429b-83b0-45b603060112"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:03:14.018506 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.018487    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed8a4d0-4f1b-429b-83b0-45b603060112-openshift-service-ca\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 13:03:14.020042 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.020014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed8a4d0-4f1b-429b-83b0-45b603060112-kube-api-access-nmfcf" (OuterVolumeSpecName: "kube-api-access-nmfcf") pod "5ed8a4d0-4f1b-429b-83b0-45b603060112" (UID: "5ed8a4d0-4f1b-429b-83b0-45b603060112"). InnerVolumeSpecName "kube-api-access-nmfcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:03:14.020125 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.020056    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ed8a4d0-4f1b-429b-83b0-45b603060112" (UID: "5ed8a4d0-4f1b-429b-83b0-45b603060112"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:03:14.020125 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.020081    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5ed8a4d0-4f1b-429b-83b0-45b603060112" (UID: "5ed8a4d0-4f1b-429b-83b0-45b603060112"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:03:14.119341 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.119310    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-maas-api-tls\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 13:03:14.119341 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.119335    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed8a4d0-4f1b-429b-83b0-45b603060112-metrics-certs\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 13:03:14.119341 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.119344    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmfcf\" (UniqueName: \"kubernetes.io/projected/5ed8a4d0-4f1b-429b-83b0-45b603060112-kube-api-access-nmfcf\") on node \"ip-10-0-133-121.ec2.internal\" DevicePath \"\""
Sep 11 13:03:14.652727 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.652689    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ed8a4d0-4f1b-429b-83b0-45b603060112" containerID="cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e" exitCode=0
Sep 11 13:03:14.652901 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.652733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"
Sep 11 13:03:14.652901 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.652769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf" event={"ID":"5ed8a4d0-4f1b-429b-83b0-45b603060112","Type":"ContainerDied","Data":"cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e"}
Sep 11 13:03:14.652901 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.652825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf" event={"ID":"5ed8a4d0-4f1b-429b-83b0-45b603060112","Type":"ContainerDied","Data":"cc35d5fbab4f8dc9c41e1778b727a9410698e68f35914cdac5f8f6ce30bc8c60"}
Sep 11 13:03:14.652901 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.652850    2563 scope.go:117] "RemoveContainer" containerID="cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e"
Sep 11 13:03:14.662304 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.662288    2563 scope.go:117] "RemoveContainer" containerID="cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e"
Sep 11 13:03:14.662667 ip-10-0-133-121 kubenswrapper[2563]: E0911 13:03:14.662638    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e\": container with ID starting with cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e not found: ID does not exist" containerID="cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e"
Sep 11 13:03:14.662738 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.662681    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e"} err="failed to get container status \"cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e\": rpc error: code = NotFound desc = could not find container \"cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e\": container with ID starting with cff4679e54ef4ae875f8bb4a05788ba8d206567288f398ab4581f31196ed7f2e not found: ID does not exist"
Sep 11 13:03:14.677718 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.677695    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"]
Sep 11 13:03:14.681668 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:14.681648    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-78cdb675f8-7nvnf"]
Sep 11 13:03:15.811911 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:15.811873    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed8a4d0-4f1b-429b-83b0-45b603060112" path="/var/lib/kubelet/pods/5ed8a4d0-4f1b-429b-83b0-45b603060112/volumes"
Sep 11 13:03:32.626586 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:32.626558    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dd9d877ff-z9b7z_da727657-4d0b-4b9a-985f-dba0c19d66f3/manager/0.log"
Sep 11 13:03:32.730626 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:32.730598    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jlt5s_f744a4c1-b285-4540-9a40-228ebdc71d54/server/0.log"
Sep 11 13:03:33.084318 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:33.084291    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-f9z7q_a2a1c760-1069-4483-8ddb-c9143c39c49b/copy-manifests/0.log"
Sep 11 13:03:33.094297 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:33.094272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-f9z7q_a2a1c760-1069-4483-8ddb-c9143c39c49b/manager/0.log"
Sep 11 13:03:33.665590 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:33.665564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6664b7b778-k22xp_3de53039-4e16-428f-b263-1c2e9d6a4a4a/maas-api/0.log"
Sep 11 13:03:33.990992 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:33.990917    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kr9t6_80e0b938-4068-4587-9d0e-6b2bfc767172/postgres/0.log"
Sep 11 13:03:35.879950 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:35.879919    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zbxmm_29a5165b-5c2c-4e0d-a4e4-1d173552d8d5/discovery/0.log"
Sep 11 13:03:36.319763 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:36.319732    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kwsw6_c5319f2a-4387-49f5-93a8-e76154944cc3/payload-pre-processing/0.log"
Sep 11 13:03:36.568433 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:36.568406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc64c6b56-xmhwh_15635f4b-3982-4cd9-8130-6d5de40458e3/router/0.log"
Sep 11 13:03:36.904269 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:36.904240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bdl42_69679f84-6f92-44b0-b764-741178b1073a/main/0.log"
Sep 11 13:03:37.010873 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:37.010843    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4vf9h_63d30551-c232-4cf4-9921-afe1f510aad9/main/0.log"
Sep 11 13:03:37.446968 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:37.446937    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7r9tp_ce89ad9a-a151-47ed-a5de-74b03a973128/main/0.log"
Sep 11 13:03:45.557376 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:45.557342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bhqgf_d62afd5e-0b26-45bb-8113-f581cde3c6d5/global-pull-secret-syncer/0.log"
Sep 11 13:03:45.763530 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:45.763499    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sjxnz_5610ec0e-6a8f-4295-a5b2-511adee43ca4/konnectivity-agent/0.log"
Sep 11 13:03:45.838289 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:45.838217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-121.ec2.internal_f8d2aef2a39cd9167d2677babe4e9748/haproxy/0.log"
Sep 11 13:03:51.344942 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.344914    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/alertmanager/0.log"
Sep 11 13:03:51.369555 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.369529    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/config-reloader/0.log"
Sep 11 13:03:51.391069 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.391048    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/kube-rbac-proxy-web/0.log"
Sep 11 13:03:51.414247 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.414229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/kube-rbac-proxy/0.log"
Sep 11 13:03:51.441684 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.441664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/kube-rbac-proxy-metric/0.log"
Sep 11 13:03:51.464933 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.464912    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/prom-label-proxy/0.log"
Sep 11 13:03:51.488010 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.487994    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0cff8dcb-35e3-44cf-92e4-8ec947a58daa/init-config-reloader/0.log"
Sep 11 13:03:51.534136 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.534064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-sgfhz_a3f26454-b9d0-4199-82dd-e59f12fb5130/cluster-monitoring-operator/0.log"
Sep 11 13:03:51.557982 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.557960    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-2bq5j_92a3d652-d4ae-4012-ab07-1cd026b9bbd1/kube-state-metrics/0.log"
Sep 11 13:03:51.580856 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.580832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-2bq5j_92a3d652-d4ae-4012-ab07-1cd026b9bbd1/kube-rbac-proxy-main/0.log"
Sep 11 13:03:51.605975 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.605954    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-2bq5j_92a3d652-d4ae-4012-ab07-1cd026b9bbd1/kube-rbac-proxy-self/0.log"
Sep 11 13:03:51.847720 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.847650    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlp4v_c6bc939b-f33e-4938-9920-5d2d52d9628b/node-exporter/0.log"
Sep 11 13:03:51.879145 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.879122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlp4v_c6bc939b-f33e-4938-9920-5d2d52d9628b/kube-rbac-proxy/0.log"
Sep 11 13:03:51.899826 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.899806    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlp4v_c6bc939b-f33e-4938-9920-5d2d52d9628b/init-textfile/0.log"
Sep 11 13:03:51.927377 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.927341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dz4nk_ee2711f9-8aeb-4a92-8757-54b9c1c84d15/kube-rbac-proxy-main/0.log"
Sep 11 13:03:51.947539 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.947505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dz4nk_ee2711f9-8aeb-4a92-8757-54b9c1c84d15/kube-rbac-proxy-self/0.log"
Sep 11 13:03:51.968919 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:51.968901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dz4nk_ee2711f9-8aeb-4a92-8757-54b9c1c84d15/openshift-state-metrics/0.log"
Sep 11 13:03:52.009733 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.009715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/prometheus/0.log"
Sep 11 13:03:52.032244 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.032229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/config-reloader/0.log"
Sep 11 13:03:52.054356 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.054335    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/thanos-sidecar/0.log"
Sep 11 13:03:52.076842 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.076805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/kube-rbac-proxy-web/0.log"
Sep 11 13:03:52.100401 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.100333    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/kube-rbac-proxy/0.log"
Sep 11 13:03:52.124000 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.123971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/kube-rbac-proxy-thanos/0.log"
Sep 11 13:03:52.146852 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.146831    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93952af1-6213-4458-b6bd-71966877bf1e/init-config-reloader/0.log"
Sep 11 13:03:52.175368 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.175347    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-sh4tq_54911bce-ca7e-41e3-8154-9823cbe64640/prometheus-operator/0.log"
Sep 11 13:03:52.198891 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.198872    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-sh4tq_54911bce-ca7e-41e3-8154-9823cbe64640/kube-rbac-proxy/0.log"
Sep 11 13:03:52.222649 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:52.222628    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-dc8pv_1560719d-bea2-46df-b35f-c34fb82267c4/prometheus-operator-admission-webhook/0.log"
Sep 11 13:03:54.691484 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:54.691454    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/2.log"
Sep 11 13:03:54.695668 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:54.695645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-nclsq_c62718e5-19aa-45cf-bf82-50570d247c63/console-operator/3.log"
Sep 11 13:03:55.383190 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.383156    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"]
Sep 11 13:03:55.383606 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.383592    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed8a4d0-4f1b-429b-83b0-45b603060112" containerName="maas-api"
Sep 11 13:03:55.383657 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.383608    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed8a4d0-4f1b-429b-83b0-45b603060112" containerName="maas-api"
Sep 11 13:03:55.383696 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.383673    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed8a4d0-4f1b-429b-83b0-45b603060112" containerName="maas-api"
Sep 11 13:03:55.385618 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.385597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.388491 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.388470    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhplr\"/\"openshift-service-ca.crt\""
Sep 11 13:03:55.388602 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.388508    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhplr\"/\"kube-root-ca.crt\""
Sep 11 13:03:55.390101 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.390085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rhplr\"/\"default-dockercfg-lbvs9\""
Sep 11 13:03:55.397440 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.397421    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"]
Sep 11 13:03:55.496406 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.496346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-lib-modules\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.496600 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.496463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-proc\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.496600 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.496545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czl99\" (UniqueName: \"kubernetes.io/projected/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-kube-api-access-czl99\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.496600 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.496566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-sys\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.496722 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.496613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-podres\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597258 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-proc\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597447 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czl99\" (UniqueName: \"kubernetes.io/projected/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-kube-api-access-czl99\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597447 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-sys\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597447 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-podres\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597447 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-proc\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597447 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-lib-modules\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597695 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-sys\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597695 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-podres\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.597695 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.597536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-lib-modules\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.611546 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.611524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czl99\" (UniqueName: \"kubernetes.io/projected/d7be6f8c-b2fa-4fdf-b15d-608c6c453658-kube-api-access-czl99\") pod \"perf-node-gather-daemonset-wv9h8\" (UID: \"d7be6f8c-b2fa-4fdf-b15d-608c6c453658\") " pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.695492 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.695466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:55.965866 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:55.965825    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"]
Sep 11 13:03:55.968620 ip-10-0-133-121 kubenswrapper[2563]: W0911 13:03:55.968594    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7be6f8c_b2fa_4fdf_b15d_608c6c453658.slice/crio-e95c3e752ec596d3886efc7c449eee9f4d92d7ee262b75486e9617562cc8420a WatchSource:0}: Error finding container e95c3e752ec596d3886efc7c449eee9f4d92d7ee262b75486e9617562cc8420a: Status 404 returned error can't find the container with id e95c3e752ec596d3886efc7c449eee9f4d92d7ee262b75486e9617562cc8420a
Sep 11 13:03:56.861760 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:56.861726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8" event={"ID":"d7be6f8c-b2fa-4fdf-b15d-608c6c453658","Type":"ContainerStarted","Data":"baa2d8c6bf3d18387c346eaa53d520f1a78dc0b217021bff21f750fbbc7f4a16"}
Sep 11 13:03:56.862120 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:56.861777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8" event={"ID":"d7be6f8c-b2fa-4fdf-b15d-608c6c453658","Type":"ContainerStarted","Data":"e95c3e752ec596d3886efc7c449eee9f4d92d7ee262b75486e9617562cc8420a"}
Sep 11 13:03:56.862120 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:56.861799    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:03:56.879532 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:56.879492    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8" podStartSLOduration=1.8794784949999999 podStartE2EDuration="1.879478495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:56.878799692 +0000 UTC m=+2237.591802731" watchObservedRunningTime="2026-09-11 13:03:56.879478495 +0000 UTC m=+2237.592481532"
Sep 11 13:03:57.133420 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:57.133340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2h7pz_0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308/dns/0.log"
Sep 11 13:03:57.163992 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:57.163970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2h7pz_0e8213c4-c1e3-4b5a-b4ef-3b8c87ede308/kube-rbac-proxy/0.log"
Sep 11 13:03:57.374102 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:57.374075    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gsb88_3738755c-d7ed-42ec-b73b-2293264b6a58/dns-node-resolver/0.log"
Sep 11 13:03:57.942693 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:57.942664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mjr57_398ed8ec-3c6b-4305-be68-5abbc29dc9be/node-ca/0.log"
Sep 11 13:03:59.094043 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:59.094012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zbxmm_29a5165b-5c2c-4e0d-a4e4-1d173552d8d5/discovery/0.log"
Sep 11 13:03:59.245354 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:59.245327    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kwsw6_c5319f2a-4387-49f5-93a8-e76154944cc3/payload-pre-processing/0.log"
Sep 11 13:03:59.317176 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:03:59.317152    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc64c6b56-xmhwh_15635f4b-3982-4cd9-8130-6d5de40458e3/router/0.log"
Sep 11 13:04:00.172174 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:00.172146    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cq2v_7deaa126-8256-42ed-9c6f-5976a5ec0aa2/serve-healthcheck-canary/0.log"
Sep 11 13:04:00.740836 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:00.740810    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mhfj_e4d3aa49-8bb5-40d1-8ee5-2258463f93b3/kube-rbac-proxy/0.log"
Sep 11 13:04:00.761684 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:00.761659    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mhfj_e4d3aa49-8bb5-40d1-8ee5-2258463f93b3/exporter/0.log"
Sep 11 13:04:00.783631 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:00.783609    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8mhfj_e4d3aa49-8bb5-40d1-8ee5-2258463f93b3/extractor/0.log"
Sep 11 13:04:02.876456 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:02.876383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rhplr/perf-node-gather-daemonset-wv9h8"
Sep 11 13:04:03.240500 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:03.240463    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dd9d877ff-z9b7z_da727657-4d0b-4b9a-985f-dba0c19d66f3/manager/0.log"
Sep 11 13:04:03.262103 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:03.262077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jlt5s_f744a4c1-b285-4540-9a40-228ebdc71d54/server/0.log"
Sep 11 13:04:03.466279 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:03.466250    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-f9z7q_a2a1c760-1069-4483-8ddb-c9143c39c49b/manager/0.log"
Sep 11 13:04:03.486439 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:03.486420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65cbc8d955-f9z7q_a2a1c760-1069-4483-8ddb-c9143c39c49b/copy-manifests/0.log"
Sep 11 13:04:05.015184 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:05.015115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-556b8bb6b-wwwl9_d2355ec8-9e28-4221-b749-8bd99e4d8369/manager/0.log"
Sep 11 13:04:05.313080 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:05.313012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zbxmm_29a5165b-5c2c-4e0d-a4e4-1d173552d8d5/discovery/0.log"
Sep 11 13:04:05.396080 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:05.396056    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kwsw6_c5319f2a-4387-49f5-93a8-e76154944cc3/payload-pre-processing/0.log"
Sep 11 13:04:05.447893 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:05.447863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc64c6b56-xmhwh_15635f4b-3982-4cd9-8130-6d5de40458e3/router/0.log"
Sep 11 13:04:07.060858 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:07.060780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zbxmm_29a5165b-5c2c-4e0d-a4e4-1d173552d8d5/discovery/0.log"
Sep 11 13:04:07.149779 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:07.149749    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kwsw6_c5319f2a-4387-49f5-93a8-e76154944cc3/payload-pre-processing/0.log"
Sep 11 13:04:07.205602 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:07.205574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc64c6b56-xmhwh_15635f4b-3982-4cd9-8130-6d5de40458e3/router/0.log"
Sep 11 13:04:11.416003 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.415974    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/kube-multus-additional-cni-plugins/0.log"
Sep 11 13:04:11.462135 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.462101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/egress-router-binary-copy/0.log"
Sep 11 13:04:11.510209 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.510167    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/cni-plugins/0.log"
Sep 11 13:04:11.544005 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.543979    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/bond-cni-plugin/0.log"
Sep 11 13:04:11.596171 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.596113    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/routeoverride-cni/0.log"
Sep 11 13:04:11.648974 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.648953    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/whereabouts-cni-bincopy/0.log"
Sep 11 13:04:11.692883 ip-10-0-133-121 kubenswrapper[2563]: I0911 13:04:11.692822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-78xpk_45419924-f936-4192-89df-b7f611862137/whereabouts-cni/0.log"