Jul 27 20:51:08.542824 ip-10-0-131-91 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:51:08.845895 ip-10-0-131-91 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:51:08.845895 ip-10-0-131-91 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:51:08.845895 ip-10-0-131-91 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:51:08.845895 ip-10-0-131-91 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:51:08.845895 ip-10-0-131-91 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:51:08.847338 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.847255    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:51:08.854209 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854189    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:08.854209 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854208    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854216    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854222    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854227    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854231    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854236    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854240    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854244    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854249    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854253    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854257    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854261    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854265    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854269    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854274    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854278    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854282    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854288    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854294    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:08.854356 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854299    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854303    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854307    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854312    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854316    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854319    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854323    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854328    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854332    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854336    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854340    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854344    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854351    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854355    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854359    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854363    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854367    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854370    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854375    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854378    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:08.855149 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854383    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854387    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854391    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854395    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854399    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854403    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854407    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854412    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854416    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854419    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854423    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854428    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854432    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854436    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854441    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854445    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854449    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854453    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854457    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854461    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:08.855997 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854465    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854470    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854474    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854478    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854483    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854489    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854496    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854500    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854505    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854510    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854514    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854518    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854522    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854526    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854533    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854536    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854540    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854544    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854549    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:08.856871 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854578    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854583    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854588    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854592    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854597    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854602    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854605    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854612    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854616    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854621    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854625    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854629    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854633    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854637    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854641    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854645    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854649    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854653    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854657    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.854661    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:08.857704 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855824    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855834    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855839    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855843    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855848    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855852    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855856    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855861    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855865    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855870    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855874    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855878    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855883    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855887    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855891    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855895    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855900    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855906    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855910    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:08.858545 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855915    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855919    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855924    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855928    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855933    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855937    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855941    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855945    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855949    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855954    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855959    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855963    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855968    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855972    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855977    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855981    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855985    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855989    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855993    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.855996    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:08.859216 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856000    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856004    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856008    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856012    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856017    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856023    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856027    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856031    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856035    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856040    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856044    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856050    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856054    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856058    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856062    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856066    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856071    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856076    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856080    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:08.859841 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856085    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856089    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856093    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856097    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856101    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856106    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856110    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856115    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856119    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856123    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856127    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856131    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856135    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856139    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856143    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856148    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856155    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856162    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856166    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856171    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:08.860506 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856175    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856180    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856185    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856190    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856195    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856203    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856207    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856212    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856216    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856220    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856224    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856229    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856233    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856237    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856241    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856245    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856249    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856253    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856257    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:08.861027 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856263    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856269    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856850    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856861    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856866    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856870    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856875    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856879    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856883    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856888    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856893    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856897    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856901    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856906    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856910    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856915    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856919    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856923    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856928    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856932    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:08.861537 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856936    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856941    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856945    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856949    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856953    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856957    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856961    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856965    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856969    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856974    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856978    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856982    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856986    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856990    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856994    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.856999    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857003    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857007    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857011    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857015    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:08.862099 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857020    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857027    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857032    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857036    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857040    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857045    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857049    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857053    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857058    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857062    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857066    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857072    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857077    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857081    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857085    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857089    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857094    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857098    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857102    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857106    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:08.862613 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857110    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857114    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857118    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857122    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857126    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857130    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857134    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857140    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857144    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857148    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857152    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857156    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857160    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857166    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857170    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857174    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857181    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857187    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857192    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:08.863091 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857197    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857202    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857206    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857211    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857217    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857223    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857227    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857232    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857237    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857241    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857245    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857249    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857257    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857263    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857267    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857271    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857275    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857280    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857284    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:08.863580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857288    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857294    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.857298    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857395    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857406    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857415    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857421    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857429    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857433    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857440    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857446    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857450    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857455    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857461    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857466    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857470    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857475    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857479    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857484    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857490    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857495    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857502    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857506    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857511    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:51:08.864040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857516    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857521    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857527    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857531    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857537    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857542    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857546    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857551    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857573    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857581    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857585    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857592    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857596    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857601    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857605    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857611    2567 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857615    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857622    2567 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857627    2567 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857631    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857636    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857640    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857646    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857651    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857655    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:51:08.864696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857660    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857665    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857669    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857675    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857680    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857684    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857688    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857693    2567 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857699    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857703    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857707    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857711    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857716    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857720    2567 flags.go:64] FLAG: --help="false"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857724    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-131-91.ec2.internal"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857729    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857735    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857740    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857746    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857751    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857756    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857760    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857765    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:51:08.865296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857770    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857774    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857779    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857783    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857788    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857793    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857798    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857802    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857807    2567 flags.go:64] FLAG: --lock-file=""
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857811    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857815    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857820    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857829    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857834    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857838    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857843    2567 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857848    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857853    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857857    2567 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857861    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857868    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857873    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857878    2567 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857883    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857887    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:51:08.865912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857894    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857898    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857903    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857907    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857912    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857923    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857929    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857933    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857938    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857942    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857951    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857955    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857960    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857964    2567 flags.go:64] FLAG: --port="10250"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857969    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857974    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04dc61aadee4cc659"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857978    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857983    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857988    2567 flags.go:64] FLAG: --register-node="true"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857993    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.857998    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858004    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858008    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858013    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858018    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:51:08.866509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858023    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858028    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858033    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858037    2567 flags.go:64] FLAG: --runonce="false"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858042    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858047    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858051    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858056    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858063    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858067    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858072    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858077    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858082    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858087    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858092    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858096    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858101    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858106    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858110    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858118    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858123    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858127    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858134    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858139    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858143    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:51:08.867135 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858148    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858152    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858157    2567 flags.go:64] FLAG: --v="2"
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858163    2567 flags.go:64] FLAG: --version="false"
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858174    2567 flags.go:64] FLAG: --vmodule=""
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858180    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.858185    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858358    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858365    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858370    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858375    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858381    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858385    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858390    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858394    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858401    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858405    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858409    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858413    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858418    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858422    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:08.867830 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858426    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858431    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858435    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858439    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858444    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858448    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858452    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858456    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858460    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858464    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858468    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858472    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858477    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858481    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858486    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858490    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858495    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858499    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858503    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858507    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:08.868331 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858511    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858515    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858519    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858524    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858528    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858532    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858538    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858542    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858547    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858550    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858572    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858578    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858582    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858586    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858590    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858595    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858599    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858602    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858607    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858611    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:08.868844 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858615    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858619    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858623    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858627    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858631    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858635    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858640    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858644    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858650    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858657    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858661    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858666    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858671    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858675    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858679    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858683    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858687    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858691    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858698    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858702    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:08.869352 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858706    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858710    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858714    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858720    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858724    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858728    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858732    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858737    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858741    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858745    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858749    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858753    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858758    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858762    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858766    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858770    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858777    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858783    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858788    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:08.869847 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858793    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858798    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858803    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858807    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858812    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.858818    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.859411    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.866065    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.866079    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.866669    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.866680    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866739    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866744    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866748    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:08.870294 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866752    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866756    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866760    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866764    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866767    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866770    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866773    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866775    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866778    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866781    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866783    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866786    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866789    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866791    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866794    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866796    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866799    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866801    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866803    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866806    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:08.870659 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866808    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866811    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866813    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866816    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866819    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866822    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866832    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866834    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866837    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866840    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866842    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866845    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866847    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866851    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866854    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866857    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866860    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866862    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866865    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:08.871133 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866867    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866869    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866872    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866874    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866877    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866879    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866882    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866885    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866887    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866889    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866892    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866894    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866897    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866899    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866901    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866904    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866907    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866909    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866912    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866915    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:08.871615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866923    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866926    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866928    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866932    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866936    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866939    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866941    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866944    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866947    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866949    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866952    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866954    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866957    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866959    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866962    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866964    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866967    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866969    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866972    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:08.872120 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866974    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866976    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866979    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866981    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866984    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866986    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866989    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.866997    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867000    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867003    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867005    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867008    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867010    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867013    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867021    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867023    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867026    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:08.872639 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867028    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.867033    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867163    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867167    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867170    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867172    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867175    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867178    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867180    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867183    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867190    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867193    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867195    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867198    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867200    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:08.873050 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867203    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867205    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867207    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867210    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867212    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867215    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867217    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867220    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867222    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867225    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867227    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867229    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867232    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867235    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867237    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867245    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867248    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867250    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867252    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867255    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:08.873419 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867257    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867259    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867262    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867264    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867267    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867269    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867271    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867274    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867276    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867279    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867281    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867283    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867286    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867288    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867291    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867294    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867297    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867300    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867302    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867304    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:08.873918 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867307    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867309    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867312    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867314    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867317    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867319    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867322    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867324    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867332    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867334    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867337    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867339    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867342    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867344    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867346    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867349    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867351    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867354    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867356    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867358    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:08.874386 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867361    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867363    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867366    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867368    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867370    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867373    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867375    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867378    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867380    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867382    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867385    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867387    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867389    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867392    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867394    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867396    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867399    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867402    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867404    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867406    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:08.874885 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867408    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867416    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867420    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867425    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867428    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:08.867431    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.867436    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.867531    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.869481    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.870811    2567 server.go:1019] "Starting client certificate rotation"
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.870917    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.871491    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:51:08.875349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.873885    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:51:08.875796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.875768    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:51:08.885104 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.885087    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:51:08.888100 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.888084    2567 log.go:25] "Validated CRI v1 image API"
Jul 27 20:51:08.892335 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.892322    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:51:08.894240 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.894221    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7f2a99e6-915d-4964-ad4d-5796a00f438c:/dev/nvme0n1p3 93bb4744-08a6-42c3-9120-157b90928a9e:/dev/nvme0n1p4]
Jul 27 20:51:08.894305 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.894241    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:51:08.899595 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.899472    2567 manager.go:216] Machine: {Timestamp:2026-07-27 20:51:08.898264575 +0000 UTC m=+0.261500858 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103546 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec283eb27b4203d7d13ec49e91865b94 SystemUUID:ec283eb2-7b42-03d7-d13e-c49e91865b94 BootID:8bc040f2-f196-4792-8d24-c59a48ba49a5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:55:d2:f7:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:55:d2:f7:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:70:99:5e:5e:59 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:51:08.899595 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.899590    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:51:08.899702 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.899659    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:51:08.901595 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.901572    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:51:08.901724 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.901598    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:51:08.902202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.902193    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:51:08.902241 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.902205    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:51:08.902241 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.902214    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:51:08.902241 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.902227    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:51:08.903015 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.903005    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:51:08.904347 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904332    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:51:08.904831 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904820    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:51:08.904943 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904934    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:51:08.904981 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904962    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:51:08.904981 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904971    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:51:08.905032 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904986    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:51:08.905032 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.904996    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:51:08.905032 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.905005    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:51:08.905400 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.905387    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:51:08.905439 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.905411    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:51:08.907078 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.907064    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:51:08.909074 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.909062    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:51:08.909123 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.909091    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:51:08.910527 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910517    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910532    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910540    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910545    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910571    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910580    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910590    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:51:08.910609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910610    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:51:08.910908 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910617    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:51:08.910908 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910626    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:51:08.910908 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910645    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:51:08.910908 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.910651    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:51:08.911849 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.911838    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:51:08.911849 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.911848    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:51:08.914969 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.914955    2567 server.go:1268] "Started kubelet"
Jul 27 20:51:08.915083 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.915060    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:51:08.915150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.915103    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:51:08.915150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.915096    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:51:08.919329 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.917324    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:51:08.919329 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.917600    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:51:08.919329 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.917695    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:51:08.919329 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.918043    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:51:08.919329 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.918897    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:51:08.917585 ip-10-0-131-91 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:51:08.921109 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.921090    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:51:08.925459 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.924782    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-91.ec2.internal.18c640b9c4dae6b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-91.ec2.internal,UID:ip-10-0-131-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-91.ec2.internal,},FirstTimestamp:2026-07-27 20:51:08.914788022 +0000 UTC m=+0.278024306,LastTimestamp:2026-07-27 20:51:08.914788022 +0000 UTC m=+0.278024306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-91.ec2.internal,}"
Jul 27 20:51:08.926581 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.926547    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:51:08.926641 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.926592    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:51:08.926695 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.926658    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:08.927305 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.927154    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:51:08.927305 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.927188    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:51:08.927305 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.927159    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:51:08.927468 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.927361    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:51:08.927468 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.927371    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:51:08.928206 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928187    2567 factory.go:55] Registering systemd factory
Jul 27 20:51:08.928206 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928202    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:51:08.928427 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928411    2567 factory.go:153] Registering CRI-O factory
Jul 27 20:51:08.928484 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928431    2567 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:51:08.928484 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928482    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:51:08.928589 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928506    2567 factory.go:103] Registering Raw factory
Jul 27 20:51:08.928589 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928521    2567 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:51:08.928919 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.928907    2567 manager.go:349] Starting recovery of all containers
Jul 27 20:51:08.935479 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.935446    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:51:08.935612 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.935589    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:51:08.939585 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.939040    2567 manager.go:354] Recovery completed
Jul 27 20:51:08.943495 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.943482    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:08.946961 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.946940    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:08.947018 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.946983    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:08.947018 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.946994    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:08.947634 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.947621    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:51:08.947634 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.947636    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:51:08.947753 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.947658    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:51:08.947753 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.947672    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:08.948419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.948404    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:08.948473 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.948435    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:08.948512 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.948474    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:08.948794 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.948693    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-91.ec2.internal.18c640b9c6c5ce34  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-91.ec2.internal,UID:ip-10-0-131-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-91.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-91.ec2.internal,},FirstTimestamp:2026-07-27 20:51:08.946959924 +0000 UTC m=+0.310196207,LastTimestamp:2026-07-27 20:51:08.946959924 +0000 UTC m=+0.310196207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-91.ec2.internal,}"
Jul 27 20:51:08.949575 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.949547    2567 policy_none.go:49] "None policy: Start"
Jul 27 20:51:08.949632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.949582    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:51:08.949632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.949598    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:51:08.950710 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.950698    2567 policy_none.go:47] "Start"
Jul 27 20:51:08.954696 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.954677    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rstlf"
Jul 27 20:51:08.961242 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.961146    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-91.ec2.internal.18c640b9c6c63be3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-91.ec2.internal,UID:ip-10-0-131-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-91.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-91.ec2.internal,},FirstTimestamp:2026-07-27 20:51:08.946988003 +0000 UTC m=+0.310224288,LastTimestamp:2026-07-27 20:51:08.946988003 +0000 UTC m=+0.310224288,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-91.ec2.internal,}"
Jul 27 20:51:08.962329 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.962311    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rstlf"
Jul 27 20:51:08.998087 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998065    2567 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:51:08.998173 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.998102    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:51:08.998173 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998115    2567 server.go:87] "Starting device plugin registration server"
Jul 27 20:51:08.998380 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998367    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:51:08.998448 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998381    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:51:08.998514 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998494    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:51:08.998651 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998638    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:51:08.998651 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:08.998652    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:51:08.999183 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.999167    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:51:08.999272 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:08.999210    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.020656 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.020634    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:51:09.021989 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.021975    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:51:09.022051 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.022008    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:51:09.022093 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.022052    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:51:09.022126 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.022090    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:51:09.024680 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.024663    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:09.099094 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.099003    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:09.099977 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.099957    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:09.100065 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.099990    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:09.100065 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.100000    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:09.100065 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.100023    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.109602 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.109586    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.109686 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.109607    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-91.ec2.internal\": node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.122907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.122884    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"]
Jul 27 20:51:09.122997 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.122945    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:09.123778 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.123763    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:09.123864 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.123794    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:09.123864 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.123808    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:09.124938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.124924    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:09.125069 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.125115 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125081    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:09.125587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125548    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:09.125678 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125596    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:09.125678 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125612    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:09.125745 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125596    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:09.125745 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125742    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:09.125802 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.125752    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:09.126678 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.126661    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.126736 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.126694    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:09.127845 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.127828    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:09.127919 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.127847    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:09.127919 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.127857    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:09.128001 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.127929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bf8cac1cb8fccbdc6fd8c2f146bc292-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal\" (UID: \"1bf8cac1cb8fccbdc6fd8c2f146bc292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.128001 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.127963    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf8cac1cb8fccbdc6fd8c2f146bc292-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal\" (UID: \"1bf8cac1cb8fccbdc6fd8c2f146bc292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.128071 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.128001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed929be85ebfd2f1b71d7e50ffae918d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-91.ec2.internal\" (UID: \"ed929be85ebfd2f1b71d7e50ffae918d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.143224 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.143199    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.151162 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.151138    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-91.ec2.internal\" not found" node="ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.154456 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.154442    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-91.ec2.internal\" not found" node="ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.228618 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.228595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed929be85ebfd2f1b71d7e50ffae918d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-91.ec2.internal\" (UID: \"ed929be85ebfd2f1b71d7e50ffae918d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.228704 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.228621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bf8cac1cb8fccbdc6fd8c2f146bc292-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal\" (UID: \"1bf8cac1cb8fccbdc6fd8c2f146bc292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.228704 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.228641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf8cac1cb8fccbdc6fd8c2f146bc292-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal\" (UID: \"1bf8cac1cb8fccbdc6fd8c2f146bc292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.228704 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.228685    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf8cac1cb8fccbdc6fd8c2f146bc292-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal\" (UID: \"1bf8cac1cb8fccbdc6fd8c2f146bc292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.228801 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.228707    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bf8cac1cb8fccbdc6fd8c2f146bc292-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal\" (UID: \"1bf8cac1cb8fccbdc6fd8c2f146bc292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.228801 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.228710    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed929be85ebfd2f1b71d7e50ffae918d-config\") pod \"kube-apiserver-proxy-ip-10-0-131-91.ec2.internal\" (UID: \"ed929be85ebfd2f1b71d7e50ffae918d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.244027 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.244006    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.344550 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.344509    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.445389 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.445320    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.453507 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.453488    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.457381 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.457244    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:09.545679 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.545638    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.646209 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.646177    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.746917 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.746689    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.847294 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.847254    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.870451 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.870420    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:51:09.870622 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.870603    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:51:09.947811 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:09.947776    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:09.967005 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.966967    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:46:09 +0000 UTC" deadline="2028-04-27 00:03:19.501496294 +0000 UTC"
Jul 27 20:51:09.967069 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.967010    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15339h12m9.534492123s"
Jul 27 20:51:09.975859 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:09.975826    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded929be85ebfd2f1b71d7e50ffae918d.slice/crio-3acc27d8f5c63c48f9d8f47e659e323ea4c0de6165da6695546987d0640f4408 WatchSource:0}: Error finding container 3acc27d8f5c63c48f9d8f47e659e323ea4c0de6165da6695546987d0640f4408: Status 404 returned error can't find the container with id 3acc27d8f5c63c48f9d8f47e659e323ea4c0de6165da6695546987d0640f4408
Jul 27 20:51:09.976125 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:09.976092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf8cac1cb8fccbdc6fd8c2f146bc292.slice/crio-58cd60d2785a8072b3196f44f5788c8312948e324976c326622ccb743d5dbbea WatchSource:0}: Error finding container 58cd60d2785a8072b3196f44f5788c8312948e324976c326622ccb743d5dbbea: Status 404 returned error can't find the container with id 58cd60d2785a8072b3196f44f5788c8312948e324976c326622ccb743d5dbbea
Jul 27 20:51:09.979674 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:09.979656    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:51:10.025947 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.025891    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal" event={"ID":"ed929be85ebfd2f1b71d7e50ffae918d","Type":"ContainerStarted","Data":"3acc27d8f5c63c48f9d8f47e659e323ea4c0de6165da6695546987d0640f4408"}
Jul 27 20:51:10.027027 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.026999    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal" event={"ID":"1bf8cac1cb8fccbdc6fd8c2f146bc292","Type":"ContainerStarted","Data":"58cd60d2785a8072b3196f44f5788c8312948e324976c326622ccb743d5dbbea"}
Jul 27 20:51:10.049077 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.049032    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:10.131516 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.131486    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:10.132526 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.132506    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:10.132662 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.132541    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:10.132662 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.132551    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:10.149874 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.149839    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:10.172876 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.172854    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:10.247332 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.247296    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:10.249923 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.249899    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:10.350624 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.350504    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-91.ec2.internal\" not found"
Jul 27 20:51:10.386429 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.386392    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:10.427380 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.427349    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:10.436008 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.435969    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:51:10.438323 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.438282    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal"
Jul 27 20:51:10.455217 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.455188    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:51:10.906163 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.906129    2567 apiserver.go:52] "Watching apiserver"
Jul 27 20:51:10.912955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.912928    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:51:10.913953 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.913926    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-4ttsr","kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal","openshift-image-registry/node-ca-kz7c6","openshift-multus/multus-additional-cni-plugins-r2x2s","openshift-multus/network-metrics-daemon-xvhwj","openshift-network-diagnostics/network-check-target-2j9ck","openshift-network-operator/iptables-alerter-sstdc","kube-system/global-pull-secret-syncer-dlvss","kube-system/konnectivity-agent-j4cv2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj","openshift-cluster-node-tuning-operator/tuned-g5xq8","openshift-dns/node-resolver-4kldw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal","openshift-multus/multus-hvn6j"]
Jul 27 20:51:10.915620 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.915597    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:10.915722 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.915680    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:10.916925 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.916895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.918057 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.917896    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:10.919658 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.919112    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.919658 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.919265    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.920026 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.920009    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.920299 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.920282    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:10.920392 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.920367    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:10.920471 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.920450    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:51:10.920534 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.920490    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:51:10.920663 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.920644    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q74xz\""
Jul 27 20:51:10.920770 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.920753    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v66dj\""
Jul 27 20:51:10.921632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.921288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:10.921632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.921616    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-67m2m\""
Jul 27 20:51:10.921823 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.921807    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.922167 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.922146    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.922248 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.922181    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:51:10.922339 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.922318    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:51:10.922711 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.922544    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:51:10.922795 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.922763    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.924172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.924149    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jvrwr\""
Jul 27 20:51:10.924436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.924415    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:51:10.924673 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.924631    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:10.924835 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:10.924807    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:10.924920 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.924855    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.925616 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.925594    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.925805 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.925660    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.925895 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.925867    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.925956 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.925929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:10.926540 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.926147    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:51:10.926540 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.926497    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:51:10.926652 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.926612    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:51:10.927212 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.927193    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:51:10.927461 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.927444    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lw4z9\""
Jul 27 20:51:10.927625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.927572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.928886 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.928868    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.929950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.929342    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.929950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.929531    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nsqjl\""
Jul 27 20:51:10.929950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.929736    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:51:10.930196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.930137    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:51:10.931933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.931843    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.932821    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.933485    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.933815    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.933833    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m6xzk\""
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.933982    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.934021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-scm48\""
Jul 27 20:51:10.934419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.934261    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.934867 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.934747    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:51:10.935321 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.934997    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:51:10.935321 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.935028    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s2wrx\""
Jul 27 20:51:10.940984 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.940841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26b9057b-6a13-4157-bfe5-17641024e234-ovn-node-metrics-cert\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.940984 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.940880    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32952a5d-cf34-405d-b269-53a351f82d9a-hosts-file\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:10.940984 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.940919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.940992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-var-lib-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-node-log\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-env-overrides\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/274bcbd6-ef93-4686-98a0-18286f84e849-konnectivity-ca\") pod \"konnectivity-agent-j4cv2\" (UID: \"274bcbd6-ef93-4686-98a0-18286f84e849\") " pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:10.941203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-host\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-tmp\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-cnibin\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4w6s\" (UniqueName: \"kubernetes.io/projected/d0fcda60-bf81-4305-83d7-080f46f96326-kube-api-access-d4w6s\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941287    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-registration-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-run\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-sys\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5k8\" (UniqueName: \"kubernetes.io/projected/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-kube-api-access-7l5k8\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-cni-netd\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-ovnkube-script-lib\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6h6l\" (UniqueName: \"kubernetes.io/projected/26b9057b-6a13-4157-bfe5-17641024e234-kube-api-access-w6h6l\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1259b23b-67fe-4a7a-8b50-8c219a156830-host-slash\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:10.941587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-var-lib-kubelet\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz6rl\" (UniqueName: \"kubernetes.io/projected/dc844e47-3a37-488e-8b43-45d669c7a184-kube-api-access-zz6rl\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-modprobe-d\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysctl-conf\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-lib-modules\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941710    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-systemd\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7wm\" (UniqueName: \"kubernetes.io/projected/32952a5d-cf34-405d-b269-53a351f82d9a-kube-api-access-bm7wm\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/274bcbd6-ef93-4686-98a0-18286f84e849-agent-certs\") pod \"konnectivity-agent-j4cv2\" (UID: \"274bcbd6-ef93-4686-98a0-18286f84e849\") " pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-os-release\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qbw\" (UniqueName: \"kubernetes.io/projected/73b12703-91cd-4468-95fc-bed4fb1859ec-kube-api-access-j6qbw\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-kubelet\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32952a5d-cf34-405d-b269-53a351f82d9a-tmp-dir\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941917    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1259b23b-67fe-4a7a-8b50-8c219a156830-iptables-alerter-script\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc844e47-3a37-488e-8b43-45d669c7a184-host\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-socket-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.942196 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.941992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-ovnkube-config\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysconfig\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942152    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-tuned\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942192    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-etc-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e77adafa-2a18-4718-9eb7-7fa46d6c1192-dbus\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-device-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-sys-fs\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-systemd\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jj5\" (UniqueName: \"kubernetes.io/projected/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-kube-api-access-64jj5\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-kubernetes\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysctl-d\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-ovn\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e77adafa-2a18-4718-9eb7-7fa46d6c1192-kubelet-config\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942547    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-run-netns\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-log-socket\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5qn7\" (UniqueName: \"kubernetes.io/projected/1259b23b-67fe-4a7a-8b50-8c219a156830-kube-api-access-w5qn7\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-system-cni-dir\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942729    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc844e47-3a37-488e-8b43-45d669c7a184-serviceca\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-systemd-units\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-cni-bin\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:10.943857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.942835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-slash\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:10.944526 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.944183    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:51:10.964712 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.964684    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ksj6z"
Jul 27 20:51:10.972732 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:10.972701    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ksj6z"
Jul 27 20:51:11.028882 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.028854    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-lib-modules\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043321    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-systemd\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7wm\" (UniqueName: \"kubernetes.io/projected/32952a5d-cf34-405d-b269-53a351f82d9a-kube-api-access-bm7wm\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/274bcbd6-ef93-4686-98a0-18286f84e849-agent-certs\") pod \"konnectivity-agent-j4cv2\" (UID: \"274bcbd6-ef93-4686-98a0-18286f84e849\") " pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-os-release\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qbw\" (UniqueName: \"kubernetes.io/projected/73b12703-91cd-4468-95fc-bed4fb1859ec-kube-api-access-j6qbw\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.043509 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.043459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-kubelet\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.044417 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.044368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32952a5d-cf34-405d-b269-53a351f82d9a-tmp-dir\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.044555 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.044451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.045725 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.045696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1259b23b-67fe-4a7a-8b50-8c219a156830-iptables-alerter-script\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.045885 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.045866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc844e47-3a37-488e-8b43-45d669c7a184-host\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.046031 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046007    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-kubelet\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.046100 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-socket-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.046100 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-cnibin\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.046202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046121    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-os-release\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.046202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.046202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32952a5d-cf34-405d-b269-53a351f82d9a-tmp-dir\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.046202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-ovnkube-config\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-system-cni-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6aa9272-7292-4f9f-96da-d31d327d5ba8-cni-binary-copy\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-kubelet\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046321    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc844e47-3a37-488e-8b43-45d669c7a184-host\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-hostroot\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046388    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-systemd\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysconfig\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.046445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.046442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-tuned\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.046897 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.045949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-lib-modules\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.047101 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047070    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysconfig\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.047207 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047118    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-os-release\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.047273 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-socket-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.047273 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047231    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047418    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047501    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047623    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-etc-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e77adafa-2a18-4718-9eb7-7fa46d6c1192-dbus\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.047792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-ovnkube-config\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048097    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e77adafa-2a18-4718-9eb7-7fa46d6c1192-dbus\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-etc-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-device-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048391    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-sys-fs\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-cni-bin\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-systemd\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048539    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jj5\" (UniqueName: \"kubernetes.io/projected/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-kube-api-access-64jj5\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.048843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-kubernetes\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048611    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysctl-d\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048665    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1259b23b-67fe-4a7a-8b50-8c219a156830-iptables-alerter-script\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-kubernetes\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-systemd\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-device-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-sys-fs\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysctl-d\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.048877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049145    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-ovn\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e77adafa-2a18-4718-9eb7-7fa46d6c1192-kubelet-config\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-netns\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-run-netns\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-log-socket\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.049765 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049759    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5qn7\" (UniqueName: \"kubernetes.io/projected/1259b23b-67fe-4a7a-8b50-8c219a156830-kube-api-access-w5qn7\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-socket-dir-parent\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049849    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-k8s-cni-cncf-io\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-daemon-config\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-system-cni-dir\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc844e47-3a37-488e-8b43-45d669c7a184-serviceca\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.049969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-etc-kubernetes\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-systemd-units\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-cni-bin\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-cni-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-slash\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26b9057b-6a13-4157-bfe5-17641024e234-ovn-node-metrics-cert\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32952a5d-cf34-405d-b269-53a351f82d9a-hosts-file\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-var-lib-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.050605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-node-log\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050300    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-env-overrides\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050393    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/274bcbd6-ef93-4686-98a0-18286f84e849-konnectivity-ca\") pod \"konnectivity-agent-j4cv2\" (UID: \"274bcbd6-ef93-4686-98a0-18286f84e849\") " pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-multus-certs\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmr48\" (UniqueName: \"kubernetes.io/projected/f6aa9272-7292-4f9f-96da-d31d327d5ba8-kube-api-access-nmr48\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-host\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050569    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-systemd-units\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-run-ovn\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-host\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-slash\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e77adafa-2a18-4718-9eb7-7fa46d6c1192-kubelet-config\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-run-netns\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050860    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-var-lib-openvswitch\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-system-cni-dir\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.050907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-tmp\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.051070    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:11.051388 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-env-overrides\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-cnibin\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4w6s\" (UniqueName: \"kubernetes.io/projected/d0fcda60-bf81-4305-83d7-080f46f96326-kube-api-access-d4w6s\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-registration-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.051545    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:11.551522238 +0000 UTC m=+2.914758513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-conf-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-run\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-sys\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5k8\" (UniqueName: \"kubernetes.io/projected/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-kube-api-access-7l5k8\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-cni-netd\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-ovnkube-script-lib\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6h6l\" (UniqueName: \"kubernetes.io/projected/26b9057b-6a13-4157-bfe5-17641024e234-kube-api-access-w6h6l\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1259b23b-67fe-4a7a-8b50-8c219a156830-host-slash\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-var-lib-kubelet\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.052316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32952a5d-cf34-405d-b269-53a351f82d9a-hosts-file\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz6rl\" (UniqueName: \"kubernetes.io/projected/dc844e47-3a37-488e-8b43-45d669c7a184-kube-api-access-zz6rl\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-cni-multus\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.051996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-modprobe-d\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysctl-conf\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-sysctl-conf\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-var-lib-kubelet\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052287    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-run\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-sys\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052343    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73b12703-91cd-4468-95fc-bed4fb1859ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-node-log\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.052479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-cni-netd\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1259b23b-67fe-4a7a-8b50-8c219a156830-host-slash\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73b12703-91cd-4468-95fc-bed4fb1859ec-cnibin\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.053252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-host-cni-bin\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053289    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26b9057b-6a13-4157-bfe5-17641024e234-ovnkube-script-lib\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053427    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/274bcbd6-ef93-4686-98a0-18286f84e849-konnectivity-ca\") pod \"konnectivity-agent-j4cv2\" (UID: \"274bcbd6-ef93-4686-98a0-18286f84e849\") " pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-registration-dir\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.053646    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.053744    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:11.553725404 +0000 UTC m=+2.916961677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc844e47-3a37-488e-8b43-45d669c7a184-serviceca\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053774    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26b9057b-6a13-4157-bfe5-17641024e234-log-socket\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.054024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.053941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-modprobe-d\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.055336 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.055307    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/274bcbd6-ef93-4686-98a0-18286f84e849-agent-certs\") pod \"konnectivity-agent-j4cv2\" (UID: \"274bcbd6-ef93-4686-98a0-18286f84e849\") " pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:11.058330 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.058267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-etc-tuned\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.058437 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.058416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26b9057b-6a13-4157-bfe5-17641024e234-ovn-node-metrics-cert\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.058570 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.058552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-tmp\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.058992 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.058965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qbw\" (UniqueName: \"kubernetes.io/projected/73b12703-91cd-4468-95fc-bed4fb1859ec-kube-api-access-j6qbw\") pod \"multus-additional-cni-plugins-r2x2s\" (UID: \"73b12703-91cd-4468-95fc-bed4fb1859ec\") " pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.059170 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.059149    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7wm\" (UniqueName: \"kubernetes.io/projected/32952a5d-cf34-405d-b269-53a351f82d9a-kube-api-access-bm7wm\") pod \"node-resolver-4kldw\" (UID: \"32952a5d-cf34-405d-b269-53a351f82d9a\") " pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.060976 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.060955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5qn7\" (UniqueName: \"kubernetes.io/projected/1259b23b-67fe-4a7a-8b50-8c219a156830-kube-api-access-w5qn7\") pod \"iptables-alerter-sstdc\" (UID: \"1259b23b-67fe-4a7a-8b50-8c219a156830\") " pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.061109 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.060955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jj5\" (UniqueName: \"kubernetes.io/projected/2fb6ab22-9035-4bd3-b52d-af735e10b2ec-kube-api-access-64jj5\") pod \"aws-ebs-csi-driver-node-nh6zj\" (UID: \"2fb6ab22-9035-4bd3-b52d-af735e10b2ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.062932 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.062908    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:11.063196 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.063171    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:11.063348 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.063321    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:11.063473 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.063416    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:11.563393313 +0000 UTC m=+2.926629614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:11.067070 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.067039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5k8\" (UniqueName: \"kubernetes.io/projected/ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c-kube-api-access-7l5k8\") pod \"tuned-g5xq8\" (UID: \"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c\") " pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.067070 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.067063    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4w6s\" (UniqueName: \"kubernetes.io/projected/d0fcda60-bf81-4305-83d7-080f46f96326-kube-api-access-d4w6s\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:11.067242 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.067062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6h6l\" (UniqueName: \"kubernetes.io/projected/26b9057b-6a13-4157-bfe5-17641024e234-kube-api-access-w6h6l\") pod \"ovnkube-node-4ttsr\" (UID: \"26b9057b-6a13-4157-bfe5-17641024e234\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.068359 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.068333    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz6rl\" (UniqueName: \"kubernetes.io/projected/dc844e47-3a37-488e-8b43-45d669c7a184-kube-api-access-zz6rl\") pod \"node-ca-kz7c6\" (UID: \"dc844e47-3a37-488e-8b43-45d669c7a184\") " pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.117726 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.117691    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:11.152661 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-cni-bin\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-netns\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152722    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-socket-dir-parent\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-k8s-cni-cncf-io\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-daemon-config\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-etc-kubernetes\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-k8s-cni-cncf-io\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-cni-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.152855 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152842    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-netns\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-cni-bin\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-socket-dir-parent\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-cni-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-multus-certs\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-etc-kubernetes\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152928    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmr48\" (UniqueName: \"kubernetes.io/projected/f6aa9272-7292-4f9f-96da-d31d327d5ba8-kube-api-access-nmr48\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.152939    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-run-multus-certs\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-conf-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-cni-multus\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153167    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-conf-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-cnibin\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-os-release\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-cni-multus\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-system-cni-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-os-release\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6aa9272-7292-4f9f-96da-d31d327d5ba8-cni-binary-copy\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153291    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-cnibin\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-kubelet\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-hostroot\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-system-cni-dir\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-host-var-lib-kubelet\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153420    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6aa9272-7292-4f9f-96da-d31d327d5ba8-hostroot\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6aa9272-7292-4f9f-96da-d31d327d5ba8-multus-daemon-config\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.153922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.153746    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6aa9272-7292-4f9f-96da-d31d327d5ba8-cni-binary-copy\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.162526 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.162461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmr48\" (UniqueName: \"kubernetes.io/projected/f6aa9272-7292-4f9f-96da-d31d327d5ba8-kube-api-access-nmr48\") pod \"multus-hvn6j\" (UID: \"f6aa9272-7292-4f9f-96da-d31d327d5ba8\") " pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.233824 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.233785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5xq8"
Jul 27 20:51:11.244158 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.244127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:11.251988 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.251952    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r2x2s"
Jul 27 20:51:11.261870 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.261843    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sstdc"
Jul 27 20:51:11.271052 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.271025    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:11.278776 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.278751    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kz7c6"
Jul 27 20:51:11.288014 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.287980    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj"
Jul 27 20:51:11.296805 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.296776    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4kldw"
Jul 27 20:51:11.303851 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.303825    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hvn6j"
Jul 27 20:51:11.557238 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.557139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:11.557238 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.557201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:11.557475 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.557341    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:11.557475 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.557368    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:11.557475 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.557427    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:12.557402995 +0000 UTC m=+3.920639280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:11.557475 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.557450    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:12.557438837 +0000 UTC m=+3.920675112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:11.658125 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.658087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:11.658346 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.658320    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:11.658395 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.658362    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:11.658395 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.658378    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:11.658512 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:11.658465    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:12.658442463 +0000 UTC m=+4.021678739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:11.976390 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.976309    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:46:11 +0000 UTC" deadline="2027-12-21 15:30:05.733123571 +0000 UTC"
Jul 27 20:51:11.976390 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:11.976344    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12282h38m53.756783168s"
Jul 27 20:51:12.016428 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:12.016392    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b12703_91cd_4468_95fc_bed4fb1859ec.slice/crio-147aa1f7f636bbab8fc3e1832aa8062376427f1cc17748ee1af459d1a18b0384 WatchSource:0}: Error finding container 147aa1f7f636bbab8fc3e1832aa8062376427f1cc17748ee1af459d1a18b0384: Status 404 returned error can't find the container with id 147aa1f7f636bbab8fc3e1832aa8062376427f1cc17748ee1af459d1a18b0384
Jul 27 20:51:12.019798 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:12.019765    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1259b23b_67fe_4a7a_8b50_8c219a156830.slice/crio-682af2ea70a2edbca373b07f83a129c319e25ceed15cde478d0483ebea18a8f5 WatchSource:0}: Error finding container 682af2ea70a2edbca373b07f83a129c319e25ceed15cde478d0483ebea18a8f5: Status 404 returned error can't find the container with id 682af2ea70a2edbca373b07f83a129c319e25ceed15cde478d0483ebea18a8f5
Jul 27 20:51:12.022331 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.022306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:12.022438 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.022345    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:12.022438 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.022416    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:12.022554 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.022477    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:12.023580 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:12.023535    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274bcbd6_ef93_4686_98a0_18286f84e849.slice/crio-6c0ebe2354435ba24c2716bd2f05bbe632d7dd1b1a4856b3f46151c9844c94b3 WatchSource:0}: Error finding container 6c0ebe2354435ba24c2716bd2f05bbe632d7dd1b1a4856b3f46151c9844c94b3: Status 404 returned error can't find the container with id 6c0ebe2354435ba24c2716bd2f05bbe632d7dd1b1a4856b3f46151c9844c94b3
Jul 27 20:51:12.024304 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:12.024279    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc844e47_3a37_488e_8b43_45d669c7a184.slice/crio-4ca290bcaf8f7192fe87cfca82fc9fd28ba29ee4bde3ca5f6feba11c425b7621 WatchSource:0}: Error finding container 4ca290bcaf8f7192fe87cfca82fc9fd28ba29ee4bde3ca5f6feba11c425b7621: Status 404 returned error can't find the container with id 4ca290bcaf8f7192fe87cfca82fc9fd28ba29ee4bde3ca5f6feba11c425b7621
Jul 27 20:51:12.026221 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:12.026195    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9c1c4a_b3aa_4d63_8e92_26b6f91a1e2c.slice/crio-b9423f58ed76a8b1c697972c507f60e2327b1192e87b3b121e8a0c72f74ec53f WatchSource:0}: Error finding container b9423f58ed76a8b1c697972c507f60e2327b1192e87b3b121e8a0c72f74ec53f: Status 404 returned error can't find the container with id b9423f58ed76a8b1c697972c507f60e2327b1192e87b3b121e8a0c72f74ec53f
Jul 27 20:51:12.027028 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:12.026991    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32952a5d_cf34_405d_b269_53a351f82d9a.slice/crio-82c02194e945cc0af95f1a35d2ecafdf0a979f50f8117459928ac0cbfc6fa056 WatchSource:0}: Error finding container 82c02194e945cc0af95f1a35d2ecafdf0a979f50f8117459928ac0cbfc6fa056: Status 404 returned error can't find the container with id 82c02194e945cc0af95f1a35d2ecafdf0a979f50f8117459928ac0cbfc6fa056
Jul 27 20:51:12.033284 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.033222    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sstdc" event={"ID":"1259b23b-67fe-4a7a-8b50-8c219a156830","Type":"ContainerStarted","Data":"682af2ea70a2edbca373b07f83a129c319e25ceed15cde478d0483ebea18a8f5"}
Jul 27 20:51:12.035076 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.035053    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerStarted","Data":"147aa1f7f636bbab8fc3e1832aa8062376427f1cc17748ee1af459d1a18b0384"}
Jul 27 20:51:12.038005 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.037980    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4kldw" event={"ID":"32952a5d-cf34-405d-b269-53a351f82d9a","Type":"ContainerStarted","Data":"82c02194e945cc0af95f1a35d2ecafdf0a979f50f8117459928ac0cbfc6fa056"}
Jul 27 20:51:12.039728 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.039700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"f6c544bf3b8bef3d32988764c72b71581820396dab6651d5d7cff1276715be62"}
Jul 27 20:51:12.042061 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.042035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5xq8" event={"ID":"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c","Type":"ContainerStarted","Data":"b9423f58ed76a8b1c697972c507f60e2327b1192e87b3b121e8a0c72f74ec53f"}
Jul 27 20:51:12.043221 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.043198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kz7c6" event={"ID":"dc844e47-3a37-488e-8b43-45d669c7a184","Type":"ContainerStarted","Data":"4ca290bcaf8f7192fe87cfca82fc9fd28ba29ee4bde3ca5f6feba11c425b7621"}
Jul 27 20:51:12.044432 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.044408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4cv2" event={"ID":"274bcbd6-ef93-4686-98a0-18286f84e849","Type":"ContainerStarted","Data":"6c0ebe2354435ba24c2716bd2f05bbe632d7dd1b1a4856b3f46151c9844c94b3"}
Jul 27 20:51:12.566327 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.566198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:12.566487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.566326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:12.566487 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.566376    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:12.566487 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.566473    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:14.566449721 +0000 UTC m=+5.929686010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:12.566487 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.566483    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:12.566759 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.566564    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:14.566546743 +0000 UTC m=+5.929783030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:12.668432 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.667652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:12.668432 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.667886    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:12.668432 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.667909    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:12.668432 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.667924    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:12.668432 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:12.667987    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:14.667967807 +0000 UTC m=+6.031204085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:12.976793 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.976627    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:46:11 +0000 UTC" deadline="2028-04-05 01:52:20.932979812 +0000 UTC"
Jul 27 20:51:12.976793 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:12.976699    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14813h1m7.956285755s"
Jul 27 20:51:13.024009 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.023384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:13.024009 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:13.023555    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:13.058500 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.057596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal" event={"ID":"ed929be85ebfd2f1b71d7e50ffae918d","Type":"ContainerStarted","Data":"0a9988badce012c072a6d7dbefc31b689eac352510efed9740c0117fd329aad4"}
Jul 27 20:51:13.066730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.066566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hvn6j" event={"ID":"f6aa9272-7292-4f9f-96da-d31d327d5ba8","Type":"ContainerStarted","Data":"d0a33c583290d775b9d68b13980edc62343e1845c61702278ade57e4313a5c1f"}
Jul 27 20:51:13.077103 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.076740    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-91.ec2.internal" podStartSLOduration=2.076724589 podStartE2EDuration="2.076724589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:13.075901936 +0000 UTC m=+4.439138227" watchObservedRunningTime="2026-07-27 20:51:13.076724589 +0000 UTC m=+4.439960886"
Jul 27 20:51:13.083389 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.083350    2567 generic.go:356] "Generic (PLEG): container finished" podID="1bf8cac1cb8fccbdc6fd8c2f146bc292" containerID="353f59b317ee520c7a9a5b6529420b0769fbe5141506d8f68e8bca583142d5c1" exitCode=0
Jul 27 20:51:13.083709 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.083684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal" event={"ID":"1bf8cac1cb8fccbdc6fd8c2f146bc292","Type":"ContainerDied","Data":"353f59b317ee520c7a9a5b6529420b0769fbe5141506d8f68e8bca583142d5c1"}
Jul 27 20:51:13.098635 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:13.098533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj" event={"ID":"2fb6ab22-9035-4bd3-b52d-af735e10b2ec","Type":"ContainerStarted","Data":"efcf6585585683ce2456713f0f58dfc06c0e390ff0f82a279e74da756a97521e"}
Jul 27 20:51:14.023755 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:14.023007    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:14.023755 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.023157    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:14.023755 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:14.023566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:14.023755 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.023686    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:14.126481 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:14.126377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal" event={"ID":"1bf8cac1cb8fccbdc6fd8c2f146bc292","Type":"ContainerStarted","Data":"da5d38306bba364d029c960496b542793303e16eaa958a1ecbe17365e476632e"}
Jul 27 20:51:14.586255 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:14.585417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:14.586255 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:14.585529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:14.586255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.585683    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:14.586255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.585750    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:18.585730816 +0000 UTC m=+9.948967089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:14.586255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.586166    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:14.586255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.586218    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:18.586202876 +0000 UTC m=+9.949439173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:14.687074 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:14.686398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:14.687074 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.686574    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:14.687074 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.686618    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:14.687074 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.686633    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:14.687074 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:14.686698    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:18.686679394 +0000 UTC m=+10.049915682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:15.023913 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:15.023830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:15.024374 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:15.023965    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:16.022670 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:16.022632    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:16.022878 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:16.022779    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:16.023192 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:16.023168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:16.023320 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:16.023298    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:17.025571 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:17.025529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:17.026075 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:17.025696    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:18.022642 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:18.022604    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:18.022862 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:18.022646    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:18.022862 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.022775    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:18.022982 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.022919    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:18.619759 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:18.619718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:18.620185 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:18.619786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:18.620185 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.619922    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:18.620185 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.619993    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:26.619972905 +0000 UTC m=+17.983209196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:18.620185 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.620055    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:18.620185 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.620083    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:26.620075239 +0000 UTC m=+17.983311512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:18.721012 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:18.720975    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:18.721224 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.721198    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:18.721297 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.721234    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:18.721297 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.721249    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:18.721377 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:18.721317    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:26.721295926 +0000 UTC m=+18.084532203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:19.025117 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:19.024536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:19.025117 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:19.024689    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:20.022686 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:20.022641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:20.023126 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:20.022649    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:20.023126 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:20.022813    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:20.023126 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:20.022940    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:21.023787 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:21.023274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:21.023787 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:21.023412    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:22.022665 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:22.022635    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:22.022819 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:22.022644    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:22.022819 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:22.022763    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:22.022944 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:22.022817    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:23.022512 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:23.022478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:23.022972 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:23.022621    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:24.022836 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:24.022748    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:24.023234 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:24.022862    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:24.023234 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:24.022931    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:24.023234 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:24.023018    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:25.022508 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:25.022478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:25.022703 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:25.022609    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:26.023002 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:26.022960    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:26.023002 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:26.022997    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:26.023471 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.023108    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:26.023471 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.023228    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:26.689815 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:26.689774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:26.689993 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:26.689861    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:26.689993 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.689946    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:26.689993 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.689967    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:26.690159 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.690019    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:42.689997249 +0000 UTC m=+34.053233521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:26.690159 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.690034    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:42.690027826 +0000 UTC m=+34.053264097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:26.791088 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:26.791055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:26.791255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.791212    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:26.791255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.791231    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:26.791255 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.791241    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:26.791372 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:26.791295    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:42.791282279 +0000 UTC m=+34.154518549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:27.022732 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:27.022647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:27.022879 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:27.022766    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:28.022403 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:28.022304    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:28.022403 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:28.022348    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:28.022936 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:28.022459    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:28.022936 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:28.022607    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:29.023481 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:29.023005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:29.023481 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:29.023115    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:30.022792 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:30.022760    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:30.022974 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:30.022894    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:30.022974 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:30.022946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:30.023082 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:30.023058    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:31.022745 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:31.022705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:31.023419 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:31.022846    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:32.023395 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.023083    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:32.023971 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.023108    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:32.023971 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:32.023494    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:32.023971 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:32.023592    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:32.166063 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.166031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5xq8" event={"ID":"ff9c1c4a-b3aa-4d63-8e92-26b6f91a1e2c","Type":"ContainerStarted","Data":"f4a7bb3f5ad3616d80ce5397464211fba1b3302dce8f92586594733b91236538"}
Jul 27 20:51:32.167730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.167698    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kz7c6" event={"ID":"dc844e47-3a37-488e-8b43-45d669c7a184","Type":"ContainerStarted","Data":"238f908a840c2ae8d96accc8b584f2f4cfad29f67b87a659a0b33424fec6f012"}
Jul 27 20:51:32.169254 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.169229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4cv2" event={"ID":"274bcbd6-ef93-4686-98a0-18286f84e849","Type":"ContainerStarted","Data":"bbfedc299c20d847c83618ed5cc8e3313faaff72cdcc1a4e2185416ec9cf372b"}
Jul 27 20:51:32.170742 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.170719    2567 generic.go:356] "Generic (PLEG): container finished" podID="73b12703-91cd-4468-95fc-bed4fb1859ec" containerID="d27f202b77879789edf1bd287c383947b8b95789aa606433cd885105436c443d" exitCode=0
Jul 27 20:51:32.170839 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.170799    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerDied","Data":"d27f202b77879789edf1bd287c383947b8b95789aa606433cd885105436c443d"}
Jul 27 20:51:32.172287 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.172249    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hvn6j" event={"ID":"f6aa9272-7292-4f9f-96da-d31d327d5ba8","Type":"ContainerStarted","Data":"07790003ec54731a65a4e7e7b3016cb184b85cdd70fbfc2dfd43d34d0c835a3b"}
Jul 27 20:51:32.173753 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.173726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4kldw" event={"ID":"32952a5d-cf34-405d-b269-53a351f82d9a","Type":"ContainerStarted","Data":"055eddf82fa4893791d0c2c56855960e2cc6db6b5354e5d569c6a8500b452041"}
Jul 27 20:51:32.175230 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.175210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj" event={"ID":"2fb6ab22-9035-4bd3-b52d-af735e10b2ec","Type":"ContainerStarted","Data":"6c20f8eeaaf3e35ee057253df8e296a8594bd884b0b97f9c3ea79bf681faf520"}
Jul 27 20:51:32.178202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.178180    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"1a9cc046c21d555a3d30a358a61b33257e47f879dd78165e484286433817c687"}
Jul 27 20:51:32.178302 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.178252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"6a8218ca80419d5a05bebd50f8a80b83a00d4900119ab4f20cfa54f973ac061e"}
Jul 27 20:51:32.178363 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.178305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"2b52c8a295d0973481264c9ca3de408bd5b69de51b266255458b6b6e43c94036"}
Jul 27 20:51:32.178363 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.178352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"8fe8490d565afb2677ee6e9ce2019653d473ff999500c36981251c85d6604246"}
Jul 27 20:51:32.183132 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.183089    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-91.ec2.internal" podStartSLOduration=21.183051976 podStartE2EDuration="21.183051976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:14.143738864 +0000 UTC m=+5.506975162" watchObservedRunningTime="2026-07-27 20:51:32.183051976 +0000 UTC m=+23.546288269"
Jul 27 20:51:32.183776 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.183748    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g5xq8" podStartSLOduration=3.568360273 podStartE2EDuration="23.183736925s" totalImagesPullingTime="19.615376652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:32.183025878 +0000 UTC m=+23.546262186" watchObservedRunningTime="2026-07-27 20:51:32.183736925 +0000 UTC m=+23.546973218"
Jul 27 20:51:32.230766 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.230724    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4kldw" podStartSLOduration=2.589638387 podStartE2EDuration="22.230709052s" totalImagesPullingTime="19.641070665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:32.198418751 +0000 UTC m=+23.561655045" watchObservedRunningTime="2026-07-27 20:51:32.230709052 +0000 UTC m=+23.593945344"
Jul 27 20:51:32.230879 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.230821    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hvn6j" podStartSLOduration=2.589458032 podStartE2EDuration="22.230815715s" totalImagesPullingTime="19.641357683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:32.230415892 +0000 UTC m=+23.593652185" watchObservedRunningTime="2026-07-27 20:51:32.230815715 +0000 UTC m=+23.594052008"
Jul 27 20:51:32.273391 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.273339    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j4cv2" podStartSLOduration=3.657796817 podStartE2EDuration="23.273323266s" totalImagesPullingTime="19.615526449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:32.273157978 +0000 UTC m=+23.636394271" watchObservedRunningTime="2026-07-27 20:51:32.273323266 +0000 UTC m=+23.636559559"
Jul 27 20:51:32.286931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:32.286885    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kz7c6" podStartSLOduration=2.6720035490000003 podStartE2EDuration="22.286869763s" totalImagesPullingTime="19.614866214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:32.286702096 +0000 UTC m=+23.649938389" watchObservedRunningTime="2026-07-27 20:51:32.286869763 +0000 UTC m=+23.650106056"
Jul 27 20:51:33.023337 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:33.023257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:33.023535 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:33.023443    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:33.184257 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:33.184223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"618978e5bdb2a1f4a29c0c69132fb4a304523130fbee9966a22c2f083ffd5ad1"}
Jul 27 20:51:33.184379 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:33.184319    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"55916cf38fa9439903e3ef38232863491df9eea5fd53382a2b058800c3ac71f3"}
Jul 27 20:51:33.185630 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:33.185599    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sstdc" event={"ID":"1259b23b-67fe-4a7a-8b50-8c219a156830","Type":"ContainerStarted","Data":"b2c45aa40d270c161e3382afd2dcefa483f987c9de26b33dbb5810544c1a4cf7"}
Jul 27 20:51:33.218412 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:33.218373    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sstdc" podStartSLOduration=3.595645682 podStartE2EDuration="23.218359582s" totalImagesPullingTime="19.6227139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:33.218040197 +0000 UTC m=+24.581276491" watchObservedRunningTime="2026-07-27 20:51:33.218359582 +0000 UTC m=+24.581595876"
Jul 27 20:51:33.337129 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:33.337099    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:51:34.013722 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:34.013616    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:51:33.337120786Z","UUID":"39aea249-cc43-4578-9ef0-b72881824491","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:51:34.015244 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:34.015222    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:51:34.015389 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:34.015268    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:51:34.022322 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:34.022287    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:34.022434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:34.022306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:34.022434 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:34.022414    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:34.022517 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:34.022464    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:34.190987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:34.190943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj" event={"ID":"2fb6ab22-9035-4bd3-b52d-af735e10b2ec","Type":"ContainerStarted","Data":"e131b3b63521056e12b91cbcd7640f415816dd60761ff6e8f1ad7940657601a1"}
Jul 27 20:51:35.023111 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:35.023069    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:35.023342 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:35.023196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:35.196782 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:35.196749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"5c399963b5fd2e24ce9eb0d1cfe02f79c5803c31a094891bd22fcc22d20ea5e3"}
Jul 27 20:51:35.199014 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:35.198988    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj" event={"ID":"2fb6ab22-9035-4bd3-b52d-af735e10b2ec","Type":"ContainerStarted","Data":"6af803a0f63da480436db3d06ef0870a1b04efcb1ca89dcc08a9862fecbdaec5"}
Jul 27 20:51:35.217611 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:35.217543    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nh6zj" podStartSLOduration=3.229261465 podStartE2EDuration="25.217528459s" totalImagesPullingTime="21.988266994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:35.216970832 +0000 UTC m=+26.580207124" watchObservedRunningTime="2026-07-27 20:51:35.217528459 +0000 UTC m=+26.580764752"
Jul 27 20:51:36.022512 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:36.022479    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:36.025547 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:36.023007    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:36.025547 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:36.023438    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:36.025547 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:36.023586    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:36.509867 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:36.509794    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:36.510340 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:36.510325    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:37.023003 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.022778    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:37.023134 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:37.023037    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:37.206736 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.206699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" event={"ID":"26b9057b-6a13-4157-bfe5-17641024e234","Type":"ContainerStarted","Data":"6af2e6646ccd87772d1993d091f4d777f47da3e1e3a4011b62e16b915cee4fbb"}
Jul 27 20:51:37.207023 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.206999    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:37.207178 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.207074    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:37.208587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.208549    2567 generic.go:356] "Generic (PLEG): container finished" podID="73b12703-91cd-4468-95fc-bed4fb1859ec" containerID="c9c3f335bffac7da942b86b5a0e0beee36d25bb8ebf53b0929e93198cdd70738" exitCode=0
Jul 27 20:51:37.208692 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.208634    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerDied","Data":"c9c3f335bffac7da942b86b5a0e0beee36d25bb8ebf53b0929e93198cdd70738"}
Jul 27 20:51:37.208804 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.208787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:37.209289 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.209280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j4cv2"
Jul 27 20:51:37.222739 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.222717    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:37.236662 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:37.236622    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr" podStartSLOduration=7.529689043 podStartE2EDuration="27.236606548s" totalImagesPullingTime="19.706917505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:37.236030362 +0000 UTC m=+28.599266657" watchObservedRunningTime="2026-07-27 20:51:37.236606548 +0000 UTC m=+28.599842840"
Jul 27 20:51:38.022736 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.022704    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:38.023615 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:38.022820    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:38.023615 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.022863    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:38.023615 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:38.022932    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:38.211608 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.211584    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:38.226846 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.226821    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:51:38.678957 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.678699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvhwj"]
Jul 27 20:51:38.679124 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.678970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:38.679124 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:38.679070    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:38.681994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.681722    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2j9ck"]
Jul 27 20:51:38.681994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.681844    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:38.681994 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:38.681950    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:38.682283 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.682265    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlvss"]
Jul 27 20:51:38.682341 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:38.682331    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:38.682423 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:38.682405    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:39.215170 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:39.215142    2567 generic.go:356] "Generic (PLEG): container finished" podID="73b12703-91cd-4468-95fc-bed4fb1859ec" containerID="f6152fe003b448885a2c0f5ac7667284db73d28a3316173474ea66fd93f6660c" exitCode=0
Jul 27 20:51:39.215576 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:39.215227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerDied","Data":"f6152fe003b448885a2c0f5ac7667284db73d28a3316173474ea66fd93f6660c"}
Jul 27 20:51:40.022999 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:40.022966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:40.022999 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:40.022977    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:40.023199 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:40.022977    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:40.023199 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:40.023085    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:40.023199 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:40.023142    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:40.023294 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:40.023212    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:41.223195 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:41.223162    2567 generic.go:356] "Generic (PLEG): container finished" podID="73b12703-91cd-4468-95fc-bed4fb1859ec" containerID="7df70eacdc8251243a70a62a480925a5f4661335d2b01c89eac9b3f0981e0a13" exitCode=0
Jul 27 20:51:41.223629 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:41.223232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerDied","Data":"7df70eacdc8251243a70a62a480925a5f4661335d2b01c89eac9b3f0981e0a13"}
Jul 27 20:51:42.022281 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:42.022248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:42.022467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:42.022249    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:42.022467 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.022387    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:42.022467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:42.022249    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:42.022661 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.022467    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:42.022661 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.022613    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:42.711045 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:42.711010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:42.711482 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:42.711057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:42.711482 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.711165    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:42.711482 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.711165    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:42.711482 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.711230    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret podName:e77adafa-2a18-4718-9eb7-7fa46d6c1192 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:14.711215684 +0000 UTC m=+66.074451956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret") pod "global-pull-secret-syncer-dlvss" (UID: "e77adafa-2a18-4718-9eb7-7fa46d6c1192") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:42.711482 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.711245    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:14.711239682 +0000 UTC m=+66.074475953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:42.812376 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:42.812341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:42.812553 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.812522    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:42.812553 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.812548    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:42.812766 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.812579    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ptzmw for pod openshift-network-diagnostics/network-check-target-2j9ck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:42.812766 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:42.812648    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw podName:d7188b33-1448-4c30-8aa0-46cdb9c3d5a7 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:14.812627267 +0000 UTC m=+66.175863538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptzmw" (UniqueName: "kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw") pod "network-check-target-2j9ck" (UID: "d7188b33-1448-4c30-8aa0-46cdb9c3d5a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:44.022786 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.022754    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:44.023235 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.022755    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:44.023235 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.022881    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9ck" podUID="d7188b33-1448-4c30-8aa0-46cdb9c3d5a7"
Jul 27 20:51:44.023235 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.022755    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:44.023235 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.022982    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvss" podUID="e77adafa-2a18-4718-9eb7-7fa46d6c1192"
Jul 27 20:51:44.023235 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.023045    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhwj" podUID="d0fcda60-bf81-4305-83d7-080f46f96326"
Jul 27 20:51:44.447944 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.447875    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-91.ec2.internal" event="NodeReady"
Jul 27 20:51:44.448085 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.448006    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:51:44.490115 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.490088    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"]
Jul 27 20:51:44.494947 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.494926    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.496968 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.496948    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:51:44.496968 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.496958    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:51:44.497326 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.497307    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:51:44.497427 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.497361    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jv4bm\""
Jul 27 20:51:44.502521 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.502498    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:51:44.507251 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.507226    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"]
Jul 27 20:51:44.511357 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.511336    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2wt9c"]
Jul 27 20:51:44.514794 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.514775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.516688 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.516668    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pmx7s"]
Jul 27 20:51:44.519802 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.519782    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.520494 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.520474    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:51:44.520880 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.520855    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9tww\""
Jul 27 20:51:44.520974 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.520877    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:51:44.521653 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.521634    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:51:44.522298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.521899    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:51:44.522835 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.522820    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:51:44.523084 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.523069    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lslmx\""
Jul 27 20:51:44.529913 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.529828    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wt9c"]
Jul 27 20:51:44.535414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.535390    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmx7s"]
Jul 27 20:51:44.626637 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1df2aed-dc55-4a60-8bd4-26984cc5c324-cert\") pod \"ingress-canary-pmx7s\" (UID: \"c1df2aed-dc55-4a60-8bd4-26984cc5c324\") " pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.626819 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx258\" (UniqueName: \"kubernetes.io/projected/c1df2aed-dc55-4a60-8bd4-26984cc5c324-kube-api-access-zx258\") pod \"ingress-canary-pmx7s\" (UID: \"c1df2aed-dc55-4a60-8bd4-26984cc5c324\") " pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.626819 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626677    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-installation-pull-secrets\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.626819 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626785    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.626955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626839    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4dc17931-747e-4a9c-9e2c-7bbe085ed090-config-volume\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.626955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-image-registry-private-configuration\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.626955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.626955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phmp9\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-kube-api-access-phmp9\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.627172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ng2\" (UniqueName: \"kubernetes.io/projected/4dc17931-747e-4a9c-9e2c-7bbe085ed090-kube-api-access-m8ng2\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.627172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.626978    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-trusted-ca\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.627172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.627001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc17931-747e-4a9c-9e2c-7bbe085ed090-tmp-dir\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.627172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.627038    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-certificates\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.627172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.627076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-bound-sa-token\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.627172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.627111    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96a01f16-fc40-4d36-8d60-4b38cb1fe296-ca-trust-extracted\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.680511 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.680460    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:44.727605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96a01f16-fc40-4d36-8d60-4b38cb1fe296-ca-trust-extracted\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.727605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1df2aed-dc55-4a60-8bd4-26984cc5c324-cert\") pod \"ingress-canary-pmx7s\" (UID: \"c1df2aed-dc55-4a60-8bd4-26984cc5c324\") " pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.727605 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx258\" (UniqueName: \"kubernetes.io/projected/c1df2aed-dc55-4a60-8bd4-26984cc5c324-kube-api-access-zx258\") pod \"ingress-canary-pmx7s\" (UID: \"c1df2aed-dc55-4a60-8bd4-26984cc5c324\") " pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.727870 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-installation-pull-secrets\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.727870 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.727870 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4dc17931-747e-4a9c-9e2c-7bbe085ed090-config-volume\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.727870 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.727756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-image-registry-private-configuration\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.727870 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.727846    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:44.728098 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.727932    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:45.227909559 +0000 UTC m=+36.591145845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:44.728098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96a01f16-fc40-4d36-8d60-4b38cb1fe296-ca-trust-extracted\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.728098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.728098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phmp9\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-kube-api-access-phmp9\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.728098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ng2\" (UniqueName: \"kubernetes.io/projected/4dc17931-747e-4a9c-9e2c-7bbe085ed090-kube-api-access-m8ng2\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.728098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-trusted-ca\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.728380 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc17931-747e-4a9c-9e2c-7bbe085ed090-tmp-dir\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.728380 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-certificates\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.728380 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-bound-sa-token\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.728527 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728300    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4dc17931-747e-4a9c-9e2c-7bbe085ed090-config-volume\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.728603 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.728384    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:44.728603 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.728574    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:51:44.728697 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:44.728634    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:45.228617048 +0000 UTC m=+36.591853336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:51:44.728697 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.728687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc17931-747e-4a9c-9e2c-7bbe085ed090-tmp-dir\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.729067 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.729045    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-certificates\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.729279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.729258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-trusted-ca\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.732781 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.732757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1df2aed-dc55-4a60-8bd4-26984cc5c324-cert\") pod \"ingress-canary-pmx7s\" (UID: \"c1df2aed-dc55-4a60-8bd4-26984cc5c324\") " pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.732872 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.732765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-installation-pull-secrets\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.735082 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.735060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-image-registry-private-configuration\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.738274 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.738248    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phmp9\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-kube-api-access-phmp9\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.738670 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.738642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ng2\" (UniqueName: \"kubernetes.io/projected/4dc17931-747e-4a9c-9e2c-7bbe085ed090-kube-api-access-m8ng2\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:44.738838 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.738819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-bound-sa-token\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:44.740087 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.740062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx258\" (UniqueName: \"kubernetes.io/projected/c1df2aed-dc55-4a60-8bd4-26984cc5c324-kube-api-access-zx258\") pod \"ingress-canary-pmx7s\" (UID: \"c1df2aed-dc55-4a60-8bd4-26984cc5c324\") " pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:44.779521 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.779487    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:44.832574 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:44.832530    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmx7s"
Jul 27 20:51:45.231465 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:45.231435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:45.232029 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:45.231499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:45.232029 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:45.231570    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:45.232029 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:45.231635    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:46.231619146 +0000 UTC m=+37.594855417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:45.232029 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:45.231641    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:45.232029 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:45.231653    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:51:45.232029 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:45.231703    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:46.231689163 +0000 UTC m=+37.594925435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:51:45.354802 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:45.354771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmx7s"]
Jul 27 20:51:45.358686 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:51:45.358660    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1df2aed_dc55_4a60_8bd4_26984cc5c324.slice/crio-d533f3db897132c57d1d2bbe9f1c2ea72965b6f5eeb4b1678b68a465a52efc6f WatchSource:0}: Error finding container d533f3db897132c57d1d2bbe9f1c2ea72965b6f5eeb4b1678b68a465a52efc6f: Status 404 returned error can't find the container with id d533f3db897132c57d1d2bbe9f1c2ea72965b6f5eeb4b1678b68a465a52efc6f
Jul 27 20:51:46.022916 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.022880    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:51:46.023081 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.022933    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:51:46.023081 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.022998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:51:46.025211 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.025050    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:51:46.025211 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.025061    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvgk8\""
Jul 27 20:51:46.025871 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.025696    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:51:46.025871 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.025743    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:51:46.026001 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.025970    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:51:46.026112 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.026089    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qtl47\""
Jul 27 20:51:46.237941 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.237909    2567 generic.go:356] "Generic (PLEG): container finished" podID="73b12703-91cd-4468-95fc-bed4fb1859ec" containerID="cf33f22ea1a7287d573d002275a1483d2813e4c4861d312733f1af729c7a7e38" exitCode=0
Jul 27 20:51:46.238736 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.237944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerDied","Data":"cf33f22ea1a7287d573d002275a1483d2813e4c4861d312733f1af729c7a7e38"}
Jul 27 20:51:46.239396 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.239370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmx7s" event={"ID":"c1df2aed-dc55-4a60-8bd4-26984cc5c324","Type":"ContainerStarted","Data":"d533f3db897132c57d1d2bbe9f1c2ea72965b6f5eeb4b1678b68a465a52efc6f"}
Jul 27 20:51:46.239706 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.239686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:46.239836 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:46.239732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:46.239904 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:46.239844    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:46.239904 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:46.239897    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:46.240002 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:46.239911    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:48.239892211 +0000 UTC m=+39.603128488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:46.240002 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:46.239912    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:51:46.240002 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:46.239983    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:48.239964815 +0000 UTC m=+39.603201085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:51:47.193494 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:47.193333    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:47.245236 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:47.245202    2567 generic.go:356] "Generic (PLEG): container finished" podID="73b12703-91cd-4468-95fc-bed4fb1859ec" containerID="e2f3853d97776ad072ceff25e0d4eddc117394c9e117a15c94865ce4ae32e824" exitCode=0
Jul 27 20:51:47.245895 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:47.245266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerDied","Data":"e2f3853d97776ad072ceff25e0d4eddc117394c9e117a15c94865ce4ae32e824"}
Jul 27 20:51:47.274296 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:47.274236    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.189098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.189042    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.250910 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.250879    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" event={"ID":"73b12703-91cd-4468-95fc-bed4fb1859ec","Type":"ContainerStarted","Data":"bf8a088679e70e932166bf61a1a20165db6040512dc09347fe97470c1a5945c0"}
Jul 27 20:51:48.253826 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.253792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:48.253937 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.253845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:48.254009 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:48.253938    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:48.254009 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:48.253949    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:48.254009 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:48.253958    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:51:48.254009 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:48.253999    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:52.253987167 +0000 UTC m=+43.617223439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:51:48.254009 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:48.254010    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:52.254004984 +0000 UTC m=+43.617241255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:48.278367 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.278308    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r2x2s" podStartSLOduration=9.005185673 podStartE2EDuration="39.27829169s" totalImagesPullingTime="30.273106017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:48.278133635 +0000 UTC m=+39.641369929" watchObservedRunningTime="2026-07-27 20:51:48.27829169 +0000 UTC m=+39.641527985"
Jul 27 20:51:48.286202 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.286164    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.402936 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.402904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.505209 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.505178    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.603599 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.603535    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.664184 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.664142    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.830961 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:48.830930    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:49.254571 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:49.254535    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmx7s" event={"ID":"c1df2aed-dc55-4a60-8bd4-26984cc5c324","Type":"ContainerStarted","Data":"f4ccd1775bca1362a6b2bf3b3ff6d973bad2d976ae23525acdc4ed38b7ff077c"}
Jul 27 20:51:49.270210 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:49.270147    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pmx7s" podStartSLOduration=2.211752669 podStartE2EDuration="5.270129316s" totalImagesPullingTime="3.058376647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:49.269781313 +0000 UTC m=+40.633017597" watchObservedRunningTime="2026-07-27 20:51:49.270129316 +0000 UTC m=+40.633365610"
Jul 27 20:51:51.130634 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:51.130598    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:52.281148 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:52.281105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:51:52.281513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:52.281200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:51:52.281513 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:52.281258    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:52.281513 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:52.281277    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:51:52.281513 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:52.281292    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:52.281513 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:52.281342    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:00.281323895 +0000 UTC m=+51.644560165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:51:52.281513 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:51:52.281359    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:00.28135103 +0000 UTC m=+51.644587302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:55.759710 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:55.759658    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:57.226868 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:57.226832    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:57.289275 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:51:57.289239    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log" limit=1024
Jul 27 20:52:00.337905 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:00.337862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:52:00.338398 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:00.337923    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:52:00.338398 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:00.338032    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:52:00.338398 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:00.338045    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:52:00.338398 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:00.338056    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:52:00.338398 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:00.338096    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:16.338080537 +0000 UTC m=+67.701316807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:52:00.338398 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:00.338110    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:16.338104714 +0000 UTC m=+67.701340985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:52:10.237315 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:10.237286    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ttsr"
Jul 27 20:52:14.281856 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.281820    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mvhgs"]
Jul 27 20:52:14.284394 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.284374    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"]
Jul 27 20:52:14.284528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.284511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.285878 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.285856    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.287752 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.287734    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 20:52:14.288693 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.288677    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 20:52:14.288972 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.288958    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:52:14.289857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.289831    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:52:14.289983 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.289958    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 20:52:14.290062 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.289988    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 20:52:14.290170 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.290146    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:52:14.290433 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.290400    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gvl7z\""
Jul 27 20:52:14.290433 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.290404    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xlb7z\""
Jul 27 20:52:14.292508 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.292488    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:52:14.300389 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.300369    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 20:52:14.303517 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.303495    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mvhgs"]
Jul 27 20:52:14.310253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.310231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"]
Jul 27 20:52:14.339025 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.338973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-snapshots\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.339150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-serving-cert\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.339150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9288184e-b907-4c15-9a3c-c9225641f949-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.339150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.339310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4vdr\" (UniqueName: \"kubernetes.io/projected/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-kube-api-access-f4vdr\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.339310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv77t\" (UniqueName: \"kubernetes.io/projected/9288184e-b907-4c15-9a3c-c9225641f949-kube-api-access-hv77t\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.339310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339231    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-tmp\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.339310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.339310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.339291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-service-ca-bundle\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.389049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.389011    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"]
Jul 27 20:52:14.390991 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.390970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:14.393307 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.393285    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 20:52:14.393871 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.393843    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-44x2x\""
Jul 27 20:52:14.394010 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.393991    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 20:52:14.403364 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.403344    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"]
Jul 27 20:52:14.440246 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-snapshots\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.440440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-serving-cert\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.440440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9288184e-b907-4c15-9a3c-c9225641f949-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.440440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.440440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4vdr\" (UniqueName: \"kubernetes.io/projected/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-kube-api-access-f4vdr\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.440440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv77t\" (UniqueName: \"kubernetes.io/projected/9288184e-b907-4c15-9a3c-c9225641f949-kube-api-access-hv77t\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.440440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-tmp\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.440796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:14.440796 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.440460    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:14.440796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440476    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.440796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-service-ca-bundle\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.440796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ddacfee-9e8f-4c36-8c01-e4f334abe684-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:14.440796 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.440542    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls podName:9288184e-b907-4c15-9a3c-c9225641f949 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:14.940520688 +0000 UTC m=+66.303756967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m2zs4" (UID: "9288184e-b907-4c15-9a3c-c9225641f949") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:14.441029 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-tmp\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.441029 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.440980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-snapshots\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.441149 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.441130    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-service-ca-bundle\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.441408 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.441389    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.441638 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.441617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9288184e-b907-4c15-9a3c-c9225641f949-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.444132 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.444118    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-serving-cert\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.454933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.454905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4vdr\" (UniqueName: \"kubernetes.io/projected/40ad3ed6-5a32-4b1b-b42d-134ba41022e8-kube-api-access-f4vdr\") pod \"insights-operator-5885fdb759-mvhgs\" (UID: \"40ad3ed6-5a32-4b1b-b42d-134ba41022e8\") " pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.455050 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.454912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv77t\" (UniqueName: \"kubernetes.io/projected/9288184e-b907-4c15-9a3c-c9225641f949-kube-api-access-hv77t\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.541753 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.541662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:14.541753 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.541709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ddacfee-9e8f-4c36-8c01-e4f334abe684-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:14.541930 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.541783    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:52:14.541930 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.541860    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert podName:2ddacfee-9e8f-4c36-8c01-e4f334abe684 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:15.041844135 +0000 UTC m=+66.405080405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gwx9c" (UID: "2ddacfee-9e8f-4c36-8c01-e4f334abe684") : secret "networking-console-plugin-cert" not found
Jul 27 20:52:14.542380 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.542363    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ddacfee-9e8f-4c36-8c01-e4f334abe684-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:14.594894 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.594851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-mvhgs"
Jul 27 20:52:14.720376 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.720340    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-mvhgs"]
Jul 27 20:52:14.724845 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:14.724816    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ad3ed6_5a32_4b1b_b42d_134ba41022e8.slice/crio-d3a2b51735fa27a532852666a248dea5fd404d15335de3e8a5b8bac8a7dbb7a3 WatchSource:0}: Error finding container d3a2b51735fa27a532852666a248dea5fd404d15335de3e8a5b8bac8a7dbb7a3: Status 404 returned error can't find the container with id d3a2b51735fa27a532852666a248dea5fd404d15335de3e8a5b8bac8a7dbb7a3
Jul 27 20:52:14.744100 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.744078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:52:14.744213 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.744170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:52:14.745968 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.745953    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:52:14.746033 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.745956    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:52:14.754551 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.754531    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:52:14.754624 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.754607    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs podName:d0fcda60-bf81-4305-83d7-080f46f96326 nodeName:}" failed. No retries permitted until 2026-07-27 20:53:18.754590645 +0000 UTC m=+130.117826916 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs") pod "network-metrics-daemon-xvhwj" (UID: "d0fcda60-bf81-4305-83d7-080f46f96326") : secret "metrics-daemon-secret" not found
Jul 27 20:52:14.756620 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.756604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e77adafa-2a18-4718-9eb7-7fa46d6c1192-original-pull-secret\") pod \"global-pull-secret-syncer-dlvss\" (UID: \"e77adafa-2a18-4718-9eb7-7fa46d6c1192\") " pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:52:14.834103 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.834033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvss"
Jul 27 20:52:14.844679 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.844644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:52:14.846701 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.846681    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:52:14.857211 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.857180    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:52:14.868654 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.868630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzmw\" (UniqueName: \"kubernetes.io/projected/d7188b33-1448-4c30-8aa0-46cdb9c3d5a7-kube-api-access-ptzmw\") pod \"network-check-target-2j9ck\" (UID: \"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7\") " pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:52:14.945731 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.945675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:14.945885 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.945855    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:14.945935 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:14.945926    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls podName:9288184e-b907-4c15-9a3c-c9225641f949 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:15.945910374 +0000 UTC m=+67.309146645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m2zs4" (UID: "9288184e-b907-4c15-9a3c-c9225641f949") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:14.960809 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:14.960782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlvss"]
Jul 27 20:52:14.964325 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:14.964300    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77adafa_2a18_4718_9eb7_7fa46d6c1192.slice/crio-72c8adcc575aa9cc2af8c718364e40fca34fd12efc35276da9b599daf66ecaa7 WatchSource:0}: Error finding container 72c8adcc575aa9cc2af8c718364e40fca34fd12efc35276da9b599daf66ecaa7: Status 404 returned error can't find the container with id 72c8adcc575aa9cc2af8c718364e40fca34fd12efc35276da9b599daf66ecaa7
Jul 27 20:52:15.047171 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.047134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:15.047327 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:15.047284    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:52:15.047365 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:15.047349    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert podName:2ddacfee-9e8f-4c36-8c01-e4f334abe684 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:16.047331263 +0000 UTC m=+67.410567535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gwx9c" (UID: "2ddacfee-9e8f-4c36-8c01-e4f334abe684") : secret "networking-console-plugin-cert" not found
Jul 27 20:52:15.141959 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.141833    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qtl47\""
Jul 27 20:52:15.150843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.150815    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:52:15.313287 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.313255    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2j9ck"]
Jul 27 20:52:15.315168 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.315143    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlvss" event={"ID":"e77adafa-2a18-4718-9eb7-7fa46d6c1192","Type":"ContainerStarted","Data":"72c8adcc575aa9cc2af8c718364e40fca34fd12efc35276da9b599daf66ecaa7"}
Jul 27 20:52:15.316483 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.316448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mvhgs" event={"ID":"40ad3ed6-5a32-4b1b-b42d-134ba41022e8","Type":"ContainerStarted","Data":"d3a2b51735fa27a532852666a248dea5fd404d15335de3e8a5b8bac8a7dbb7a3"}
Jul 27 20:52:15.317987 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:15.317962    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7188b33_1448_4c30_8aa0_46cdb9c3d5a7.slice/crio-a78950dbdace8aea1fae07acd11eca1962a4dd3fc9285839ea9c9a0582704f6d WatchSource:0}: Error finding container a78950dbdace8aea1fae07acd11eca1962a4dd3fc9285839ea9c9a0582704f6d: Status 404 returned error can't find the container with id a78950dbdace8aea1fae07acd11eca1962a4dd3fc9285839ea9c9a0582704f6d
Jul 27 20:52:15.953468 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:15.953434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:15.953696 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:15.953621    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:15.953696 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:15.953687    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls podName:9288184e-b907-4c15-9a3c-c9225641f949 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:17.953669533 +0000 UTC m=+69.316905805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m2zs4" (UID: "9288184e-b907-4c15-9a3c-c9225641f949") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:16.054001 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:16.053951    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:16.054179 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.054146    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:52:16.054290 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.054231    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert podName:2ddacfee-9e8f-4c36-8c01-e4f334abe684 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:18.054212085 +0000 UTC m=+69.417448357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gwx9c" (UID: "2ddacfee-9e8f-4c36-8c01-e4f334abe684") : secret "networking-console-plugin-cert" not found
Jul 27 20:52:16.321022 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:16.320983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2j9ck" event={"ID":"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7","Type":"ContainerStarted","Data":"a78950dbdace8aea1fae07acd11eca1962a4dd3fc9285839ea9c9a0582704f6d"}
Jul 27 20:52:16.356473 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:16.356441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:52:16.356684 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:16.356580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:52:16.356817 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.356696    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:52:16.356817 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.356757    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls podName:4dc17931-747e-4a9c-9e2c-7bbe085ed090 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:48.356736507 +0000 UTC m=+99.719972778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls") pod "dns-default-2wt9c" (UID: "4dc17931-747e-4a9c-9e2c-7bbe085ed090") : secret "dns-default-metrics-tls" not found
Jul 27 20:52:16.357169 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.357142    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:52:16.357169 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.357166    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d7d7d9f5-tqmr5: secret "image-registry-tls" not found
Jul 27 20:52:16.357306 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:16.357212    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls podName:96a01f16-fc40-4d36-8d60-4b38cb1fe296 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:48.357197024 +0000 UTC m=+99.720433306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls") pod "image-registry-85d7d7d9f5-tqmr5" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296") : secret "image-registry-tls" not found
Jul 27 20:52:17.328936 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:17.328903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mvhgs" event={"ID":"40ad3ed6-5a32-4b1b-b42d-134ba41022e8","Type":"ContainerStarted","Data":"0b5909c07e7a4427846f1a8eb83b7cc623a512fbada1568cb81ea00af1e308ad"}
Jul 27 20:52:17.359567 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:17.359510    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-mvhgs" podStartSLOduration=0.932351868 podStartE2EDuration="3.359495612s" totalImagesPullingTime="2.427143744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:17.358745684 +0000 UTC m=+68.721981978" watchObservedRunningTime="2026-07-27 20:52:17.359495612 +0000 UTC m=+68.722731904"
Jul 27 20:52:17.969446 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:17.969399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:17.969686 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:17.969633    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:17.969768 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:17.969701    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls podName:9288184e-b907-4c15-9a3c-c9225641f949 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:21.969681116 +0000 UTC m=+73.332917393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m2zs4" (UID: "9288184e-b907-4c15-9a3c-c9225641f949") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:18.070824 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:18.070747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:18.071014 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:18.070884    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:52:18.071014 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:18.070971    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert podName:2ddacfee-9e8f-4c36-8c01-e4f334abe684 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:22.070948868 +0000 UTC m=+73.434185143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gwx9c" (UID: "2ddacfee-9e8f-4c36-8c01-e4f334abe684") : secret "networking-console-plugin-cert" not found
Jul 27 20:52:19.116546 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.116502    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cr6p4"]
Jul 27 20:52:19.131534 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.131508    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.133714 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.133690    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:52:19.133856 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.133715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5rxbs\""
Jul 27 20:52:19.134886 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.134866    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:52:19.136518 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.136492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cr6p4"]
Jul 27 20:52:19.182081 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.182044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2e340e0-0aac-4d30-8895-d8c337d95374-crio-socket\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.182266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.182176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.182266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.182203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.182266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.182239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e340e0-0aac-4d30-8895-d8c337d95374-data-volume\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.182434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.182318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh85h\" (UniqueName: \"kubernetes.io/projected/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-api-access-wh85h\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.283770 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.283732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2e340e0-0aac-4d30-8895-d8c337d95374-crio-socket\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.283933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.283833    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.283933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.283857    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.283933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.283880    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e340e0-0aac-4d30-8895-d8c337d95374-data-volume\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.283933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.283884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2e340e0-0aac-4d30-8895-d8c337d95374-crio-socket\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.283933 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.283904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh85h\" (UniqueName: \"kubernetes.io/projected/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-api-access-wh85h\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.284149 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.284063    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:19.284149 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.284110    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:19.784096287 +0000 UTC m=+71.147332558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:19.284268 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.284252    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:19.284308 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.284303    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:19.784289476 +0000 UTC m=+71.147525748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:19.284551 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.284530    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e340e0-0aac-4d30-8895-d8c337d95374-data-volume\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.293857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.293831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh85h\" (UniqueName: \"kubernetes.io/projected/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-api-access-wh85h\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.788349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.788169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.788349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:19.788220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:19.788349 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.788312    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:19.788638 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.788398    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:20.788372932 +0000 UTC m=+72.151609218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:19.788638 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.788403    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:19.788638 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:19.788466    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:20.788448457 +0000 UTC m=+72.151684728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:20.797259 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:20.797220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:20.797259 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:20.797263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:20.797705 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:20.797354    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:20.797705 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:20.797412    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:20.797705 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:20.797419    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:22.797403881 +0000 UTC m=+74.160640152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:20.797705 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:20.797456    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:22.797445083 +0000 UTC m=+74.160681354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:21.341224 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:21.341184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2j9ck" event={"ID":"d7188b33-1448-4c30-8aa0-46cdb9c3d5a7","Type":"ContainerStarted","Data":"6796e13351c3bf5a25e63f6fffe815625cf92cbe4208ddce7f9f8eac81300df4"}
Jul 27 20:52:21.341409 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:21.341272    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:52:21.342600 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:21.342552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlvss" event={"ID":"e77adafa-2a18-4718-9eb7-7fa46d6c1192","Type":"ContainerStarted","Data":"4d945c21a2b1eb26eb26e5e6a3e87066b50b1dace49882f9571120ab7fc32cc8"}
Jul 27 20:52:21.360544 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:21.360503    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2j9ck" podStartSLOduration=67.325742144 podStartE2EDuration="1m12.360489229s" totalImagesPullingTime="5.034747085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:21.360159434 +0000 UTC m=+72.723395728" watchObservedRunningTime="2026-07-27 20:52:21.360489229 +0000 UTC m=+72.723725501"
Jul 27 20:52:21.376355 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:21.376311    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dlvss" podStartSLOduration=65.976165719 podStartE2EDuration="1m11.376296789s" totalImagesPullingTime="5.40013107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:21.375324898 +0000 UTC m=+72.738561192" watchObservedRunningTime="2026-07-27 20:52:21.376296789 +0000 UTC m=+72.739533082"
Jul 27 20:52:21.710928 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:21.710854    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4kldw_32952a5d-cf34-405d-b269-53a351f82d9a/dns-node-resolver/0.log"
Jul 27 20:52:22.007527 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.007494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:22.007938 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.007656    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:22.007938 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.007723    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls podName:9288184e-b907-4c15-9a3c-c9225641f949 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:30.007707684 +0000 UTC m=+81.370943955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m2zs4" (UID: "9288184e-b907-4c15-9a3c-c9225641f949") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:22.108136 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.108099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:22.108291 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.108244    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:52:22.108337 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.108311    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert podName:2ddacfee-9e8f-4c36-8c01-e4f334abe684 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:30.108296475 +0000 UTC m=+81.471532746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gwx9c" (UID: "2ddacfee-9e8f-4c36-8c01-e4f334abe684") : secret "networking-console-plugin-cert" not found
Jul 27 20:52:22.537797 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.537757    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-wg9zt"]
Jul 27 20:52:22.540644 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.540622    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.543237 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.543217    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 20:52:22.543237 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.543230    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 20:52:22.543368 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.543224    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6dvgf\""
Jul 27 20:52:22.543769 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.543747    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 20:52:22.543879 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.543790    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 20:52:22.550843 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.550822    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-wg9zt"]
Jul 27 20:52:22.612163 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.612124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/393f5c81-53fb-42a7-a8b3-cca55dcc046b-signing-key\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.612327 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.612249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frb7\" (UniqueName: \"kubernetes.io/projected/393f5c81-53fb-42a7-a8b3-cca55dcc046b-kube-api-access-7frb7\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.612327 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.612308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/393f5c81-53fb-42a7-a8b3-cca55dcc046b-signing-cabundle\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.712927 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.712893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/393f5c81-53fb-42a7-a8b3-cca55dcc046b-signing-key\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.713055 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.712989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frb7\" (UniqueName: \"kubernetes.io/projected/393f5c81-53fb-42a7-a8b3-cca55dcc046b-kube-api-access-7frb7\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.713055 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.713025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/393f5c81-53fb-42a7-a8b3-cca55dcc046b-signing-cabundle\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.713803 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.713741    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/393f5c81-53fb-42a7-a8b3-cca55dcc046b-signing-cabundle\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.715547 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.715525    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/393f5c81-53fb-42a7-a8b3-cca55dcc046b-signing-key\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.721495 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.721473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frb7\" (UniqueName: \"kubernetes.io/projected/393f5c81-53fb-42a7-a8b3-cca55dcc046b-kube-api-access-7frb7\") pod \"service-ca-658d7b7c78-wg9zt\" (UID: \"393f5c81-53fb-42a7-a8b3-cca55dcc046b\") " pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.814090 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.813997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:22.814090 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.814037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:22.814264 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.814126    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:22.814264 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.814164    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:22.814264 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.814206    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:26.814193088 +0000 UTC m=+78.177429359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:22.814264 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:22.814219    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:26.814212118 +0000 UTC m=+78.177448390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:22.849903 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.849871    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt"
Jul 27 20:52:22.998274 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:22.998245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-wg9zt"]
Jul 27 20:52:23.001627 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:23.001601    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393f5c81_53fb_42a7_a8b3_cca55dcc046b.slice/crio-2c98d9da98569096ff1f4de5619abbc799c4329a9420eb9025aa1c692fb0de23 WatchSource:0}: Error finding container 2c98d9da98569096ff1f4de5619abbc799c4329a9420eb9025aa1c692fb0de23: Status 404 returned error can't find the container with id 2c98d9da98569096ff1f4de5619abbc799c4329a9420eb9025aa1c692fb0de23
Jul 27 20:52:23.112338 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:23.112271    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kz7c6_dc844e47-3a37-488e-8b43-45d669c7a184/node-ca/0.log"
Jul 27 20:52:23.349054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:23.349012    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt" event={"ID":"393f5c81-53fb-42a7-a8b3-cca55dcc046b","Type":"ContainerStarted","Data":"2c98d9da98569096ff1f4de5619abbc799c4329a9420eb9025aa1c692fb0de23"}
Jul 27 20:52:23.915972 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:23.915938    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmx7s_c1df2aed-dc55-4a60-8bd4-26984cc5c324/serve-healthcheck-canary/0.log"
Jul 27 20:52:25.355209 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:25.355173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt" event={"ID":"393f5c81-53fb-42a7-a8b3-cca55dcc046b","Type":"ContainerStarted","Data":"21349c22a7b3af4b189c377d96f50be00142666c2abb5b24ca121fc7a7cddd92"}
Jul 27 20:52:25.371164 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:25.371117    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-wg9zt" podStartSLOduration=1.457062463 podStartE2EDuration="3.371104405s" totalImagesPullingTime="1.914041942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:25.370297434 +0000 UTC m=+76.733533718" watchObservedRunningTime="2026-07-27 20:52:25.371104405 +0000 UTC m=+76.734340698"
Jul 27 20:52:26.847008 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:26.846964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:26.847517 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:26.847016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:26.847517 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:26.847099    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:26.847517 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:26.847137    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:26.847517 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:26.847187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:34.847165107 +0000 UTC m=+86.210401392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:26.847517 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:26.847209    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:34.847200872 +0000 UTC m=+86.210437144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:30.073671 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:30.073498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:30.074043 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:30.073674    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:30.074043 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:30.073757    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls podName:9288184e-b907-4c15-9a3c-c9225641f949 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:46.073737058 +0000 UTC m=+97.436973329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m2zs4" (UID: "9288184e-b907-4c15-9a3c-c9225641f949") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:30.174848 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:30.174812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:30.175012 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:30.174979    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:52:30.175069 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:30.175059    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert podName:2ddacfee-9e8f-4c36-8c01-e4f334abe684 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:46.175042682 +0000 UTC m=+97.538278953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gwx9c" (UID: "2ddacfee-9e8f-4c36-8c01-e4f334abe684") : secret "networking-console-plugin-cert" not found
Jul 27 20:52:34.915718 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:34.915676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:34.915718 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:34.915719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:34.916277 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:34.915870    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:34.916277 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:52:34.915925    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls podName:c2e340e0-0aac-4d30-8895-d8c337d95374 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:50.915911442 +0000 UTC m=+102.279147713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cr6p4" (UID: "c2e340e0-0aac-4d30-8895-d8c337d95374") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:34.916385 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:34.916321    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e340e0-0aac-4d30-8895-d8c337d95374-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:46.106740 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.106700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:46.109242 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.109214    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9288184e-b907-4c15-9a3c-c9225641f949-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m2zs4\" (UID: \"9288184e-b907-4c15-9a3c-c9225641f949\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:46.207770 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.207717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:46.210213 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.210193    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ddacfee-9e8f-4c36-8c01-e4f334abe684-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gwx9c\" (UID: \"2ddacfee-9e8f-4c36-8c01-e4f334abe684\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:46.402762 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.402668    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"
Jul 27 20:52:46.499887 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.499859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"
Jul 27 20:52:46.530262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.530220    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4"]
Jul 27 20:52:46.535231 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:46.535192    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9288184e_b907_4c15_9a3c_c9225641f949.slice/crio-52837b6f999cb1e13d9b2fa607d8328050725bf72e297748cb8a1b7eb605829c WatchSource:0}: Error finding container 52837b6f999cb1e13d9b2fa607d8328050725bf72e297748cb8a1b7eb605829c: Status 404 returned error can't find the container with id 52837b6f999cb1e13d9b2fa607d8328050725bf72e297748cb8a1b7eb605829c
Jul 27 20:52:46.627275 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:46.627244    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c"]
Jul 27 20:52:46.630277 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:46.630246    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddacfee_9e8f_4c36_8c01_e4f334abe684.slice/crio-53c99c290d03d440627a170d53bd370ffda4910a42334c191c9330bfbe6e7c84 WatchSource:0}: Error finding container 53c99c290d03d440627a170d53bd370ffda4910a42334c191c9330bfbe6e7c84: Status 404 returned error can't find the container with id 53c99c290d03d440627a170d53bd370ffda4910a42334c191c9330bfbe6e7c84
Jul 27 20:52:47.415771 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.415735    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c" event={"ID":"2ddacfee-9e8f-4c36-8c01-e4f334abe684","Type":"ContainerStarted","Data":"53c99c290d03d440627a170d53bd370ffda4910a42334c191c9330bfbe6e7c84"}
Jul 27 20:52:47.417162 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.417131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4" event={"ID":"9288184e-b907-4c15-9a3c-c9225641f949","Type":"ContainerStarted","Data":"52837b6f999cb1e13d9b2fa607d8328050725bf72e297748cb8a1b7eb605829c"}
Jul 27 20:52:47.778073 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.778043    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"]
Jul 27 20:52:47.782704 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.782682    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:47.797631 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.797604    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 20:52:47.798396 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.798372    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 20:52:47.798502 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.798442    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 20:52:47.809773 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.809724    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v6l9p\""
Jul 27 20:52:47.810058 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.810033    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 20:52:47.817110 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.817081    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"]
Jul 27 20:52:47.821458 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.821432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:47.825424 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.825399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"]
Jul 27 20:52:47.826119 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.826097    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 20:52:47.861542 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.861514    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"]
Jul 27 20:52:47.919821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.919778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9916611f-7a48-44cd-989b-5c1504f35115-klusterlet-config\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:47.919821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.919820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl767\" (UniqueName: \"kubernetes.io/projected/a0b78e28-6a72-4d99-8bad-52bb5ea83697-kube-api-access-sl767\") pod \"managed-serviceaccount-addon-agent-64756b6cd8-ncwsh\" (UID: \"a0b78e28-6a72-4d99-8bad-52bb5ea83697\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:47.920073 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.919895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0b78e28-6a72-4d99-8bad-52bb5ea83697-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64756b6cd8-ncwsh\" (UID: \"a0b78e28-6a72-4d99-8bad-52bb5ea83697\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:47.920073 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.919912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9916611f-7a48-44cd-989b-5c1504f35115-tmp\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:47.920073 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:47.920055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hfg\" (UniqueName: \"kubernetes.io/projected/9916611f-7a48-44cd-989b-5c1504f35115-kube-api-access-w6hfg\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.021187 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.021149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hfg\" (UniqueName: \"kubernetes.io/projected/9916611f-7a48-44cd-989b-5c1504f35115-kube-api-access-w6hfg\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.021394 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.021226    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9916611f-7a48-44cd-989b-5c1504f35115-klusterlet-config\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.021394 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.021255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl767\" (UniqueName: \"kubernetes.io/projected/a0b78e28-6a72-4d99-8bad-52bb5ea83697-kube-api-access-sl767\") pod \"managed-serviceaccount-addon-agent-64756b6cd8-ncwsh\" (UID: \"a0b78e28-6a72-4d99-8bad-52bb5ea83697\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:48.021394 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.021304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0b78e28-6a72-4d99-8bad-52bb5ea83697-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64756b6cd8-ncwsh\" (UID: \"a0b78e28-6a72-4d99-8bad-52bb5ea83697\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:48.021618 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.021590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9916611f-7a48-44cd-989b-5c1504f35115-tmp\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.021990 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.021960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9916611f-7a48-44cd-989b-5c1504f35115-tmp\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.024258 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.024238    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9916611f-7a48-44cd-989b-5c1504f35115-klusterlet-config\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.024351 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.024276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0b78e28-6a72-4d99-8bad-52bb5ea83697-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64756b6cd8-ncwsh\" (UID: \"a0b78e28-6a72-4d99-8bad-52bb5ea83697\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:48.038732 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.038702    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hfg\" (UniqueName: \"kubernetes.io/projected/9916611f-7a48-44cd-989b-5c1504f35115-kube-api-access-w6hfg\") pod \"klusterlet-addon-workmgr-b848644f-fvxpb\" (UID: \"9916611f-7a48-44cd-989b-5c1504f35115\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.039118 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.039098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl767\" (UniqueName: \"kubernetes.io/projected/a0b78e28-6a72-4d99-8bad-52bb5ea83697-kube-api-access-sl767\") pod \"managed-serviceaccount-addon-agent-64756b6cd8-ncwsh\" (UID: \"a0b78e28-6a72-4d99-8bad-52bb5ea83697\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:48.106580 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.106521    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"
Jul 27 20:52:48.132150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.132112    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:48.393865 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.393826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"]
Jul 27 20:52:48.396715 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:48.396687    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9916611f_7a48_44cd_989b_5c1504f35115.slice/crio-b08d7e27aa0de4f182f19cfd64f103e8b98deea978568788719d342ea1fc1e22 WatchSource:0}: Error finding container b08d7e27aa0de4f182f19cfd64f103e8b98deea978568788719d342ea1fc1e22: Status 404 returned error can't find the container with id b08d7e27aa0de4f182f19cfd64f103e8b98deea978568788719d342ea1fc1e22
Jul 27 20:52:48.423024 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.422985    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4" event={"ID":"9288184e-b907-4c15-9a3c-c9225641f949","Type":"ContainerStarted","Data":"3075003e6a2ef1ab7e84b37be7654e53206761029cd9fc5c9f58e6a1345d2e46"}
Jul 27 20:52:48.424467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.424417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb" event={"ID":"9916611f-7a48-44cd-989b-5c1504f35115","Type":"ContainerStarted","Data":"b08d7e27aa0de4f182f19cfd64f103e8b98deea978568788719d342ea1fc1e22"}
Jul 27 20:52:48.424588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.424544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:52:48.424654 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.424639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:52:48.425845 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.425811    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh"]
Jul 27 20:52:48.427246 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.427225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c" event={"ID":"2ddacfee-9e8f-4c36-8c01-e4f334abe684","Type":"ContainerStarted","Data":"d035d95f5f9d16c1bdcc2763604531d5099de79e97e94c4cdd0dd96a445c12ff"}
Jul 27 20:52:48.427432 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.427415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4dc17931-747e-4a9c-9e2c-7bbe085ed090-metrics-tls\") pod \"dns-default-2wt9c\" (UID: \"4dc17931-747e-4a9c-9e2c-7bbe085ed090\") " pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:52:48.427600 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.427582    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"image-registry-85d7d7d9f5-tqmr5\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") " pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:52:48.428795 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:48.428777    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0b78e28_6a72_4d99_8bad_52bb5ea83697.slice/crio-c2fbcf8a333e201f8c275cef10a043afe174ce5461d21d4b921cb569b045411f WatchSource:0}: Error finding container c2fbcf8a333e201f8c275cef10a043afe174ce5461d21d4b921cb569b045411f: Status 404 returned error can't find the container with id c2fbcf8a333e201f8c275cef10a043afe174ce5461d21d4b921cb569b045411f
Jul 27 20:52:48.502785 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.502725    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m2zs4" podStartSLOduration=32.757809699 podStartE2EDuration="34.502700592s" totalImagesPullingTime="1.744890893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:48.47399032 +0000 UTC m=+99.837226613" watchObservedRunningTime="2026-07-27 20:52:48.502700592 +0000 UTC m=+99.865936886"
Jul 27 20:52:48.502956 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.502853    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gwx9c" podStartSLOduration=33.470211467 podStartE2EDuration="34.502845609s" totalImagesPullingTime="1.032634142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:48.501315041 +0000 UTC m=+99.864551334" watchObservedRunningTime="2026-07-27 20:52:48.502845609 +0000 UTC m=+99.866081902"
Jul 27 20:52:48.708606 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.708516    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jv4bm\""
Jul 27 20:52:48.716973 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.716949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:52:48.731025 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.731004    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9tww\""
Jul 27 20:52:48.736052 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.736033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:52:48.872954 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.872929    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"]
Jul 27 20:52:48.874952 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:48.874919    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a01f16_fc40_4d36_8d60_4b38cb1fe296.slice/crio-54b2638e44d8fce8497562f49acf44c6f9c4a8e1511ba20ac57f18e86067d81d WatchSource:0}: Error finding container 54b2638e44d8fce8497562f49acf44c6f9c4a8e1511ba20ac57f18e86067d81d: Status 404 returned error can't find the container with id 54b2638e44d8fce8497562f49acf44c6f9c4a8e1511ba20ac57f18e86067d81d
Jul 27 20:52:48.894300 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:48.894224    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wt9c"]
Jul 27 20:52:48.904314 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:48.903858    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc17931_747e_4a9c_9e2c_7bbe085ed090.slice/crio-a5da83acd4df59b30b34d95c17291f5eb9527c6dcf5306bc020275085cf411cb WatchSource:0}: Error finding container a5da83acd4df59b30b34d95c17291f5eb9527c6dcf5306bc020275085cf411cb: Status 404 returned error can't find the container with id a5da83acd4df59b30b34d95c17291f5eb9527c6dcf5306bc020275085cf411cb
Jul 27 20:52:49.438265 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:49.438156    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wt9c" event={"ID":"4dc17931-747e-4a9c-9e2c-7bbe085ed090","Type":"ContainerStarted","Data":"a5da83acd4df59b30b34d95c17291f5eb9527c6dcf5306bc020275085cf411cb"}
Jul 27 20:52:49.441636 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:49.441576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh" event={"ID":"a0b78e28-6a72-4d99-8bad-52bb5ea83697","Type":"ContainerStarted","Data":"c2fbcf8a333e201f8c275cef10a043afe174ce5461d21d4b921cb569b045411f"}
Jul 27 20:52:49.448266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:49.447745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5" event={"ID":"96a01f16-fc40-4d36-8d60-4b38cb1fe296","Type":"ContainerStarted","Data":"384242c5090a93dd0ec0240f714201ff4e3e13be6f8dd7d08b163cc6fc65b1ec"}
Jul 27 20:52:49.448266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:49.447790    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5" event={"ID":"96a01f16-fc40-4d36-8d60-4b38cb1fe296","Type":"ContainerStarted","Data":"54b2638e44d8fce8497562f49acf44c6f9c4a8e1511ba20ac57f18e86067d81d"}
Jul 27 20:52:49.448266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:49.448216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:52:50.983359 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:50.983306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:50.986269 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:50.986243    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e340e0-0aac-4d30-8895-d8c337d95374-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cr6p4\" (UID: \"c2e340e0-0aac-4d30-8895-d8c337d95374\") " pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:51.243817 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:51.243734    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cr6p4"
Jul 27 20:52:52.347009 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:52.346981    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2j9ck"
Jul 27 20:52:52.365599 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:52.365529    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5" podStartSLOduration=102.365513631 podStartE2EDuration="1m42.365513631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:49.473128901 +0000 UTC m=+100.836365196" watchObservedRunningTime="2026-07-27 20:52:52.365513631 +0000 UTC m=+103.728749924"
Jul 27 20:52:54.265513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.265331    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cr6p4"]
Jul 27 20:52:54.269200 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:52:54.269175    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e340e0_0aac_4d30_8895_d8c337d95374.slice/crio-c8180aaf2c2aa54bb80a6c9be5877f42158dab83e8a070970b6ce8f1d96308fc WatchSource:0}: Error finding container c8180aaf2c2aa54bb80a6c9be5877f42158dab83e8a070970b6ce8f1d96308fc: Status 404 returned error can't find the container with id c8180aaf2c2aa54bb80a6c9be5877f42158dab83e8a070970b6ce8f1d96308fc
Jul 27 20:52:54.465979 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.465939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cr6p4" event={"ID":"c2e340e0-0aac-4d30-8895-d8c337d95374","Type":"ContainerStarted","Data":"c8180aaf2c2aa54bb80a6c9be5877f42158dab83e8a070970b6ce8f1d96308fc"}
Jul 27 20:52:54.467960 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.467929    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wt9c" event={"ID":"4dc17931-747e-4a9c-9e2c-7bbe085ed090","Type":"ContainerStarted","Data":"c7006f75795ef93d3bd9bc1aa58db0b60c4e32fcb1224b5f63e4f6c43fcf38e2"}
Jul 27 20:52:54.468108 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.467993    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wt9c" event={"ID":"4dc17931-747e-4a9c-9e2c-7bbe085ed090","Type":"ContainerStarted","Data":"a64190ebf03de57cd62116f984e98f6d77c9f1b67c2678495ef391702f2ebd21"}
Jul 27 20:52:54.468108 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.468054    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:52:54.469530 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.469508    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb" event={"ID":"9916611f-7a48-44cd-989b-5c1504f35115","Type":"ContainerStarted","Data":"11d702f237809437af1d0ade224b97aeeae358dffaed57fb2f2f1021276d37d3"}
Jul 27 20:52:54.469673 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.469584    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:54.471339 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.471318    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh" event={"ID":"a0b78e28-6a72-4d99-8bad-52bb5ea83697","Type":"ContainerStarted","Data":"418aed1525344dd3cc7801c3de2baed13ca12ca7f7ea88c0aac890f156be8d50"}
Jul 27 20:52:54.471465 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.471447    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb"
Jul 27 20:52:54.571921 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.571869    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2wt9c" podStartSLOduration=65.353446795 podStartE2EDuration="1m10.571852137s" totalImagesPullingTime="5.218405342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.52689999 +0000 UTC m=+105.890136288" watchObservedRunningTime="2026-07-27 20:52:54.571852137 +0000 UTC m=+105.935088433"
Jul 27 20:52:54.572080 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.571993    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b848644f-fvxpb" podStartSLOduration=1.827861695 podStartE2EDuration="7.571986649s" totalImagesPullingTime="5.744124954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.571074545 +0000 UTC m=+105.934310848" watchObservedRunningTime="2026-07-27 20:52:54.571986649 +0000 UTC m=+105.935222919"
Jul 27 20:52:54.608497 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:54.608378    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64756b6cd8-ncwsh" podStartSLOduration=1.913133206 podStartE2EDuration="7.608361266s" totalImagesPullingTime="5.69522806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.607987866 +0000 UTC m=+105.971224158" watchObservedRunningTime="2026-07-27 20:52:54.608361266 +0000 UTC m=+105.971597558"
Jul 27 20:52:59.490931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:52:59.490891    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cr6p4" event={"ID":"c2e340e0-0aac-4d30-8895-d8c337d95374","Type":"ContainerStarted","Data":"c6ffed4fe7e872b7508ca82a34101e668dc992c328192342599b78658e501d55"}
Jul 27 20:53:00.876746 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.876711    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f85d9cfdd-lt7tt"]
Jul 27 20:53:00.883313 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.883284    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.887861 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.887833    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 20:53:00.888036 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.887833    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:53:00.888745 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.888702    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 20:53:00.889008 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.888987    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:53:00.889114 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.889024    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 20:53:00.889114 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.889070    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nr66h\""
Jul 27 20:53:00.889375 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.889347    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 20:53:00.889499 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.889464    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 20:53:00.892070 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.891858    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f85d9cfdd-lt7tt"]
Jul 27 20:53:00.895186 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.895046    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 20:53:00.969522 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969481    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-oauth-serving-cert\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.969730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5vv\" (UniqueName: \"kubernetes.io/projected/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-kube-api-access-pv5vv\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.969730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-config\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.969730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-oauth-config\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.969730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-service-ca\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.969888 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-trusted-ca-bundle\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:00.969888 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:00.969840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-serving-cert\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.070753 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-oauth-config\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.070950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-service-ca\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.070950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-trusted-ca-bundle\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.070950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-serving-cert\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.070950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-oauth-serving-cert\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.070950 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5vv\" (UniqueName: \"kubernetes.io/projected/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-kube-api-access-pv5vv\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.071199 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.070961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-config\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.072098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.072066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-service-ca\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.072232 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.072120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-oauth-serving-cert\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.072320 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.072286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-trusted-ca-bundle\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.072655 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.072635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-config\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.073595 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.073548    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-oauth-config\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.073792 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.073776    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-serving-cert\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.086045 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.086017    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5vv\" (UniqueName: \"kubernetes.io/projected/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-kube-api-access-pv5vv\") pod \"console-5f85d9cfdd-lt7tt\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") " pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:01.196167 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:01.196077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:02.483184 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.483146    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6bmmr"]
Jul 27 20:53:02.496616 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.496583    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"]
Jul 27 20:53:02.496817 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.496702    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.505227 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.505197    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:53:02.505943 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.505916    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:53:02.513881 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.513455    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:53:02.513881 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.513524    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:53:02.513881 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.513716    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwms7\""
Jul 27 20:53:02.514292 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.514262    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"]
Jul 27 20:53:02.514407 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.514391    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.516337 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.516316    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h2c5n\""
Jul 27 20:53:02.516463 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.516316    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 20:53:02.516618 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.516598    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 20:53:02.516831 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.516711    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 20:53:02.586916 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.586872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2013103-0b26-4cb0-8a9f-9775c4647525-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.587080 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.586934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587080 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.586964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.587080 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.586998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b2013103-0b26-4cb0-8a9f-9775c4647525-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.587080 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjjbm\" (UniqueName: \"kubernetes.io/projected/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-api-access-jjjbm\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-tls\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92ebdc6-8df5-4729-8410-077e4d30bf87-metrics-client-ca\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-sys\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-wtmp\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587656 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-textfile\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587656 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6md7t\" (UniqueName: \"kubernetes.io/projected/b92ebdc6-8df5-4729-8410-077e4d30bf87-kube-api-access-6md7t\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.587656 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.587353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-root\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.688424 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.688424 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b2013103-0b26-4cb0-8a9f-9775c4647525-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjjbm\" (UniqueName: \"kubernetes.io/projected/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-api-access-jjjbm\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:53:02.688587    2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-tls\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:53:02.688671    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-tls podName:b2013103-0b26-4cb0-8a9f-9775c4647525 nodeName:}" failed. No retries permitted until 2026-07-27 20:53:03.188647327 +0000 UTC m=+114.551883603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-p27ct" (UID: "b2013103-0b26-4cb0-8a9f-9775c4647525") : secret "kube-state-metrics-tls" not found
Jul 27 20:53:02.688713 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92ebdc6-8df5-4729-8410-077e4d30bf87-metrics-client-ca\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-sys\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688818    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-wtmp\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-textfile\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6md7t\" (UniqueName: \"kubernetes.io/projected/b92ebdc6-8df5-4729-8410-077e4d30bf87-kube-api-access-6md7t\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-root\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b2013103-0b26-4cb0-8a9f-9775c4647525-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.689054 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.688966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2013103-0b26-4cb0-8a9f-9775c4647525-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.689482 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-sys\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689482 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-accelerators-collector-config\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689482 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689296    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.689482 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-textfile\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689482 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689440    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92ebdc6-8df5-4729-8410-077e4d30bf87-metrics-client-ca\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-root\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-wtmp\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.689735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.689619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2013103-0b26-4cb0-8a9f-9775c4647525-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.691387 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.691364    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.692082 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.692065    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92ebdc6-8df5-4729-8410-077e4d30bf87-node-exporter-tls\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.692176 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.692094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.697609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.697583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6md7t\" (UniqueName: \"kubernetes.io/projected/b92ebdc6-8df5-4729-8410-077e4d30bf87-kube-api-access-6md7t\") pod \"node-exporter-6bmmr\" (UID: \"b92ebdc6-8df5-4729-8410-077e4d30bf87\") " pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.697990 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.697972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjjbm\" (UniqueName: \"kubernetes.io/projected/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-api-access-jjjbm\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:02.824474 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.824445    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6bmmr"
Jul 27 20:53:02.836082 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:53:02.835941    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92ebdc6_8df5_4729_8410_077e4d30bf87.slice/crio-ca4533855843381439eb6c9f6ab8239381da3e7e26fec9056abd6f639237aa01 WatchSource:0}: Error finding container ca4533855843381439eb6c9f6ab8239381da3e7e26fec9056abd6f639237aa01: Status 404 returned error can't find the container with id ca4533855843381439eb6c9f6ab8239381da3e7e26fec9056abd6f639237aa01
Jul 27 20:53:02.916821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:02.916787    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f85d9cfdd-lt7tt"]
Jul 27 20:53:02.920249 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:53:02.920225    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d8eac6_5332_4a59_aba2_a9ee4b67ccd9.slice/crio-214bb9f49a3578f2d42c75f70f8c47925d06a95487a1d7ca1e2793693f8b6621 WatchSource:0}: Error finding container 214bb9f49a3578f2d42c75f70f8c47925d06a95487a1d7ca1e2793693f8b6621: Status 404 returned error can't find the container with id 214bb9f49a3578f2d42c75f70f8c47925d06a95487a1d7ca1e2793693f8b6621
Jul 27 20:53:03.194458 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.194367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:03.196904 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.196883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2013103-0b26-4cb0-8a9f-9775c4647525-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-p27ct\" (UID: \"b2013103-0b26-4cb0-8a9f-9775c4647525\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:03.431981 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.431942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"
Jul 27 20:53:03.519942 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.519903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cr6p4" event={"ID":"c2e340e0-0aac-4d30-8895-d8c337d95374","Type":"ContainerStarted","Data":"75cc375c980c46120c637b0064b287c5da059c46c8fc47db7a24f7273cbd1e25"}
Jul 27 20:53:03.523000 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.522816    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bmmr" event={"ID":"b92ebdc6-8df5-4729-8410-077e4d30bf87","Type":"ContainerStarted","Data":"ca4533855843381439eb6c9f6ab8239381da3e7e26fec9056abd6f639237aa01"}
Jul 27 20:53:03.525434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.525354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f85d9cfdd-lt7tt" event={"ID":"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9","Type":"ContainerStarted","Data":"214bb9f49a3578f2d42c75f70f8c47925d06a95487a1d7ca1e2793693f8b6621"}
Jul 27 20:53:03.551677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.550246    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:53:03.554425 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.554404    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.558143 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.556817    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 20:53:03.558143 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.557133    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 20:53:03.558143 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.557652    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 20:53:03.558143 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.557897    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 20:53:03.558143 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.558108    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 20:53:03.558485 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.558468    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 20:53:03.558802 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.558695    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 20:53:03.558917 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.558895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 20:53:03.559724 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.559166    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 20:53:03.559724 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.559484    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnf4k\""
Jul 27 20:53:03.577587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.577461    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:53:03.640047 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.639791    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct"]
Jul 27 20:53:03.644344 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:53:03.644307    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2013103_0b26_4cb0_8a9f_9775c4647525.slice/crio-6ba67c251713ec918526c419b974fcdd7c531f53ccd5e9bb3f9970e6fcdf894e WatchSource:0}: Error finding container 6ba67c251713ec918526c419b974fcdd7c531f53ccd5e9bb3f9970e6fcdf894e: Status 404 returned error can't find the container with id 6ba67c251713ec918526c419b974fcdd7c531f53ccd5e9bb3f9970e6fcdf894e
Jul 27 20:53:03.704046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.703942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-web-config\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.703999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr86t\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-kube-api-access-mr86t\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-config-volume\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704310    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.704735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.704356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-config-out\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.804907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.804968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.804997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr86t\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-kube-api-access-mr86t\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-config-volume\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-config-out\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-web-config\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.807019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.805326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.809010 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.808624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.812350 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.811687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.812460 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.812419    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.815763 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.815720    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-config-volume\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.820401 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.820349    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.821205 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.821160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr86t\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-kube-api-access-mr86t\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.821820 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.821769    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.827496 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.827323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-config-out\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.829637 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.828064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.829637 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.829133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.829637 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.829584    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.829637 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.829624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-web-config\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.829899 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.827472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:03.870232 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:03.869906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:53:04.310251 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:04.310054    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:53:04.319715 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:53:04.319675    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8982d600_43c0_45c2_9e4f_548af8ba9704.slice/crio-d95b6d1d45b3abd583030c689db0089593c313103ba014dcd053981c96752f25 WatchSource:0}: Error finding container d95b6d1d45b3abd583030c689db0089593c313103ba014dcd053981c96752f25: Status 404 returned error can't find the container with id d95b6d1d45b3abd583030c689db0089593c313103ba014dcd053981c96752f25
Jul 27 20:53:04.478796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:04.478069    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2wt9c"
Jul 27 20:53:04.536940 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:04.536822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct" event={"ID":"b2013103-0b26-4cb0-8a9f-9775c4647525","Type":"ContainerStarted","Data":"6ba67c251713ec918526c419b974fcdd7c531f53ccd5e9bb3f9970e6fcdf894e"}
Jul 27 20:53:04.543959 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:04.542940    2567 generic.go:356] "Generic (PLEG): container finished" podID="b92ebdc6-8df5-4729-8410-077e4d30bf87" containerID="3ea4a05a2467ea1f183d4af87709b16d9788d0df34f9ce13c815f5448ad18f5f" exitCode=0
Jul 27 20:53:04.543959 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:04.543040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bmmr" event={"ID":"b92ebdc6-8df5-4729-8410-077e4d30bf87","Type":"ContainerDied","Data":"3ea4a05a2467ea1f183d4af87709b16d9788d0df34f9ce13c815f5448ad18f5f"}
Jul 27 20:53:04.547528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:04.547495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"d95b6d1d45b3abd583030c689db0089593c313103ba014dcd053981c96752f25"}
Jul 27 20:53:05.556400 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:05.556366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bmmr" event={"ID":"b92ebdc6-8df5-4729-8410-077e4d30bf87","Type":"ContainerStarted","Data":"f02d2e6d20268f0133b131a116cae79102af8004d5f8d1968de20f99f2b2c4d9"}
Jul 27 20:53:05.556981 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:05.556421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6bmmr" event={"ID":"b92ebdc6-8df5-4729-8410-077e4d30bf87","Type":"ContainerStarted","Data":"feb41c5eed8f06bad5376f7ae0e2d661ac3f06cdc21632b6481a7b10e53b7468"}
Jul 27 20:53:05.586434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:05.586374    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6bmmr" podStartSLOduration=2.169271181 podStartE2EDuration="3.586354058s" totalImagesPullingTime="1.308970964s" totalInitContainerRuntime="108.111913ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:05.586330797 +0000 UTC m=+116.949567091" watchObservedRunningTime="2026-07-27 20:53:05.586354058 +0000 UTC m=+116.949590353"
Jul 27 20:53:06.969810 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.969776    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fc47786f9-dgbbk"]
Jul 27 20:53:06.975125 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.975105    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:06.979191 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.979166    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 20:53:06.979847 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.979826    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7pwl9\""
Jul 27 20:53:06.979938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.979826    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 20:53:06.979938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.979853    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 20:53:06.980175 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.980151    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 20:53:06.980263 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.980242    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8ka34hbs9hoi2\""
Jul 27 20:53:06.991299 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:06.991277    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fc47786f9-dgbbk"]
Jul 27 20:53:07.143858 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.143817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-secret-metrics-server-client-certs\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.144036 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.143864    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-secret-metrics-server-tls\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.144036 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.143932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ebd84a8b-1971-460c-aab5-f539042449b0-metrics-server-audit-profiles\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.144161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.144091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vct96\" (UniqueName: \"kubernetes.io/projected/ebd84a8b-1971-460c-aab5-f539042449b0-kube-api-access-vct96\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.144161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.144150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ebd84a8b-1971-460c-aab5-f539042449b0-audit-log\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.144254 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.144218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-client-ca-bundle\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.144298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.144283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd84a8b-1971-460c-aab5-f539042449b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.244207 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.244132    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f85d9cfdd-lt7tt"]
Jul 27 20:53:07.244999 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.244965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ebd84a8b-1971-460c-aab5-f539042449b0-audit-log\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245122 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-client-ca-bundle\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245122 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd84a8b-1971-460c-aab5-f539042449b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245122 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-secret-metrics-server-client-certs\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245122 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-secret-metrics-server-tls\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245319 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ebd84a8b-1971-460c-aab5-f539042449b0-metrics-server-audit-profiles\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245319 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vct96\" (UniqueName: \"kubernetes.io/projected/ebd84a8b-1971-460c-aab5-f539042449b0-kube-api-access-vct96\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.245408 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.245382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ebd84a8b-1971-460c-aab5-f539042449b0-audit-log\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.246035 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.246010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebd84a8b-1971-460c-aab5-f539042449b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.246301 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.246263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ebd84a8b-1971-460c-aab5-f539042449b0-metrics-server-audit-profiles\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.248337 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.248290    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-client-ca-bundle\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.248783 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.248763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-secret-metrics-server-client-certs\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.249025 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.249004    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ebd84a8b-1971-460c-aab5-f539042449b0-secret-metrics-server-tls\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.257212 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.257193    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vct96\" (UniqueName: \"kubernetes.io/projected/ebd84a8b-1971-460c-aab5-f539042449b0-kube-api-access-vct96\") pod \"metrics-server-6fc47786f9-dgbbk\" (UID: \"ebd84a8b-1971-460c-aab5-f539042449b0\") " pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:07.287063 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:07.287027    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:08.734418 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:08.734391    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fc47786f9-dgbbk"]
Jul 27 20:53:08.759380 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:53:08.759102    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd84a8b_1971_460c_aab5_f539042449b0.slice/crio-2506cdb5e7ba425b7e53a71add10c6640cc739b362a4f22f5519bec3d18b9a32 WatchSource:0}: Error finding container 2506cdb5e7ba425b7e53a71add10c6640cc739b362a4f22f5519bec3d18b9a32: Status 404 returned error can't find the container with id 2506cdb5e7ba425b7e53a71add10c6640cc739b362a4f22f5519bec3d18b9a32
Jul 27 20:53:09.573467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.573418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cr6p4" event={"ID":"c2e340e0-0aac-4d30-8895-d8c337d95374","Type":"ContainerStarted","Data":"fc376ec1061b4dda50be162868f9bd0c60bf825ce44c84744bf9971a699010a2"}
Jul 27 20:53:09.575066 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.575040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f85d9cfdd-lt7tt" event={"ID":"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9","Type":"ContainerStarted","Data":"4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc"}
Jul 27 20:53:09.576712 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.576684    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414" exitCode=0
Jul 27 20:53:09.576841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.576794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"}
Jul 27 20:53:09.580028 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.579946    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk" event={"ID":"ebd84a8b-1971-460c-aab5-f539042449b0","Type":"ContainerStarted","Data":"2506cdb5e7ba425b7e53a71add10c6640cc739b362a4f22f5519bec3d18b9a32"}
Jul 27 20:53:09.582969 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.582948    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct" event={"ID":"b2013103-0b26-4cb0-8a9f-9775c4647525","Type":"ContainerStarted","Data":"1b53558cd863cbea18e41c0a108000c800d93d698b0efef7ecb9a86601f46796"}
Jul 27 20:53:09.583050 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.583000    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct" event={"ID":"b2013103-0b26-4cb0-8a9f-9775c4647525","Type":"ContainerStarted","Data":"502bbdabe6bc09c1b0cacfef74eccd0e86712ce9a1dab20acc7ec5431927b222"}
Jul 27 20:53:09.583050 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.583031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct" event={"ID":"b2013103-0b26-4cb0-8a9f-9775c4647525","Type":"ContainerStarted","Data":"f0f926134550fa266dd43f060c89cc357f05d99bf449f144df4731f2fed01bca"}
Jul 27 20:53:09.617477 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.617214    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cr6p4" podStartSLOduration=36.4259696 podStartE2EDuration="50.617191189s" totalImagesPullingTime="14.191221589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:52:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:09.596894477 +0000 UTC m=+120.960130771" watchObservedRunningTime="2026-07-27 20:53:09.617191189 +0000 UTC m=+120.980427484"
Jul 27 20:53:09.620478 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.618857    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-p27ct" podStartSLOduration=2.693029638 podStartE2EDuration="7.618843546s" totalImagesPullingTime="4.925813908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:09.616609133 +0000 UTC m=+120.979845429" watchObservedRunningTime="2026-07-27 20:53:09.618843546 +0000 UTC m=+120.982079839"
Jul 27 20:53:09.636216 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:09.636157    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f85d9cfdd-lt7tt" podStartSLOduration=3.972803907 podStartE2EDuration="9.636133632s" totalImagesPullingTime="5.663329725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:09.634376475 +0000 UTC m=+120.997612761" watchObservedRunningTime="2026-07-27 20:53:09.636133632 +0000 UTC m=+120.999369926"
Jul 27 20:53:10.421500 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:10.421412    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"]
Jul 27 20:53:10.425634 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:10.425610    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:53:10.588437 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:10.588395    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk" event={"ID":"ebd84a8b-1971-460c-aab5-f539042449b0","Type":"ContainerStarted","Data":"4c52926454932fd2b01b50e5f1de5c62d152329132e6e5a9f2c5f6a9ffce10f7"}
Jul 27 20:53:10.607235 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:10.607179    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk" podStartSLOduration=3.334675495 podStartE2EDuration="4.607157485s" totalImagesPullingTime="1.27248199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:10.606659336 +0000 UTC m=+121.969895629" watchObservedRunningTime="2026-07-27 20:53:10.607157485 +0000 UTC m=+121.970393779"
Jul 27 20:53:11.196971 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:11.196816    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:11.595161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:11.595128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"}
Jul 27 20:53:11.595503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:11.595192    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"}
Jul 27 20:53:11.595503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:11.595225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"}
Jul 27 20:53:11.595503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:11.595250    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"}
Jul 27 20:53:11.595503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:11.595275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"}
Jul 27 20:53:12.606389 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:12.606349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerStarted","Data":"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"}
Jul 27 20:53:12.643690 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:12.640169    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.197912119 podStartE2EDuration="9.640148139s" totalImagesPullingTime="6.413065281s" totalInitContainerRuntime="29.170739ms" isStatefulPod=false podCreationTimestamp="2026-07-27 20:53:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:12.638688339 +0000 UTC m=+124.001924635" watchObservedRunningTime="2026-07-27 20:53:12.640148139 +0000 UTC m=+124.003384435"
Jul 27 20:53:18.759206 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:18.759153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:53:18.761740 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:18.761717    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0fcda60-bf81-4305-83d7-080f46f96326-metrics-certs\") pod \"network-metrics-daemon-xvhwj\" (UID: \"d0fcda60-bf81-4305-83d7-080f46f96326\") " pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:53:19.046016 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:19.045925    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvgk8\""
Jul 27 20:53:19.055257 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:19.055213    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhwj"
Jul 27 20:53:19.204137 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:19.204104    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvhwj"]
Jul 27 20:53:19.207245 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:53:19.207222    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fcda60_bf81_4305_83d7_080f46f96326.slice/crio-9d62902859d5357fd19c25e80754dad18dd7d0119c16ef09d2e02804436ebc58 WatchSource:0}: Error finding container 9d62902859d5357fd19c25e80754dad18dd7d0119c16ef09d2e02804436ebc58: Status 404 returned error can't find the container with id 9d62902859d5357fd19c25e80754dad18dd7d0119c16ef09d2e02804436ebc58
Jul 27 20:53:19.632531 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:19.632489    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvhwj" event={"ID":"d0fcda60-bf81-4305-83d7-080f46f96326","Type":"ContainerStarted","Data":"9d62902859d5357fd19c25e80754dad18dd7d0119c16ef09d2e02804436ebc58"}
Jul 27 20:53:20.638009 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:20.637973    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvhwj" event={"ID":"d0fcda60-bf81-4305-83d7-080f46f96326","Type":"ContainerStarted","Data":"3b15025a5c06e2076ad695ded7f236e8c8c731a396bcf379df8f823ba2138b4f"}
Jul 27 20:53:20.638493 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:20.638024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvhwj" event={"ID":"d0fcda60-bf81-4305-83d7-080f46f96326","Type":"ContainerStarted","Data":"68611615af4428a5e094b1e3be0b7c9abcc605c4d6c1e4dad078cd3c0758f8e1"}
Jul 27 20:53:20.654974 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:20.654918    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xvhwj" podStartSLOduration=130.718127556 podStartE2EDuration="2m11.654898662s" totalImagesPullingTime="936.771106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:53:20.653598068 +0000 UTC m=+132.016834366" watchObservedRunningTime="2026-07-27 20:53:20.654898662 +0000 UTC m=+132.018134954"
Jul 27 20:53:27.287422 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:27.287383    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:27.287922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:27.287471    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:34.598589 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:34.598511    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f85d9cfdd-lt7tt" podUID="f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" containerName="console" containerID="cri-o://4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc" gracePeriod=15
Jul 27 20:53:35.393361 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.393320    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:35.440670 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.440629    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5" podUID="96a01f16-fc40-4d36-8d60-4b38cb1fe296" containerName="registry" containerID="cri-o://384242c5090a93dd0ec0240f714201ff4e3e13be6f8dd7d08b163cc6fc65b1ec" gracePeriod=30
Jul 27 20:53:35.508575 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508525    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-trusted-ca-bundle\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.508714 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508595    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-service-ca\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.508714 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508631    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-oauth-config\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.508714 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508655    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-config\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.508714 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508671    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-serving-cert\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.508714 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508710    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv5vv\" (UniqueName: \"kubernetes.io/projected/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-kube-api-access-pv5vv\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.508987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508744    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-oauth-serving-cert\") pod \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\" (UID: \"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9\") "
Jul 27 20:53:35.509053 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.508981    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-service-ca" (OuterVolumeSpecName: "service-ca") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:35.509053 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.509004    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:35.509161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.509103    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-config" (OuterVolumeSpecName: "console-config") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:35.509324 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.509304    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:35.511262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.511231    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:53:35.511352 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.511285    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:53:35.511352 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.511289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-kube-api-access-pv5vv" (OuterVolumeSpecName: "kube-api-access-pv5vv") pod "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" (UID: "f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9"). InnerVolumeSpecName "kube-api-access-pv5vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:53:35.610187 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610144    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-trusted-ca-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.610187 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610180    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.610187 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610193    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-oauth-config\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.610677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610204    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-config\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.610677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610216    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-console-serving-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.610677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610227    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv5vv\" (UniqueName: \"kubernetes.io/projected/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-kube-api-access-pv5vv\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.610677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.610238    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9-oauth-serving-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:35.696728 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.696673    2567 generic.go:356] "Generic (PLEG): container finished" podID="96a01f16-fc40-4d36-8d60-4b38cb1fe296" containerID="384242c5090a93dd0ec0240f714201ff4e3e13be6f8dd7d08b163cc6fc65b1ec" exitCode=0
Jul 27 20:53:35.696900 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.696756    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5" event={"ID":"96a01f16-fc40-4d36-8d60-4b38cb1fe296","Type":"ContainerDied","Data":"384242c5090a93dd0ec0240f714201ff4e3e13be6f8dd7d08b163cc6fc65b1ec"}
Jul 27 20:53:35.698157 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.698132    2567 generic.go:356] "Generic (PLEG): container finished" podID="f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" containerID="4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc" exitCode=0
Jul 27 20:53:35.698278 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.698178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f85d9cfdd-lt7tt" event={"ID":"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9","Type":"ContainerDied","Data":"4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc"}
Jul 27 20:53:35.698278 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.698215    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f85d9cfdd-lt7tt" event={"ID":"f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9","Type":"ContainerDied","Data":"214bb9f49a3578f2d42c75f70f8c47925d06a95487a1d7ca1e2793693f8b6621"}
Jul 27 20:53:35.698278 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.698183    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f85d9cfdd-lt7tt"
Jul 27 20:53:35.712450 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.712427    2567 scope.go:117] "RemoveContainer" containerID="4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc"
Jul 27 20:53:35.722824 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.722803    2567 scope.go:117] "RemoveContainer" containerID="4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc"
Jul 27 20:53:35.723098 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:53:35.723074    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc\": container with ID starting with 4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc not found: ID does not exist" containerID="4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc"
Jul 27 20:53:35.723171 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.723110    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc"} err="failed to get container status \"4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc\": rpc error: code = NotFound desc = could not find container \"4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc\": container with ID starting with 4d93642005fc1aba930a3be0e0b2a8d8013fa437c31009205611363add428afc not found: ID does not exist"
Jul 27 20:53:35.777995 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.777913    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:53:35.788153 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.788125    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f85d9cfdd-lt7tt"]
Jul 27 20:53:35.794310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.794282    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f85d9cfdd-lt7tt"]
Jul 27 20:53:35.913191 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913155    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-image-registry-private-configuration\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913191 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913191    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-trusted-ca\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913219    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-certificates\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913267    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-installation-pull-secrets\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913402    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-bound-sa-token\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913427    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96a01f16-fc40-4d36-8d60-4b38cb1fe296-ca-trust-extracted\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913732 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913481    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phmp9\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-kube-api-access-phmp9\") pod \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\" (UID: \"96a01f16-fc40-4d36-8d60-4b38cb1fe296\") "
Jul 27 20:53:35.913783 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913753    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:35.913832 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.913794    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:35.915882 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.915845    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:53:35.916352 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.916329    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-kube-api-access-phmp9" (OuterVolumeSpecName: "kube-api-access-phmp9") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "kube-api-access-phmp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:53:35.916352 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.916340    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:53:35.916474 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.916425    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:53:35.916511 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.916488    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:53:35.924412 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:35.924377    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a01f16-fc40-4d36-8d60-4b38cb1fe296-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "96a01f16-fc40-4d36-8d60-4b38cb1fe296" (UID: "96a01f16-fc40-4d36-8d60-4b38cb1fe296"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:53:36.014987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.014946    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-image-registry-private-configuration\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.014987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.014979    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-trusted-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.014987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.014992    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-certificates\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.015222 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.015006    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-registry-tls\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.015222 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.015017    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96a01f16-fc40-4d36-8d60-4b38cb1fe296-installation-pull-secrets\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.015222 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.015027    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-bound-sa-token\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.015222 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.015038    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96a01f16-fc40-4d36-8d60-4b38cb1fe296-ca-trust-extracted\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.015222 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.015049    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phmp9\" (UniqueName: \"kubernetes.io/projected/96a01f16-fc40-4d36-8d60-4b38cb1fe296-kube-api-access-phmp9\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:53:36.703928 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.703900    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"
Jul 27 20:53:36.703928 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.703923    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d7d7d9f5-tqmr5" event={"ID":"96a01f16-fc40-4d36-8d60-4b38cb1fe296","Type":"ContainerDied","Data":"54b2638e44d8fce8497562f49acf44c6f9c4a8e1511ba20ac57f18e86067d81d"}
Jul 27 20:53:36.704455 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.703986    2567 scope.go:117] "RemoveContainer" containerID="384242c5090a93dd0ec0240f714201ff4e3e13be6f8dd7d08b163cc6fc65b1ec"
Jul 27 20:53:36.727297 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.727265    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"]
Jul 27 20:53:36.733339 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:36.733311    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85d7d7d9f5-tqmr5"]
Jul 27 20:53:37.027408 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:37.027368    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96a01f16-fc40-4d36-8d60-4b38cb1fe296" path="/var/lib/kubelet/pods/96a01f16-fc40-4d36-8d60-4b38cb1fe296/volumes"
Jul 27 20:53:37.027769 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:37.027755    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" path="/var/lib/kubelet/pods/f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9/volumes"
Jul 27 20:53:39.719362 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:39.719329    2567 generic.go:356] "Generic (PLEG): container finished" podID="40ad3ed6-5a32-4b1b-b42d-134ba41022e8" containerID="0b5909c07e7a4427846f1a8eb83b7cc623a512fbada1568cb81ea00af1e308ad" exitCode=0
Jul 27 20:53:39.719735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:39.719381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mvhgs" event={"ID":"40ad3ed6-5a32-4b1b-b42d-134ba41022e8","Type":"ContainerDied","Data":"0b5909c07e7a4427846f1a8eb83b7cc623a512fbada1568cb81ea00af1e308ad"}
Jul 27 20:53:39.719792 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:39.719754    2567 scope.go:117] "RemoveContainer" containerID="0b5909c07e7a4427846f1a8eb83b7cc623a512fbada1568cb81ea00af1e308ad"
Jul 27 20:53:40.725677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:40.725645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-mvhgs" event={"ID":"40ad3ed6-5a32-4b1b-b42d-134ba41022e8","Type":"ContainerStarted","Data":"17e66bc756ed53e807a8937e03fb40269fbb8c35eb1c463002a55e001b0ae5a2"}
Jul 27 20:53:47.292897 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:47.292867    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:53:47.296795 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:53:47.296773    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fc47786f9-dgbbk"
Jul 27 20:54:22.901633 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.901576    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:54:22.902161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.901963    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-metric" containerID="cri-o://5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd" gracePeriod=120
Jul 27 20:54:22.902161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.901995    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="config-reloader" containerID="cri-o://e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f" gracePeriod=120
Jul 27 20:54:22.902161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.902034    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy" containerID="cri-o://3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627" gracePeriod=120
Jul 27 20:54:22.902161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.901995    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-web" containerID="cri-o://9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186" gracePeriod=120
Jul 27 20:54:22.902161 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.902025    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="prom-label-proxy" containerID="cri-o://81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2" gracePeriod=120
Jul 27 20:54:22.902448 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:22.902152    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="alertmanager" containerID="cri-o://9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1" gracePeriod=120
Jul 27 20:54:23.886994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.886962    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2" exitCode=0
Jul 27 20:54:23.886994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.886988    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627" exitCode=0
Jul 27 20:54:23.886994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.886994    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f" exitCode=0
Jul 27 20:54:23.886994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.887001    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1" exitCode=0
Jul 27 20:54:23.887256 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.887033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"}
Jul 27 20:54:23.887256 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.887096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"}
Jul 27 20:54:23.887256 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.887124    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"}
Jul 27 20:54:23.887256 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:23.887148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"}
Jul 27 20:54:24.155904 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.155878    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:24.309582 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309517    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-web\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309582 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309580    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-config-volume\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309614    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309635    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-config-out\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309658    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-metrics-client-ca\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309686    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-main-db\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309716    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-trusted-ca-bundle\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309743    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-web-config\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309768    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-main-tls\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309802    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-cluster-tls-config\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.309841 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309838    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.310350 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309872    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-tls-assets\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.310350 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.309909    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr86t\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-kube-api-access-mr86t\") pod \"8982d600-43c0-45c2-9e4f-548af8ba9704\" (UID: \"8982d600-43c0-45c2-9e4f-548af8ba9704\") "
Jul 27 20:54:24.310350 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.310105    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:24.310350 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.310317    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:24.310827 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.310765    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:24.312840 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.312802    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-config-out" (OuterVolumeSpecName: "config-out") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:54:24.313307 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.313276    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:54:24.313405 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.313383    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.313462 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.313433    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.313518 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.313452    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.313593 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.313521    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.313810 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.313789    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-config-volume" (OuterVolumeSpecName: "config-volume") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.314733 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.314709    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-kube-api-access-mr86t" (OuterVolumeSpecName: "kube-api-access-mr86t") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "kube-api-access-mr86t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:54:24.318316 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.318287    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.324646 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.324617    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-web-config" (OuterVolumeSpecName: "web-config") pod "8982d600-43c0-45c2-9e4f-548af8ba9704" (UID: "8982d600-43c0-45c2-9e4f-548af8ba9704"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410845    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr86t\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-kube-api-access-mr86t\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410875    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410886    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410895    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410905    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-config-out\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410914    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-metrics-client-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410922    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-main-db\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410931    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8982d600-43c0-45c2-9e4f-548af8ba9704-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.410931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410940    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-web-config\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.411306 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410948    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-main-tls\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.411306 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410956    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-cluster-tls-config\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.411306 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410964    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8982d600-43c0-45c2-9e4f-548af8ba9704-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.411306 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.410974    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8982d600-43c0-45c2-9e4f-548af8ba9704-tls-assets\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:54:24.893990 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.893955    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd" exitCode=0
Jul 27 20:54:24.893990 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.893987    2567 generic.go:356] "Generic (PLEG): container finished" podID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerID="9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186" exitCode=0
Jul 27 20:54:24.894181 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.894036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"}
Jul 27 20:54:24.894181 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.894111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"}
Jul 27 20:54:24.894181 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.894049    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:24.894181 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.894139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8982d600-43c0-45c2-9e4f-548af8ba9704","Type":"ContainerDied","Data":"d95b6d1d45b3abd583030c689db0089593c313103ba014dcd053981c96752f25"}
Jul 27 20:54:24.894181 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.894172    2567 scope.go:117] "RemoveContainer" containerID="81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"
Jul 27 20:54:24.903305 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.903282    2567 scope.go:117] "RemoveContainer" containerID="5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"
Jul 27 20:54:24.912936 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.912915    2567 scope.go:117] "RemoveContainer" containerID="3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"
Jul 27 20:54:24.916848 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.916828    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:54:24.920619 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.920602    2567 scope.go:117] "RemoveContainer" containerID="9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"
Jul 27 20:54:24.921589 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.921497    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:54:24.927376 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.927356    2567 scope.go:117] "RemoveContainer" containerID="e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"
Jul 27 20:54:24.934113 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.934092    2567 scope.go:117] "RemoveContainer" containerID="9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"
Jul 27 20:54:24.941061 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.940981    2567 scope.go:117] "RemoveContainer" containerID="1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"
Jul 27 20:54:24.947903 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.947877    2567 scope.go:117] "RemoveContainer" containerID="81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"
Jul 27 20:54:24.948174 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.948153    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2\": container with ID starting with 81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2 not found: ID does not exist" containerID="81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"
Jul 27 20:54:24.948253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.948185    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"} err="failed to get container status \"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2\": rpc error: code = NotFound desc = could not find container \"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2\": container with ID starting with 81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2 not found: ID does not exist"
Jul 27 20:54:24.948253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.948210    2567 scope.go:117] "RemoveContainer" containerID="5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"
Jul 27 20:54:24.948476 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.948459    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd\": container with ID starting with 5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd not found: ID does not exist" containerID="5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"
Jul 27 20:54:24.948521 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.948482    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"} err="failed to get container status \"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd\": rpc error: code = NotFound desc = could not find container \"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd\": container with ID starting with 5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd not found: ID does not exist"
Jul 27 20:54:24.948521 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.948498    2567 scope.go:117] "RemoveContainer" containerID="3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"
Jul 27 20:54:24.948762 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.948745    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627\": container with ID starting with 3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627 not found: ID does not exist" containerID="3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"
Jul 27 20:54:24.948806 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.948768    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"} err="failed to get container status \"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627\": rpc error: code = NotFound desc = could not find container \"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627\": container with ID starting with 3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627 not found: ID does not exist"
Jul 27 20:54:24.948806 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.948783    2567 scope.go:117] "RemoveContainer" containerID="9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"
Jul 27 20:54:24.949037 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.949020    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186\": container with ID starting with 9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186 not found: ID does not exist" containerID="9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"
Jul 27 20:54:24.949116 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.949041    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"} err="failed to get container status \"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186\": rpc error: code = NotFound desc = could not find container \"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186\": container with ID starting with 9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186 not found: ID does not exist"
Jul 27 20:54:24.949116 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.949063    2567 scope.go:117] "RemoveContainer" containerID="e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"
Jul 27 20:54:24.949376 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.949358    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f\": container with ID starting with e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f not found: ID does not exist" containerID="e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"
Jul 27 20:54:24.949463 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.949381    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"} err="failed to get container status \"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f\": rpc error: code = NotFound desc = could not find container \"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f\": container with ID starting with e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f not found: ID does not exist"
Jul 27 20:54:24.949463 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.949396    2567 scope.go:117] "RemoveContainer" containerID="9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.950049    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1\": container with ID starting with 9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1 not found: ID does not exist" containerID="9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950078    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"} err="failed to get container status \"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1\": rpc error: code = NotFound desc = could not find container \"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1\": container with ID starting with 9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1 not found: ID does not exist"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950099    2567 scope.go:117] "RemoveContainer" containerID="1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:54:24.950328    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414\": container with ID starting with 1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414 not found: ID does not exist" containerID="1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950347    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"} err="failed to get container status \"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414\": rpc error: code = NotFound desc = could not find container \"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414\": container with ID starting with 1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414 not found: ID does not exist"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950360    2567 scope.go:117] "RemoveContainer" containerID="81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950608    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2"} err="failed to get container status \"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2\": rpc error: code = NotFound desc = could not find container \"81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2\": container with ID starting with 81b54160b0d86397b967124c9f4855c553276a03cf35bcfb76424c2f02a152e2 not found: ID does not exist"
Jul 27 20:54:24.950632 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950627    2567 scope.go:117] "RemoveContainer" containerID="5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"
Jul 27 20:54:24.951182 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950888    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd"} err="failed to get container status \"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd\": rpc error: code = NotFound desc = could not find container \"5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd\": container with ID starting with 5dc8f059e5a255bf2002db99aa8c35b2127dc352f1a0efd49bb82a8dd1ba8bbd not found: ID does not exist"
Jul 27 20:54:24.951182 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.950903    2567 scope.go:117] "RemoveContainer" containerID="3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"
Jul 27 20:54:24.951182 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951137    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627"} err="failed to get container status \"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627\": rpc error: code = NotFound desc = could not find container \"3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627\": container with ID starting with 3cedb7b13ebbddbdf5873277cdf9782f91b242fe86d9a33b44e406fc45fb3627 not found: ID does not exist"
Jul 27 20:54:24.951182 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951160    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:54:24.951320 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951161    2567 scope.go:117] "RemoveContainer" containerID="9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951446    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" containerName="console"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951465    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" containerName="console"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951474    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="prom-label-proxy"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951481    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="prom-label-proxy"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951490    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="alertmanager"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951497    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="alertmanager"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951505    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-web"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951511    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-web"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951518    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a01f16-fc40-4d36-8d60-4b38cb1fe296" containerName="registry"
Jul 27 20:54:24.951528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951523    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a01f16-fc40-4d36-8d60-4b38cb1fe296" containerName="registry"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951539    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="init-config-reloader"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951544    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="init-config-reloader"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951550    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951572    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951517    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186"} err="failed to get container status \"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186\": rpc error: code = NotFound desc = could not find container \"9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186\": container with ID starting with 9a3364189d1d8741b5a78b3bfa0fbb4bc81dc0c58fe36291702ae64e23c37186 not found: ID does not exist"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951589    2567 scope.go:117] "RemoveContainer" containerID="e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951581    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-metric"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951637    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-metric"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951653    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="config-reloader"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951663    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="config-reloader"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951733    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d8eac6-5332-4a59-aba2-a9ee4b67ccd9" containerName="console"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951745    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-web"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951753    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a01f16-fc40-4d36-8d60-4b38cb1fe296" containerName="registry"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951761    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy-metric"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951769    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="config-reloader"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951776    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="kube-rbac-proxy"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951785    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="alertmanager"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951791    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" containerName="prom-label-proxy"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951861    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f"} err="failed to get container status \"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f\": rpc error: code = NotFound desc = could not find container \"e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f\": container with ID starting with e4bd4626e21dcacd107abb8f4b4bfa70ef8e0a4f82f328f83cd58440bf76db2f not found: ID does not exist"
Jul 27 20:54:24.951907 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.951881    2567 scope.go:117] "RemoveContainer" containerID="9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"
Jul 27 20:54:24.952539 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.952085    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1"} err="failed to get container status \"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1\": rpc error: code = NotFound desc = could not find container \"9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1\": container with ID starting with 9584c0ff675a81804894138a531802abc500d848e538c8c4d06b1ed9505deea1 not found: ID does not exist"
Jul 27 20:54:24.952539 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.952106    2567 scope.go:117] "RemoveContainer" containerID="1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"
Jul 27 20:54:24.952539 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.952274    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414"} err="failed to get container status \"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414\": rpc error: code = NotFound desc = could not find container \"1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414\": container with ID starting with 1c4708cfbd403dedb746b24143c7c3e6e36cc280f7a8e25785b974db6d6eb414 not found: ID does not exist"
Jul 27 20:54:24.957268 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.957252    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:24.960912 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.960885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 20:54:24.960987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.960885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 20:54:24.960987 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.960885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 20:54:24.961061 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.960897    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 20:54:24.961116 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.960900    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 20:54:24.961337 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.961319    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 20:54:24.961434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.961350    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 20:54:24.961434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.961364    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 20:54:24.961434 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.961373    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnf4k\""
Jul 27 20:54:24.966411 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.966394    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 20:54:24.973669 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:24.973649    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:54:25.015286 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015286 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-config-volume\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015319    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-web-config\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015344    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015404    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knnct\" (UniqueName: \"kubernetes.io/projected/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-kube-api-access-knnct\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015459    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015708 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-config-out\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015708 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015708 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.015708 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.015624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.026692 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.026654    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8982d600-43c0-45c2-9e4f-548af8ba9704" path="/var/lib/kubelet/pods/8982d600-43c0-45c2-9e4f-548af8ba9704/volumes"
Jul 27 20:54:25.116701 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.116701 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-config-volume\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.116938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-web-config\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.116938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.116938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116785    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.116938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116819    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knnct\" (UniqueName: \"kubernetes.io/projected/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-kube-api-access-knnct\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.116938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.116847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117148 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117378 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-config-out\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117432 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117432 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117801 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117525    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.117963 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.117943    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.118837 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.118810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120104    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-config-volume\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120219    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-config-out\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120834 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120811    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-web-config\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.120938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.120920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.121527 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.121498    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.122234 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.122215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.125677 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.125654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knnct\" (UniqueName: \"kubernetes.io/projected/27e2f724-8df4-4489-b9ce-f5752b8e3c9f-kube-api-access-knnct\") pod \"alertmanager-main-0\" (UID: \"27e2f724-8df4-4489-b9ce-f5752b8e3c9f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.266039 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.266006    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 20:54:25.407672 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.407640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 20:54:25.410706 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:54:25.410678    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e2f724_8df4_4489_b9ce_f5752b8e3c9f.slice/crio-c2ef8943c15da37b8baba36dcc1b6d147bf30bcd30390d773248a9c4a40cacf1 WatchSource:0}: Error finding container c2ef8943c15da37b8baba36dcc1b6d147bf30bcd30390d773248a9c4a40cacf1: Status 404 returned error can't find the container with id c2ef8943c15da37b8baba36dcc1b6d147bf30bcd30390d773248a9c4a40cacf1
Jul 27 20:54:25.899821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.899788    2567 generic.go:356] "Generic (PLEG): container finished" podID="27e2f724-8df4-4489-b9ce-f5752b8e3c9f" containerID="d26fae33d8e1450d4fa823931ca67f21711ca66901aef635f4e7996cb6f28446" exitCode=0
Jul 27 20:54:25.899985 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.899860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerDied","Data":"d26fae33d8e1450d4fa823931ca67f21711ca66901aef635f4e7996cb6f28446"}
Jul 27 20:54:25.899985 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:25.899912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"c2ef8943c15da37b8baba36dcc1b6d147bf30bcd30390d773248a9c4a40cacf1"}
Jul 27 20:54:26.908077 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.908041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"782dbeac05803c748007679c276a29a21e16c898e237aaa69b6e9440e5867adf"}
Jul 27 20:54:26.908513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.908102    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"bea2cafebf499aada8fc1df5e5125e4ed7ddd988da54d14e2e922c145d720ca5"}
Jul 27 20:54:26.908513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.908129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"e0e4579fdc0299b7572563b87f98de0e3e10fabab6824749eb6ec9f88dc12803"}
Jul 27 20:54:26.908513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.908154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"914bf5d441c1f33dfb075b82abfa546a30d3cfd6bd99dfb089c6c1420b729bc6"}
Jul 27 20:54:26.908513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.908176    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"c5af66ddbc5ad9d2029eef2cbcca86595734378b77e8755e43bad1a97b42a429"}
Jul 27 20:54:26.908513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.908201    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e2f724-8df4-4489-b9ce-f5752b8e3c9f","Type":"ContainerStarted","Data":"e796bf4bca2d2e73a8b11047a9d1cebfee7851a93e9135243cba9e491be1efd9"}
Jul 27 20:54:26.942936 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.942878    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.927779866 podStartE2EDuration="2.942861476s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.08161ms" isStatefulPod=false podCreationTimestamp="2026-07-27 20:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:54:26.940130024 +0000 UTC m=+198.303366316" watchObservedRunningTime="2026-07-27 20:54:26.942861476 +0000 UTC m=+198.306097769"
Jul 27 20:54:26.964346 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.964317    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-787b5fd694-99trj"]
Jul 27 20:54:26.968189 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.968169    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:26.972084 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.972042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 20:54:26.972538 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.972513    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 20:54:26.972762 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.972745    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 20:54:26.973717 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.973702    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q48c2\""
Jul 27 20:54:26.976339 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.976324    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 20:54:26.977693 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:26.977677    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 20:54:27.005902 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.005873    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 20:54:27.010314 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.010293    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-787b5fd694-99trj"]
Jul 27 20:54:27.034274 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-federate-client-tls\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034274 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034260    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034462 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034304    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-metrics-client-ca\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034462 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034372    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbd5j\" (UniqueName: \"kubernetes.io/projected/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-kube-api-access-fbd5j\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034462 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034428    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034735 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-telemeter-client-tls\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034871 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-serving-certs-ca-bundle\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.034980 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.034916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-secret-telemeter-client\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136060 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbd5j\" (UniqueName: \"kubernetes.io/projected/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-kube-api-access-fbd5j\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136060 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136268 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-telemeter-client-tls\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136268 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-serving-certs-ca-bundle\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136268 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-secret-telemeter-client\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136268 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-federate-client-tls\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136268 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.136502 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-metrics-client-ca\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.137009 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-metrics-client-ca\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.137009 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.136958    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-serving-certs-ca-bundle\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.137798 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.137759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.143926 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.143879    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-secret-telemeter-client\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.143926 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.143899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.144044 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.144008    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-federate-client-tls\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.144044 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.144034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-telemeter-client-tls\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.145817 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.145800    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbd5j\" (UniqueName: \"kubernetes.io/projected/c2a44616-1a3d-448d-bed6-a6d5023cb3fe-kube-api-access-fbd5j\") pod \"telemeter-client-787b5fd694-99trj\" (UID: \"c2a44616-1a3d-448d-bed6-a6d5023cb3fe\") " pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.278072 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.278046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj"
Jul 27 20:54:27.414751 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.414716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-787b5fd694-99trj"]
Jul 27 20:54:27.417889 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:54:27.417864    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a44616_1a3d_448d_bed6_a6d5023cb3fe.slice/crio-f51b22ca40f009238703603c7dc85afa964948e7937a979b75bdf63ba8b93806 WatchSource:0}: Error finding container f51b22ca40f009238703603c7dc85afa964948e7937a979b75bdf63ba8b93806: Status 404 returned error can't find the container with id f51b22ca40f009238703603c7dc85afa964948e7937a979b75bdf63ba8b93806
Jul 27 20:54:27.913840 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:27.913805    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj" event={"ID":"c2a44616-1a3d-448d-bed6-a6d5023cb3fe","Type":"ContainerStarted","Data":"f51b22ca40f009238703603c7dc85afa964948e7937a979b75bdf63ba8b93806"}
Jul 27 20:54:29.925436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:29.925406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj" event={"ID":"c2a44616-1a3d-448d-bed6-a6d5023cb3fe","Type":"ContainerStarted","Data":"d062932c73c399fbbec4912ef766a6d0b7d3d8dac9a05e6f89603586bd67c90b"}
Jul 27 20:54:29.925865 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:29.925472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj" event={"ID":"c2a44616-1a3d-448d-bed6-a6d5023cb3fe","Type":"ContainerStarted","Data":"0a400bd7ed37ddcf79a5fc954c1309dec35e309924d57f337d9ff3abaa114eef"}
Jul 27 20:54:29.925865 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:29.925495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj" event={"ID":"c2a44616-1a3d-448d-bed6-a6d5023cb3fe","Type":"ContainerStarted","Data":"f6100547e827527a40b8043dc5f555b85bb215883d0ee714d375def8d6f9177f"}
Jul 27 20:54:29.947375 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:29.947334    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-787b5fd694-99trj" podStartSLOduration=2.138893768 podStartE2EDuration="3.947319129s" totalImagesPullingTime="1.808425361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:54:29.946411211 +0000 UTC m=+201.309647545" watchObservedRunningTime="2026-07-27 20:54:29.947319129 +0000 UTC m=+201.310555421"
Jul 27 20:54:30.846162 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.846132    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6476b5ff5d-kzx7d"]
Jul 27 20:54:30.849366 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.849350    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.852032 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852002    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 20:54:30.852476 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852459    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 20:54:30.852531 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852486    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:54:30.852757 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852744    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nr66h\""
Jul 27 20:54:30.852848 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852831    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 20:54:30.852925 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852863    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:54:30.852925 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852875    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 20:54:30.853014 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.852930    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 20:54:30.864810 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.864785    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 20:54:30.866019 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.866001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6476b5ff5d-kzx7d"]
Jul 27 20:54:30.972689 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-oauth-config\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.972689 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-trusted-ca-bundle\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.973179 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-oauth-serving-cert\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.973179 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-serving-cert\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.973179 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-service-ca\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.973179 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-config\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:30.973179 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:30.972947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwq9\" (UniqueName: \"kubernetes.io/projected/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-kube-api-access-rqwq9\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.073927 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.073895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-service-ca\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074090 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.073944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-config\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074090 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.073971    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwq9\" (UniqueName: \"kubernetes.io/projected/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-kube-api-access-rqwq9\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074212 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.074183    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-oauth-config\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074278 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.074224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-trusted-ca-bundle\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074330 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.074285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-oauth-serving-cert\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074387 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.074361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-serving-cert\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074791 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.074763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-service-ca\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.074791 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.074781    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-config\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.075302 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.075278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-oauth-serving-cert\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.075390 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.075278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-trusted-ca-bundle\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.076852 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.076833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-oauth-config\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.076983 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.076962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-serving-cert\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.081868 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.081848    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwq9\" (UniqueName: \"kubernetes.io/projected/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-kube-api-access-rqwq9\") pod \"console-6476b5ff5d-kzx7d\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") " pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.159205 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.159126    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:31.293813 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.293785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6476b5ff5d-kzx7d"]
Jul 27 20:54:31.297349 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:54:31.297324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee0a639_2f8d_46a3_8e2f_2e9041cfc88f.slice/crio-077ced9f3fcb595571081d669ae0cfee0940a907ddd1567c963a0a9206e772bb WatchSource:0}: Error finding container 077ced9f3fcb595571081d669ae0cfee0940a907ddd1567c963a0a9206e772bb: Status 404 returned error can't find the container with id 077ced9f3fcb595571081d669ae0cfee0940a907ddd1567c963a0a9206e772bb
Jul 27 20:54:31.934167 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.934131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476b5ff5d-kzx7d" event={"ID":"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f","Type":"ContainerStarted","Data":"5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364"}
Jul 27 20:54:31.934362 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.934177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476b5ff5d-kzx7d" event={"ID":"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f","Type":"ContainerStarted","Data":"077ced9f3fcb595571081d669ae0cfee0940a907ddd1567c963a0a9206e772bb"}
Jul 27 20:54:31.952461 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:31.952409    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6476b5ff5d-kzx7d" podStartSLOduration=1.952389374 podStartE2EDuration="1.952389374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:54:31.951845723 +0000 UTC m=+203.315082028" watchObservedRunningTime="2026-07-27 20:54:31.952389374 +0000 UTC m=+203.315625669"
Jul 27 20:54:41.159464 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:41.159425    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:41.159946 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:41.159489    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:41.164065 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:41.164045    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:54:41.979244 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:54:41.979208    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:56:01.034137 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:01.034100    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6476b5ff5d-kzx7d"]
Jul 27 20:56:08.945776 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:08.945726    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:56:26.053716 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.053673    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6476b5ff5d-kzx7d" podUID="fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" containerName="console" containerID="cri-o://5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364" gracePeriod=15
Jul 27 20:56:26.296162 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.296134    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:56:26.359467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359378    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqwq9\" (UniqueName: \"kubernetes.io/projected/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-kube-api-access-rqwq9\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.359467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359433    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-oauth-serving-cert\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.359467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359459    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-serving-cert\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.359821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359482    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-trusted-ca-bundle\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.359821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359510    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-oauth-config\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.359821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359535    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-service-ca\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.359821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359587    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-config\") pod \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\" (UID: \"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f\") "
Jul 27 20:56:26.360021 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.359989    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-service-ca" (OuterVolumeSpecName: "service-ca") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:56:26.360070 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.360013    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:56:26.360070 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.360020    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:56:26.360137 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.360073    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-config" (OuterVolumeSpecName: "console-config") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:56:26.361833 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.361810    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-kube-api-access-rqwq9" (OuterVolumeSpecName: "kube-api-access-rqwq9") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "kube-api-access-rqwq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:56:26.362253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.362233    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:56:26.362310 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.362245    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" (UID: "fee0a639-2f8d-46a3-8e2f-2e9041cfc88f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:56:26.374577 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.374512    2567 generic.go:356] "Generic (PLEG): container finished" podID="fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" containerID="5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364" exitCode=0
Jul 27 20:56:26.374730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.374581    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6476b5ff5d-kzx7d"
Jul 27 20:56:26.374730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.374596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476b5ff5d-kzx7d" event={"ID":"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f","Type":"ContainerDied","Data":"5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364"}
Jul 27 20:56:26.374730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.374660    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6476b5ff5d-kzx7d" event={"ID":"fee0a639-2f8d-46a3-8e2f-2e9041cfc88f","Type":"ContainerDied","Data":"077ced9f3fcb595571081d669ae0cfee0940a907ddd1567c963a0a9206e772bb"}
Jul 27 20:56:26.374730 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.374686    2567 scope.go:117] "RemoveContainer" containerID="5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364"
Jul 27 20:56:26.383506 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.383488    2567 scope.go:117] "RemoveContainer" containerID="5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364"
Jul 27 20:56:26.383838 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:56:26.383819    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364\": container with ID starting with 5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364 not found: ID does not exist" containerID="5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364"
Jul 27 20:56:26.383893 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.383848    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364"} err="failed to get container status \"5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364\": rpc error: code = NotFound desc = could not find container \"5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364\": container with ID starting with 5618e486026f2580b8053e1faf79e80d6d2603400551f005c7aff8015b3c0364 not found: ID does not exist"
Jul 27 20:56:26.406506 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.406474    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6476b5ff5d-kzx7d"]
Jul 27 20:56:26.409330 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.409306    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6476b5ff5d-kzx7d"]
Jul 27 20:56:26.461063 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461031    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqwq9\" (UniqueName: \"kubernetes.io/projected/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-kube-api-access-rqwq9\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:26.461063 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461057    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-oauth-serving-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:26.461262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461072    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-serving-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:26.461262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461086    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-trusted-ca-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:26.461262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461097    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-oauth-config\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:26.461262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461106    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:26.461262 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:26.461115    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f-console-config\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:27.027961 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:27.027926    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" path="/var/lib/kubelet/pods/fee0a639-2f8d-46a3-8e2f-2e9041cfc88f/volumes"
Jul 27 20:56:39.369519 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.369483    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"]
Jul 27 20:56:39.369898 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.369776    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" containerName="console"
Jul 27 20:56:39.369898 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.369788    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" containerName="console"
Jul 27 20:56:39.369898 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.369856    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee0a639-2f8d-46a3-8e2f-2e9041cfc88f" containerName="console"
Jul 27 20:56:39.372922 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.372906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.376215 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.376199    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:56:39.376643 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.376627    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zq6x6\""
Jul 27 20:56:39.376705 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.376627    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:56:39.401574 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.401526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"]
Jul 27 20:56:39.466702 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.466669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.466702 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.466705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.466930 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.466832    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqqhz\" (UniqueName: \"kubernetes.io/projected/e43b8097-172d-4e43-9b18-b4cb5bffe609-kube-api-access-kqqhz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.567414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.567377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqqhz\" (UniqueName: \"kubernetes.io/projected/e43b8097-172d-4e43-9b18-b4cb5bffe609-kube-api-access-kqqhz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.567650 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.567426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.567650 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.567456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.567852 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.567835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.567928 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.567903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.576689 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.576666    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqqhz\" (UniqueName: \"kubernetes.io/projected/e43b8097-172d-4e43-9b18-b4cb5bffe609-kube-api-access-kqqhz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.682015 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.681935    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:39.839260 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.839134    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"]
Jul 27 20:56:39.842063 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:56:39.842031    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43b8097_172d_4e43_9b18_b4cb5bffe609.slice/crio-6dd95864bd39c5de52a0d3cd3aa28249518f4406b6d83061c5c3a1ccaf2410b0 WatchSource:0}: Error finding container 6dd95864bd39c5de52a0d3cd3aa28249518f4406b6d83061c5c3a1ccaf2410b0: Status 404 returned error can't find the container with id 6dd95864bd39c5de52a0d3cd3aa28249518f4406b6d83061c5c3a1ccaf2410b0
Jul 27 20:56:39.843913 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:39.843898    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:56:40.436006 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:40.435969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf" event={"ID":"e43b8097-172d-4e43-9b18-b4cb5bffe609","Type":"ContainerStarted","Data":"6dd95864bd39c5de52a0d3cd3aa28249518f4406b6d83061c5c3a1ccaf2410b0"}
Jul 27 20:56:46.461787 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:46.461748    2567 generic.go:356] "Generic (PLEG): container finished" podID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerID="e12f4b7c3bce758fc38daf0284f9545a6c00557d6927a7fd818ba1f88bf78f5d" exitCode=0
Jul 27 20:56:46.462225 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:46.461844    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf" event={"ID":"e43b8097-172d-4e43-9b18-b4cb5bffe609","Type":"ContainerDied","Data":"e12f4b7c3bce758fc38daf0284f9545a6c00557d6927a7fd818ba1f88bf78f5d"}
Jul 27 20:56:49.474801 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:49.474761    2567 generic.go:356] "Generic (PLEG): container finished" podID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerID="92d7c24400fca976803173985e1737f694d412fd915d0263e376bdea4df98e13" exitCode=0
Jul 27 20:56:49.475261 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:49.474844    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf" event={"ID":"e43b8097-172d-4e43-9b18-b4cb5bffe609","Type":"ContainerDied","Data":"92d7c24400fca976803173985e1737f694d412fd915d0263e376bdea4df98e13"}
Jul 27 20:56:56.511989 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:56.511952    2567 generic.go:356] "Generic (PLEG): container finished" podID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerID="adb8c2fb44af47d073de5ac5bc8adf611fdd522b2d8d486b8f3785f7c3bf9db9" exitCode=0
Jul 27 20:56:56.512436 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:56.512012    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf" event={"ID":"e43b8097-172d-4e43-9b18-b4cb5bffe609","Type":"ContainerDied","Data":"adb8c2fb44af47d073de5ac5bc8adf611fdd522b2d8d486b8f3785f7c3bf9db9"}
Jul 27 20:56:57.641955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.641928    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:57.733754 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.733720    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-bundle\") pod \"e43b8097-172d-4e43-9b18-b4cb5bffe609\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") "
Jul 27 20:56:57.733961 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.733777    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqqhz\" (UniqueName: \"kubernetes.io/projected/e43b8097-172d-4e43-9b18-b4cb5bffe609-kube-api-access-kqqhz\") pod \"e43b8097-172d-4e43-9b18-b4cb5bffe609\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") "
Jul 27 20:56:57.733961 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.733833    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-util\") pod \"e43b8097-172d-4e43-9b18-b4cb5bffe609\" (UID: \"e43b8097-172d-4e43-9b18-b4cb5bffe609\") "
Jul 27 20:56:57.734459 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.734431    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-bundle" (OuterVolumeSpecName: "bundle") pod "e43b8097-172d-4e43-9b18-b4cb5bffe609" (UID: "e43b8097-172d-4e43-9b18-b4cb5bffe609"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:56:57.736123 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.736102    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43b8097-172d-4e43-9b18-b4cb5bffe609-kube-api-access-kqqhz" (OuterVolumeSpecName: "kube-api-access-kqqhz") pod "e43b8097-172d-4e43-9b18-b4cb5bffe609" (UID: "e43b8097-172d-4e43-9b18-b4cb5bffe609"). InnerVolumeSpecName "kube-api-access-kqqhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:56:57.739247 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.739209    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-util" (OuterVolumeSpecName: "util") pod "e43b8097-172d-4e43-9b18-b4cb5bffe609" (UID: "e43b8097-172d-4e43-9b18-b4cb5bffe609"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:56:57.834861 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.834774    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:57.834861 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.834804    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqqhz\" (UniqueName: \"kubernetes.io/projected/e43b8097-172d-4e43-9b18-b4cb5bffe609-kube-api-access-kqqhz\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:57.834861 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:57.834814    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e43b8097-172d-4e43-9b18-b4cb5bffe609-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:56:58.521707 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:58.521680    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf"
Jul 27 20:56:58.521878 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:58.521674    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404v8xf" event={"ID":"e43b8097-172d-4e43-9b18-b4cb5bffe609","Type":"ContainerDied","Data":"6dd95864bd39c5de52a0d3cd3aa28249518f4406b6d83061c5c3a1ccaf2410b0"}
Jul 27 20:56:58.521878 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:56:58.521842    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dd95864bd39c5de52a0d3cd3aa28249518f4406b6d83061c5c3a1ccaf2410b0"
Jul 27 20:57:03.407938 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.407860    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"]
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408183    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="util"
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408197    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="util"
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408210    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="pull"
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408215    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="pull"
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408223    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="extract"
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408229    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="extract"
Jul 27 20:57:03.408312 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.408288    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43b8097-172d-4e43-9b18-b4cb5bffe609" containerName="extract"
Jul 27 20:57:03.464253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.464216    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"]
Jul 27 20:57:03.464435 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.464353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.467734 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.467709    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mlvmr\""
Jul 27 20:57:03.468006 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.467986    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:57:03.468141 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.468124    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 20:57:03.583043 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.582995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839e177c-3ff1-44f7-8c96-33e6f378526f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9cqf\" (UID: \"839e177c-3ff1-44f7-8c96-33e6f378526f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.583234 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.583060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84q5w\" (UniqueName: \"kubernetes.io/projected/839e177c-3ff1-44f7-8c96-33e6f378526f-kube-api-access-84q5w\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9cqf\" (UID: \"839e177c-3ff1-44f7-8c96-33e6f378526f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.683657 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.683537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84q5w\" (UniqueName: \"kubernetes.io/projected/839e177c-3ff1-44f7-8c96-33e6f378526f-kube-api-access-84q5w\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9cqf\" (UID: \"839e177c-3ff1-44f7-8c96-33e6f378526f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.683812 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.683682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839e177c-3ff1-44f7-8c96-33e6f378526f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9cqf\" (UID: \"839e177c-3ff1-44f7-8c96-33e6f378526f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.684066 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.684048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/839e177c-3ff1-44f7-8c96-33e6f378526f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9cqf\" (UID: \"839e177c-3ff1-44f7-8c96-33e6f378526f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.697713 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.697681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84q5w\" (UniqueName: \"kubernetes.io/projected/839e177c-3ff1-44f7-8c96-33e6f378526f-kube-api-access-84q5w\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9cqf\" (UID: \"839e177c-3ff1-44f7-8c96-33e6f378526f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.773486 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.773452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"
Jul 27 20:57:03.964241 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:03.964152    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf"]
Jul 27 20:57:03.973429 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:57:03.973399    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839e177c_3ff1_44f7_8c96_33e6f378526f.slice/crio-d04912fa55c87c3febb1e0887dfebc027a51b23c79102cae980190c62b440a88 WatchSource:0}: Error finding container d04912fa55c87c3febb1e0887dfebc027a51b23c79102cae980190c62b440a88: Status 404 returned error can't find the container with id d04912fa55c87c3febb1e0887dfebc027a51b23c79102cae980190c62b440a88
Jul 27 20:57:04.546507 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:04.546465    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf" event={"ID":"839e177c-3ff1-44f7-8c96-33e6f378526f","Type":"ContainerStarted","Data":"d04912fa55c87c3febb1e0887dfebc027a51b23c79102cae980190c62b440a88"}
Jul 27 20:57:06.558569 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:06.558514    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf" event={"ID":"839e177c-3ff1-44f7-8c96-33e6f378526f","Type":"ContainerStarted","Data":"4ef87631cd3b958b3e1b3f7d18ea77a1023cb86caf4175cc326b1c296b05da9c"}
Jul 27 20:57:06.616875 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:06.616820    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9cqf" podStartSLOduration=1.678112643 podStartE2EDuration="3.61680033s" totalImagesPullingTime="1.938687687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:06.616055798 +0000 UTC m=+357.979292104" watchObservedRunningTime="2026-07-27 20:57:06.61680033 +0000 UTC m=+357.980036623"
Jul 27 20:57:07.285321 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.285285    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"]
Jul 27 20:57:07.309025 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.308980    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"]
Jul 27 20:57:07.309184 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.309108    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.313290 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.313262    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zq6x6\""
Jul 27 20:57:07.313796 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.313727    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:57:07.313963 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.313814    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:57:07.418077 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.418042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdkbm\" (UniqueName: \"kubernetes.io/projected/c2b655db-7b17-4b3f-8627-78c95ea43522-kube-api-access-cdkbm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.418269 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.418097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.418269 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.418137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.519344 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.519305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdkbm\" (UniqueName: \"kubernetes.io/projected/c2b655db-7b17-4b3f-8627-78c95ea43522-kube-api-access-cdkbm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.519532 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.519357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.519532 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.519383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.519830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.519809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.519830 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.519824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.534149 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.534125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdkbm\" (UniqueName: \"kubernetes.io/projected/c2b655db-7b17-4b3f-8627-78c95ea43522-kube-api-access-cdkbm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.621137 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.621060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:07.794728 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:07.794701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"]
Jul 27 20:57:07.797264 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:57:07.797236    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b655db_7b17_4b3f_8627_78c95ea43522.slice/crio-daad51d3ca1a5014a771c157dc29580e769d25aa5822ec6ff684950527df0a21 WatchSource:0}: Error finding container daad51d3ca1a5014a771c157dc29580e769d25aa5822ec6ff684950527df0a21: Status 404 returned error can't find the container with id daad51d3ca1a5014a771c157dc29580e769d25aa5822ec6ff684950527df0a21
Jul 27 20:57:08.065079 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.065040    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-g4n2z"]
Jul 27 20:57:08.077609 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.077547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.079916 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.079893    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 20:57:08.080238 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.080223    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 20:57:08.080321 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.080236    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ftdjq\""
Jul 27 20:57:08.089680 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.089653    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-g4n2z"]
Jul 27 20:57:08.224329 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.224235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/726b2307-4b71-474a-b933-0f7363a354f8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-g4n2z\" (UID: \"726b2307-4b71-474a-b933-0f7363a354f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.224329 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.224290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jzm\" (UniqueName: \"kubernetes.io/projected/726b2307-4b71-474a-b933-0f7363a354f8-kube-api-access-w5jzm\") pod \"cert-manager-webhook-6486ffd997-g4n2z\" (UID: \"726b2307-4b71-474a-b933-0f7363a354f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.325342 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.325304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jzm\" (UniqueName: \"kubernetes.io/projected/726b2307-4b71-474a-b933-0f7363a354f8-kube-api-access-w5jzm\") pod \"cert-manager-webhook-6486ffd997-g4n2z\" (UID: \"726b2307-4b71-474a-b933-0f7363a354f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.325588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.325410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/726b2307-4b71-474a-b933-0f7363a354f8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-g4n2z\" (UID: \"726b2307-4b71-474a-b933-0f7363a354f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.337291 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.337267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/726b2307-4b71-474a-b933-0f7363a354f8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-g4n2z\" (UID: \"726b2307-4b71-474a-b933-0f7363a354f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.337399 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.337362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jzm\" (UniqueName: \"kubernetes.io/projected/726b2307-4b71-474a-b933-0f7363a354f8-kube-api-access-w5jzm\") pod \"cert-manager-webhook-6486ffd997-g4n2z\" (UID: \"726b2307-4b71-474a-b933-0f7363a354f8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.387340 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.387307    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:08.550531 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.550501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-g4n2z"]
Jul 27 20:57:08.553605 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:57:08.553572    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod726b2307_4b71_474a_b933_0f7363a354f8.slice/crio-8fc33e4467acd02c02be761da2717db00db73a23cce8c5b0cfc6c4ea83a7845b WatchSource:0}: Error finding container 8fc33e4467acd02c02be761da2717db00db73a23cce8c5b0cfc6c4ea83a7845b: Status 404 returned error can't find the container with id 8fc33e4467acd02c02be761da2717db00db73a23cce8c5b0cfc6c4ea83a7845b
Jul 27 20:57:08.567708 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.567680    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z" event={"ID":"726b2307-4b71-474a-b933-0f7363a354f8","Type":"ContainerStarted","Data":"8fc33e4467acd02c02be761da2717db00db73a23cce8c5b0cfc6c4ea83a7845b"}
Jul 27 20:57:08.569170 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.569147    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerID="cadac2bb74e591fe21abe36186cea8aa7050358078846adfadf0cb1edbf9fe68" exitCode=0
Jul 27 20:57:08.569266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.569176    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md" event={"ID":"c2b655db-7b17-4b3f-8627-78c95ea43522","Type":"ContainerDied","Data":"cadac2bb74e591fe21abe36186cea8aa7050358078846adfadf0cb1edbf9fe68"}
Jul 27 20:57:08.569266 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:08.569207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md" event={"ID":"c2b655db-7b17-4b3f-8627-78c95ea43522","Type":"ContainerStarted","Data":"daad51d3ca1a5014a771c157dc29580e769d25aa5822ec6ff684950527df0a21"}
Jul 27 20:57:12.590023 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:12.589991    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerID="ed5b69c4e25a56345299b2418ff9b8bbb63d8ed9fd68d7c7ea2231ffa04a26c5" exitCode=0
Jul 27 20:57:12.590448 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:12.590075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md" event={"ID":"c2b655db-7b17-4b3f-8627-78c95ea43522","Type":"ContainerDied","Data":"ed5b69c4e25a56345299b2418ff9b8bbb63d8ed9fd68d7c7ea2231ffa04a26c5"}
Jul 27 20:57:12.592057 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:12.592028    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z" event={"ID":"726b2307-4b71-474a-b933-0f7363a354f8","Type":"ContainerStarted","Data":"aef47a7b8758c9748e0e5196d33747b3d0bc1004c297c740ada562466ad072f5"}
Jul 27 20:57:12.592143 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:12.592078    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:12.636402 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:12.636353    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z" podStartSLOduration=1.347393107 podStartE2EDuration="4.636336182s" totalImagesPullingTime="3.288943075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:12.634374237 +0000 UTC m=+363.997610530" watchObservedRunningTime="2026-07-27 20:57:12.636336182 +0000 UTC m=+363.999572478"
Jul 27 20:57:13.599040 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:13.599002    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerID="2b29e0cb93da6fa74989fadf7a0343d1d6e74d3247eab33f7affe538a7d5d651" exitCode=0
Jul 27 20:57:13.599471 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:13.599088    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md" event={"ID":"c2b655db-7b17-4b3f-8627-78c95ea43522","Type":"ContainerDied","Data":"2b29e0cb93da6fa74989fadf7a0343d1d6e74d3247eab33f7affe538a7d5d651"}
Jul 27 20:57:14.735340 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.735313    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:14.785271 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.785239    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdkbm\" (UniqueName: \"kubernetes.io/projected/c2b655db-7b17-4b3f-8627-78c95ea43522-kube-api-access-cdkbm\") pod \"c2b655db-7b17-4b3f-8627-78c95ea43522\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") "
Jul 27 20:57:14.785468 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.785307    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-bundle\") pod \"c2b655db-7b17-4b3f-8627-78c95ea43522\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") "
Jul 27 20:57:14.785468 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.785330    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-util\") pod \"c2b655db-7b17-4b3f-8627-78c95ea43522\" (UID: \"c2b655db-7b17-4b3f-8627-78c95ea43522\") "
Jul 27 20:57:14.785762 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.785732    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-bundle" (OuterVolumeSpecName: "bundle") pod "c2b655db-7b17-4b3f-8627-78c95ea43522" (UID: "c2b655db-7b17-4b3f-8627-78c95ea43522"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:14.787529 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.787502    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b655db-7b17-4b3f-8627-78c95ea43522-kube-api-access-cdkbm" (OuterVolumeSpecName: "kube-api-access-cdkbm") pod "c2b655db-7b17-4b3f-8627-78c95ea43522" (UID: "c2b655db-7b17-4b3f-8627-78c95ea43522"). InnerVolumeSpecName "kube-api-access-cdkbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:57:14.789613 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.789589    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-util" (OuterVolumeSpecName: "util") pod "c2b655db-7b17-4b3f-8627-78c95ea43522" (UID: "c2b655db-7b17-4b3f-8627-78c95ea43522"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:14.886109 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.886019    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdkbm\" (UniqueName: \"kubernetes.io/projected/c2b655db-7b17-4b3f-8627-78c95ea43522-kube-api-access-cdkbm\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:57:14.886109 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.886047    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:57:14.886109 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:14.886057    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2b655db-7b17-4b3f-8627-78c95ea43522-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:57:15.608647 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:15.608605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md" event={"ID":"c2b655db-7b17-4b3f-8627-78c95ea43522","Type":"ContainerDied","Data":"daad51d3ca1a5014a771c157dc29580e769d25aa5822ec6ff684950527df0a21"}
Jul 27 20:57:15.608813 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:15.608666    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daad51d3ca1a5014a771c157dc29580e769d25aa5822ec6ff684950527df0a21"
Jul 27 20:57:15.608813 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:15.608619    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxd8md"
Jul 27 20:57:18.601303 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:18.601272    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-g4n2z"
Jul 27 20:57:19.982212 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982176    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"]
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982458    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="extract"
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982468    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="extract"
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982481    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="pull"
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982487    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="pull"
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982497    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="util"
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982503    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="util"
Jul 27 20:57:19.982625 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.982550    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b655db-7b17-4b3f-8627-78c95ea43522" containerName="extract"
Jul 27 20:57:19.985626 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.985607    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:19.987772 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.987750    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 20:57:19.987885 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.987774    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:57:19.988192 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.988175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-55p4s\""
Jul 27 20:57:19.995253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:19.995234    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"]
Jul 27 20:57:20.025264 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.025235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvrhw\" (UniqueName: \"kubernetes.io/projected/4151fec5-91d8-4a5a-a414-7aff07be96fb-kube-api-access-jvrhw\") pod \"openshift-lws-operator-fd8ccff4c-ghdgb\" (UID: \"4151fec5-91d8-4a5a-a414-7aff07be96fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.025428 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.025295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4151fec5-91d8-4a5a-a414-7aff07be96fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ghdgb\" (UID: \"4151fec5-91d8-4a5a-a414-7aff07be96fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.126214 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.126174    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvrhw\" (UniqueName: \"kubernetes.io/projected/4151fec5-91d8-4a5a-a414-7aff07be96fb-kube-api-access-jvrhw\") pod \"openshift-lws-operator-fd8ccff4c-ghdgb\" (UID: \"4151fec5-91d8-4a5a-a414-7aff07be96fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.126396 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.126256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4151fec5-91d8-4a5a-a414-7aff07be96fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ghdgb\" (UID: \"4151fec5-91d8-4a5a-a414-7aff07be96fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.126620 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.126605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4151fec5-91d8-4a5a-a414-7aff07be96fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ghdgb\" (UID: \"4151fec5-91d8-4a5a-a414-7aff07be96fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.136691 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.136663    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvrhw\" (UniqueName: \"kubernetes.io/projected/4151fec5-91d8-4a5a-a414-7aff07be96fb-kube-api-access-jvrhw\") pod \"openshift-lws-operator-fd8ccff4c-ghdgb\" (UID: \"4151fec5-91d8-4a5a-a414-7aff07be96fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.295246 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.295212    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"
Jul 27 20:57:20.440193 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.440170    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb"]
Jul 27 20:57:20.441913 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:57:20.441887    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4151fec5_91d8_4a5a_a414_7aff07be96fb.slice/crio-31bd79d3a9ceca2c332aea6b25e2cdb3f20271bcab86be71adad78cf9d3d55a8 WatchSource:0}: Error finding container 31bd79d3a9ceca2c332aea6b25e2cdb3f20271bcab86be71adad78cf9d3d55a8: Status 404 returned error can't find the container with id 31bd79d3a9ceca2c332aea6b25e2cdb3f20271bcab86be71adad78cf9d3d55a8
Jul 27 20:57:20.632141 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:20.632046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb" event={"ID":"4151fec5-91d8-4a5a-a414-7aff07be96fb","Type":"ContainerStarted","Data":"31bd79d3a9ceca2c332aea6b25e2cdb3f20271bcab86be71adad78cf9d3d55a8"}
Jul 27 20:57:22.644178 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:22.644139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb" event={"ID":"4151fec5-91d8-4a5a-a414-7aff07be96fb","Type":"ContainerStarted","Data":"79c53e29c3a0a36f26484e53e5daf3d27a22faed59615f1a0220eabb4d3f70f4"}
Jul 27 20:57:22.662474 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:22.662408    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ghdgb" podStartSLOduration=2.0694519749999998 podStartE2EDuration="3.662387175s" totalImagesPullingTime="1.5929352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:22.661140544 +0000 UTC m=+374.024376836" watchObservedRunningTime="2026-07-27 20:57:22.662387175 +0000 UTC m=+374.025623468"
Jul 27 20:57:25.505144 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.505107    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"]
Jul 27 20:57:25.508701 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.508683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.510781 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.510758    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:57:25.510916 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.510843    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:57:25.511352 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.511331    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zq6x6\""
Jul 27 20:57:25.516116 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.516080    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"]
Jul 27 20:57:25.566969 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.566930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.566969 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.566969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.567189 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.567017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nnnd\" (UniqueName: \"kubernetes.io/projected/696d0347-691b-4376-b8d8-4607e1dfc37f-kube-api-access-4nnnd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.667685 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.667647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nnnd\" (UniqueName: \"kubernetes.io/projected/696d0347-691b-4376-b8d8-4607e1dfc37f-kube-api-access-4nnnd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.667879 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.667716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.667879 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.667735    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.668158 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.668139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.668203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.668153    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.680275 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.680236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nnnd\" (UniqueName: \"kubernetes.io/projected/696d0347-691b-4376-b8d8-4607e1dfc37f-kube-api-access-4nnnd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.819098 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.819013    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:25.953419 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:25.953398    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"]
Jul 27 20:57:25.955291 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:57:25.955265    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696d0347_691b_4376_b8d8_4607e1dfc37f.slice/crio-6b953bf6571cbcfb117186252d3d0c9de2d8bc727bb3a1aba0d6997d1a020e6b WatchSource:0}: Error finding container 6b953bf6571cbcfb117186252d3d0c9de2d8bc727bb3a1aba0d6997d1a020e6b: Status 404 returned error can't find the container with id 6b953bf6571cbcfb117186252d3d0c9de2d8bc727bb3a1aba0d6997d1a020e6b
Jul 27 20:57:26.662618 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:26.662584    2567 generic.go:356] "Generic (PLEG): container finished" podID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerID="f7e120b8bec624c8a7a479f83b42a536b2bbd0f6ba47929a0209cb5856fabb69" exitCode=0
Jul 27 20:57:26.663128 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:26.662655    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb" event={"ID":"696d0347-691b-4376-b8d8-4607e1dfc37f","Type":"ContainerDied","Data":"f7e120b8bec624c8a7a479f83b42a536b2bbd0f6ba47929a0209cb5856fabb69"}
Jul 27 20:57:26.663128 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:26.662715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb" event={"ID":"696d0347-691b-4376-b8d8-4607e1dfc37f","Type":"ContainerStarted","Data":"6b953bf6571cbcfb117186252d3d0c9de2d8bc727bb3a1aba0d6997d1a020e6b"}
Jul 27 20:57:27.669245 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:27.669210    2567 generic.go:356] "Generic (PLEG): container finished" podID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerID="fe333dadce7d474528b307b6677c2c1800db7a6618a950883439d6dfa9ed4e62" exitCode=0
Jul 27 20:57:27.669658 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:27.669297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb" event={"ID":"696d0347-691b-4376-b8d8-4607e1dfc37f","Type":"ContainerDied","Data":"fe333dadce7d474528b307b6677c2c1800db7a6618a950883439d6dfa9ed4e62"}
Jul 27 20:57:28.676649 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:28.676618    2567 generic.go:356] "Generic (PLEG): container finished" podID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerID="b28772024ebe47a36f93fe3a28a3e9d4b5fc6a6c821c2d587a6da17382d759cb" exitCode=0
Jul 27 20:57:28.677035 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:28.676696    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb" event={"ID":"696d0347-691b-4376-b8d8-4607e1dfc37f","Type":"ContainerDied","Data":"b28772024ebe47a36f93fe3a28a3e9d4b5fc6a6c821c2d587a6da17382d759cb"}
Jul 27 20:57:29.807440 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.807415    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:29.902539 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.902511    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-bundle\") pod \"696d0347-691b-4376-b8d8-4607e1dfc37f\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") "
Jul 27 20:57:29.902709 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.902572    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-util\") pod \"696d0347-691b-4376-b8d8-4607e1dfc37f\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") "
Jul 27 20:57:29.902709 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.902666    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nnnd\" (UniqueName: \"kubernetes.io/projected/696d0347-691b-4376-b8d8-4607e1dfc37f-kube-api-access-4nnnd\") pod \"696d0347-691b-4376-b8d8-4607e1dfc37f\" (UID: \"696d0347-691b-4376-b8d8-4607e1dfc37f\") "
Jul 27 20:57:29.903195 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.903164    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-bundle" (OuterVolumeSpecName: "bundle") pod "696d0347-691b-4376-b8d8-4607e1dfc37f" (UID: "696d0347-691b-4376-b8d8-4607e1dfc37f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:29.904806 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.904784    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696d0347-691b-4376-b8d8-4607e1dfc37f-kube-api-access-4nnnd" (OuterVolumeSpecName: "kube-api-access-4nnnd") pod "696d0347-691b-4376-b8d8-4607e1dfc37f" (UID: "696d0347-691b-4376-b8d8-4607e1dfc37f"). InnerVolumeSpecName "kube-api-access-4nnnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:57:29.910633 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:29.910607    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-util" (OuterVolumeSpecName: "util") pod "696d0347-691b-4376-b8d8-4607e1dfc37f" (UID: "696d0347-691b-4376-b8d8-4607e1dfc37f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:30.003390 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:30.003361    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nnnd\" (UniqueName: \"kubernetes.io/projected/696d0347-691b-4376-b8d8-4607e1dfc37f-kube-api-access-4nnnd\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:57:30.003390 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:30.003389    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:57:30.003599 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:30.003397    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/696d0347-691b-4376-b8d8-4607e1dfc37f-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:57:30.688298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:30.688259    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb" event={"ID":"696d0347-691b-4376-b8d8-4607e1dfc37f","Type":"ContainerDied","Data":"6b953bf6571cbcfb117186252d3d0c9de2d8bc727bb3a1aba0d6997d1a020e6b"}
Jul 27 20:57:30.688298 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:30.688286    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7r5zb"
Jul 27 20:57:30.688551 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:30.688313    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b953bf6571cbcfb117186252d3d0c9de2d8bc727bb3a1aba0d6997d1a020e6b"
Jul 27 20:57:41.584174 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584137    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"]
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584437    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="util"
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584448    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="util"
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584459    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="pull"
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584465    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="pull"
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584472    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="extract"
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584477    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="extract"
Jul 27 20:57:41.584550 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.584530    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="696d0347-691b-4376-b8d8-4607e1dfc37f" containerName="extract"
Jul 27 20:57:41.590445 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.590425    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.593846 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.593819    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sqfzw\""
Jul 27 20:57:41.594003 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.593962    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:57:41.594318 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.594301    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:57:41.594381 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.594340    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:57:41.594702 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.594688    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:57:41.605451 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.605425    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"]
Jul 27 20:57:41.706528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.706494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b283a11a-87dd-4d0a-9931-3b9f8373343e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.706528 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.706526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mvx\" (UniqueName: \"kubernetes.io/projected/b283a11a-87dd-4d0a-9931-3b9f8373343e-kube-api-access-t9mvx\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.706748 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.706574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b283a11a-87dd-4d0a-9931-3b9f8373343e-manifests\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.706748 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.706640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b283a11a-87dd-4d0a-9931-3b9f8373343e-tmp\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.706748 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.706699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b283a11a-87dd-4d0a-9931-3b9f8373343e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.807503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.807465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b283a11a-87dd-4d0a-9931-3b9f8373343e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.807503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.807508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b283a11a-87dd-4d0a-9931-3b9f8373343e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.807776 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.807529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mvx\" (UniqueName: \"kubernetes.io/projected/b283a11a-87dd-4d0a-9931-3b9f8373343e-kube-api-access-t9mvx\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.807776 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.807569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b283a11a-87dd-4d0a-9931-3b9f8373343e-manifests\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.807776 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.807600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b283a11a-87dd-4d0a-9931-3b9f8373343e-tmp\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.808158 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.808125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b283a11a-87dd-4d0a-9931-3b9f8373343e-manifests\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.810292 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.810265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b283a11a-87dd-4d0a-9931-3b9f8373343e-tmp\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.810723 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.810696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b283a11a-87dd-4d0a-9931-3b9f8373343e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.810842 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.810820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b283a11a-87dd-4d0a-9931-3b9f8373343e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.816037 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.816012    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mvx\" (UniqueName: \"kubernetes.io/projected/b283a11a-87dd-4d0a-9931-3b9f8373343e-kube-api-access-t9mvx\") pod \"opendatahub-operator-controller-manager-5c6d5848fb-wwgcn\" (UID: \"b283a11a-87dd-4d0a-9931-3b9f8373343e\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:41.901109 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:41.901022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:42.084857 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:42.084835    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"]
Jul 27 20:57:42.087583 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:57:42.087518    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb283a11a_87dd_4d0a_9931_3b9f8373343e.slice/crio-236d079c83e49eccd2b6a2f45021b2c436507e1626f572e10cf992657b71ae04 WatchSource:0}: Error finding container 236d079c83e49eccd2b6a2f45021b2c436507e1626f572e10cf992657b71ae04: Status 404 returned error can't find the container with id 236d079c83e49eccd2b6a2f45021b2c436507e1626f572e10cf992657b71ae04
Jul 27 20:57:42.755744 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:42.755707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn" event={"ID":"b283a11a-87dd-4d0a-9931-3b9f8373343e","Type":"ContainerStarted","Data":"236d079c83e49eccd2b6a2f45021b2c436507e1626f572e10cf992657b71ae04"}
Jul 27 20:57:45.774408 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:45.774367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn" event={"ID":"b283a11a-87dd-4d0a-9931-3b9f8373343e","Type":"ContainerStarted","Data":"5cd074c57696c3d211467a7f72c17d38f72f347ec2002f482f2ac0e344e9fa28"}
Jul 27 20:57:46.780246 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:46.780210    2567 generic.go:356] "Generic (PLEG): container finished" podID="b283a11a-87dd-4d0a-9931-3b9f8373343e" containerID="5cd074c57696c3d211467a7f72c17d38f72f347ec2002f482f2ac0e344e9fa28" exitCode=0
Jul 27 20:57:46.780676 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:46.780295    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn" event={"ID":"b283a11a-87dd-4d0a-9931-3b9f8373343e","Type":"ContainerDied","Data":"5cd074c57696c3d211467a7f72c17d38f72f347ec2002f482f2ac0e344e9fa28"}
Jul 27 20:57:47.787349 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:47.787306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn" event={"ID":"b283a11a-87dd-4d0a-9931-3b9f8373343e","Type":"ContainerStarted","Data":"06df5e80e61ad543f1c106e4bf51416647b89faafed97185be58c8c03b758df4"}
Jul 27 20:57:47.787788 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:47.787476    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:57:47.809859 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:47.809765    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn" podStartSLOduration=2.492944428 podStartE2EDuration="6.809744952s" totalImagesPullingTime="3.219300643s" totalInitContainerRuntime="1.097499881s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:47.809299113 +0000 UTC m=+399.172535405" watchObservedRunningTime="2026-07-27 20:57:47.809744952 +0000 UTC m=+399.172981245"
Jul 27 20:57:58.794165 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:57:58.794128    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c6d5848fb-wwgcn"
Jul 27 20:58:02.496911 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.496876    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7c2jb"]
Jul 27 20:58:02.500090 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.500072    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.509883 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.509861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hncgk\""
Jul 27 20:58:02.510219 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.510205    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 20:58:02.536967 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.536935    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7c2jb"]
Jul 27 20:58:02.602279 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.602243    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4389e3-0f61-43e0-8ffd-23ad99d609f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-7c2jb\" (UID: \"8d4389e3-0f61-43e0-8ffd-23ad99d609f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.602478 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.602288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4bs\" (UniqueName: \"kubernetes.io/projected/8d4389e3-0f61-43e0-8ffd-23ad99d609f9-kube-api-access-sg4bs\") pod \"model-serving-api-54d89bd5fc-7c2jb\" (UID: \"8d4389e3-0f61-43e0-8ffd-23ad99d609f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.703635 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.703600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4389e3-0f61-43e0-8ffd-23ad99d609f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-7c2jb\" (UID: \"8d4389e3-0f61-43e0-8ffd-23ad99d609f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.703798 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.703646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4bs\" (UniqueName: \"kubernetes.io/projected/8d4389e3-0f61-43e0-8ffd-23ad99d609f9-kube-api-access-sg4bs\") pod \"model-serving-api-54d89bd5fc-7c2jb\" (UID: \"8d4389e3-0f61-43e0-8ffd-23ad99d609f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.706297 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.706275    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d4389e3-0f61-43e0-8ffd-23ad99d609f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-7c2jb\" (UID: \"8d4389e3-0f61-43e0-8ffd-23ad99d609f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.714479 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.714458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4bs\" (UniqueName: \"kubernetes.io/projected/8d4389e3-0f61-43e0-8ffd-23ad99d609f9-kube-api-access-sg4bs\") pod \"model-serving-api-54d89bd5fc-7c2jb\" (UID: \"8d4389e3-0f61-43e0-8ffd-23ad99d609f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.810025 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.809984    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:02.964291 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:02.964255    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7c2jb"]
Jul 27 20:58:02.968615 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:58:02.968580    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4389e3_0f61_43e0_8ffd_23ad99d609f9.slice/crio-77bbae344aef1a133a46ebf33dd7afe8699bce507d1b20b663c209c3b539653a WatchSource:0}: Error finding container 77bbae344aef1a133a46ebf33dd7afe8699bce507d1b20b663c209c3b539653a: Status 404 returned error can't find the container with id 77bbae344aef1a133a46ebf33dd7afe8699bce507d1b20b663c209c3b539653a
Jul 27 20:58:03.863219 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:03.863169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb" event={"ID":"8d4389e3-0f61-43e0-8ffd-23ad99d609f9","Type":"ContainerStarted","Data":"77bbae344aef1a133a46ebf33dd7afe8699bce507d1b20b663c209c3b539653a"}
Jul 27 20:58:04.868989 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:04.868953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb" event={"ID":"8d4389e3-0f61-43e0-8ffd-23ad99d609f9","Type":"ContainerStarted","Data":"fe81aef767b3c96c8ac221e8eb6ef3e9e7a5aad4417419a78d214c9ea0852cac"}
Jul 27 20:58:04.869390 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:04.869085    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:04.895078 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:04.895029    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb" podStartSLOduration=1.139546917 podStartE2EDuration="2.895012405s" totalImagesPullingTime="1.755465488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:04.894070211 +0000 UTC m=+416.257306505" watchObservedRunningTime="2026-07-27 20:58:04.895012405 +0000 UTC m=+416.258248698"
Jul 27 20:58:07.920758 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.920716    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"]
Jul 27 20:58:07.924318 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.924297    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:07.926228 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.926210    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 20:58:07.926856 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.926837    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ql59k\""
Jul 27 20:58:07.926924 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.926890    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 20:58:07.927011 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.926984    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 20:58:07.930961 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.930936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"]
Jul 27 20:58:07.938948 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.938914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edac62c3-83aa-4d93-8d00-7f5dd822948e-cert\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:07.939077 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.939014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/edac62c3-83aa-4d93-8d00-7f5dd822948e-metrics-cert\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:07.939077 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.939050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/edac62c3-83aa-4d93-8d00-7f5dd822948e-manager-config\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:07.939188 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:07.939080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrqt\" (UniqueName: \"kubernetes.io/projected/edac62c3-83aa-4d93-8d00-7f5dd822948e-kube-api-access-mhrqt\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.040151 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.040109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/edac62c3-83aa-4d93-8d00-7f5dd822948e-metrics-cert\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.040151 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.040159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/edac62c3-83aa-4d93-8d00-7f5dd822948e-manager-config\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.040413 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.040187    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrqt\" (UniqueName: \"kubernetes.io/projected/edac62c3-83aa-4d93-8d00-7f5dd822948e-kube-api-access-mhrqt\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.040474 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.040411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edac62c3-83aa-4d93-8d00-7f5dd822948e-cert\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.040899 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.040874    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/edac62c3-83aa-4d93-8d00-7f5dd822948e-manager-config\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.042900 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.042871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edac62c3-83aa-4d93-8d00-7f5dd822948e-cert\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.042997 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.042958    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/edac62c3-83aa-4d93-8d00-7f5dd822948e-metrics-cert\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.048951 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.048928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrqt\" (UniqueName: \"kubernetes.io/projected/edac62c3-83aa-4d93-8d00-7f5dd822948e-kube-api-access-mhrqt\") pod \"lws-controller-manager-7f9595876c-lghz2\" (UID: \"edac62c3-83aa-4d93-8d00-7f5dd822948e\") " pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.234848 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.234769    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:08.368689 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.368657    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"]
Jul 27 20:58:08.371911 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:58:08.371876    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedac62c3_83aa_4d93_8d00_7f5dd822948e.slice/crio-42c7d3607b3f6467a5060532807baab52f78cf1b54e757d8caeb5130fd1651e0 WatchSource:0}: Error finding container 42c7d3607b3f6467a5060532807baab52f78cf1b54e757d8caeb5130fd1651e0: Status 404 returned error can't find the container with id 42c7d3607b3f6467a5060532807baab52f78cf1b54e757d8caeb5130fd1651e0
Jul 27 20:58:08.889294 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:08.889254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2" event={"ID":"edac62c3-83aa-4d93-8d00-7f5dd822948e","Type":"ContainerStarted","Data":"42c7d3607b3f6467a5060532807baab52f78cf1b54e757d8caeb5130fd1651e0"}
Jul 27 20:58:10.900291 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:10.900252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2" event={"ID":"edac62c3-83aa-4d93-8d00-7f5dd822948e","Type":"ContainerStarted","Data":"d4c04d099cf219fa11ab5ccbf33992f1c7913a14704edca0517eb45d63495f0a"}
Jul 27 20:58:10.900737 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:10.900397    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:10.973334 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:10.973251    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2" podStartSLOduration=2.4018488749999998 podStartE2EDuration="3.973231438s" totalImagesPullingTime="1.571382563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:10.968921543 +0000 UTC m=+422.332157836" watchObservedRunningTime="2026-07-27 20:58:10.973231438 +0000 UTC m=+422.336467734"
Jul 27 20:58:15.877363 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:15.877334    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7c2jb"
Jul 27 20:58:20.502490 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.502453    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"]
Jul 27 20:58:20.512844 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.512812    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.515364 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.515343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 20:58:20.515785 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.515769    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jqqkw\""
Jul 27 20:58:20.515945 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.515914    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:58:20.516071 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.516052    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:58:20.522851 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.522825    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"]
Jul 27 20:58:20.551417 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551417 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551669 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551669 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551669 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551669 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/882534e1-5db6-4877-a6ee-220d7435e74f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551822 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/882534e1-5db6-4877-a6ee-220d7435e74f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551822 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/882534e1-5db6-4877-a6ee-220d7435e74f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.551822 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.551803    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbds\" (UniqueName: \"kubernetes.io/projected/882534e1-5db6-4877-a6ee-220d7435e74f-kube-api-access-gfbds\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652622 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652622 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652549    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/882534e1-5db6-4877-a6ee-220d7435e74f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652751 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652650    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/882534e1-5db6-4877-a6ee-220d7435e74f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652751 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/882534e1-5db6-4877-a6ee-220d7435e74f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652751 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbds\" (UniqueName: \"kubernetes.io/projected/882534e1-5db6-4877-a6ee-220d7435e74f-kube-api-access-gfbds\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652902 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652767    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652902 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652902 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.652902 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652860    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.653114 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.653046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.653114 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.652815    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.653229 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.653156    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.653285 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.653246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/882534e1-5db6-4877-a6ee-220d7435e74f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.655259 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.655236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/882534e1-5db6-4877-a6ee-220d7435e74f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.655407 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.655388    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/882534e1-5db6-4877-a6ee-220d7435e74f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.661343 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.661318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbds\" (UniqueName: \"kubernetes.io/projected/882534e1-5db6-4877-a6ee-220d7435e74f-kube-api-access-gfbds\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.661481 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.661379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/882534e1-5db6-4877-a6ee-220d7435e74f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5\" (UID: \"882534e1-5db6-4877-a6ee-220d7435e74f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.825107 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.825003    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:20.999757 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:20.999720    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"]
Jul 27 20:58:21.003344 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:58:21.003307    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882534e1_5db6_4877_a6ee_220d7435e74f.slice/crio-02c96b9d686167fb423e0c885d400a87882e91a906aa9d0274193bb7a09b7096 WatchSource:0}: Error finding container 02c96b9d686167fb423e0c885d400a87882e91a906aa9d0274193bb7a09b7096: Status 404 returned error can't find the container with id 02c96b9d686167fb423e0c885d400a87882e91a906aa9d0274193bb7a09b7096
Jul 27 20:58:21.908657 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:21.908627    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f9595876c-lghz2"
Jul 27 20:58:21.954165 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:21.954135    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5" event={"ID":"882534e1-5db6-4877-a6ee-220d7435e74f","Type":"ContainerStarted","Data":"02c96b9d686167fb423e0c885d400a87882e91a906aa9d0274193bb7a09b7096"}
Jul 27 20:58:23.976748 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:23.976707    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:58:23.977041 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:23.976783    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:58:23.977041 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:23.976815    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 20:58:24.970447 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:24.970403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5" event={"ID":"882534e1-5db6-4877-a6ee-220d7435e74f","Type":"ContainerStarted","Data":"9bde7c9ac558da75c6e04be046ed28d4e2559259bb4e6af2a82392638f99b8be"}
Jul 27 20:58:25.000644 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:25.000594    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5" podStartSLOduration=2.029605129 podStartE2EDuration="5.00057924s" totalImagesPullingTime="2.970974111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:24.999427872 +0000 UTC m=+436.362664189" watchObservedRunningTime="2026-07-27 20:58:25.00057924 +0000 UTC m=+436.363815544"
Jul 27 20:58:25.825511 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:25.825472    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:25.830692 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:25.830663    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:25.975163 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:25.975137    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:58:25.976206 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:58:25.976187    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5"
Jul 27 20:59:02.397246 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.397210    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqcvx"]
Jul 27 20:59:02.400664 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.400643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:02.403758 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.403738    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:59:02.403854 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.403737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j5cpb\""
Jul 27 20:59:02.410134 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.410110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrqr\" (UniqueName: \"kubernetes.io/projected/e5263c16-41f2-4e35-a7b5-b39db9696f73-kube-api-access-csrqr\") pod \"kuadrant-operator-catalog-kqcvx\" (UID: \"e5263c16-41f2-4e35-a7b5-b39db9696f73\") " pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:02.414464 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.414444    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:59:02.422699 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.422678    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqcvx"]
Jul 27 20:59:02.511276 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.511237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrqr\" (UniqueName: \"kubernetes.io/projected/e5263c16-41f2-4e35-a7b5-b39db9696f73-kube-api-access-csrqr\") pod \"kuadrant-operator-catalog-kqcvx\" (UID: \"e5263c16-41f2-4e35-a7b5-b39db9696f73\") " pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:02.519314 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.519284    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrqr\" (UniqueName: \"kubernetes.io/projected/e5263c16-41f2-4e35-a7b5-b39db9696f73-kube-api-access-csrqr\") pod \"kuadrant-operator-catalog-kqcvx\" (UID: \"e5263c16-41f2-4e35-a7b5-b39db9696f73\") " pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:02.686058 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.685975    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqcvx"]
Jul 27 20:59:02.686255 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.686243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:02.826049 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.825987    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqcvx"]
Jul 27 20:59:02.828252 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:02.828225    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5263c16_41f2_4e35_a7b5_b39db9696f73.slice/crio-d52405bc042c2a6368c219ac95321b6d2b3edd7be1b7589f03ed61f238eb7c00 WatchSource:0}: Error finding container d52405bc042c2a6368c219ac95321b6d2b3edd7be1b7589f03ed61f238eb7c00: Status 404 returned error can't find the container with id d52405bc042c2a6368c219ac95321b6d2b3edd7be1b7589f03ed61f238eb7c00
Jul 27 20:59:02.900603 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.900540    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vpq2x"]
Jul 27 20:59:02.904974 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.904950    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:02.916599 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.916547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vpq2x"]
Jul 27 20:59:02.917959 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:02.917932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm8bb\" (UniqueName: \"kubernetes.io/projected/644d0ccd-3371-413b-9c17-668cd5157049-kube-api-access-rm8bb\") pod \"kuadrant-operator-catalog-vpq2x\" (UID: \"644d0ccd-3371-413b-9c17-668cd5157049\") " pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:03.019448 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:03.019413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm8bb\" (UniqueName: \"kubernetes.io/projected/644d0ccd-3371-413b-9c17-668cd5157049-kube-api-access-rm8bb\") pod \"kuadrant-operator-catalog-vpq2x\" (UID: \"644d0ccd-3371-413b-9c17-668cd5157049\") " pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:03.027665 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:03.027639    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm8bb\" (UniqueName: \"kubernetes.io/projected/644d0ccd-3371-413b-9c17-668cd5157049-kube-api-access-rm8bb\") pod \"kuadrant-operator-catalog-vpq2x\" (UID: \"644d0ccd-3371-413b-9c17-668cd5157049\") " pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:03.146187 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:03.146148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx" event={"ID":"e5263c16-41f2-4e35-a7b5-b39db9696f73","Type":"ContainerStarted","Data":"d52405bc042c2a6368c219ac95321b6d2b3edd7be1b7589f03ed61f238eb7c00"}
Jul 27 20:59:03.223487 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:03.223450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:03.363172 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:03.363142    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vpq2x"]
Jul 27 20:59:03.365643 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:03.365612    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644d0ccd_3371_413b_9c17_668cd5157049.slice/crio-13406eb8f93bade27cec0b1d56f1d8bbf39a2f214313161727800796a9947268 WatchSource:0}: Error finding container 13406eb8f93bade27cec0b1d56f1d8bbf39a2f214313161727800796a9947268: Status 404 returned error can't find the container with id 13406eb8f93bade27cec0b1d56f1d8bbf39a2f214313161727800796a9947268
Jul 27 20:59:04.154078 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:04.154043    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x" event={"ID":"644d0ccd-3371-413b-9c17-668cd5157049","Type":"ContainerStarted","Data":"13406eb8f93bade27cec0b1d56f1d8bbf39a2f214313161727800796a9947268"}
Jul 27 20:59:06.164534 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.164495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x" event={"ID":"644d0ccd-3371-413b-9c17-668cd5157049","Type":"ContainerStarted","Data":"30eeaa1255088c114068a9bda7794619d9d2ea8107799929fc063bcf0980fedc"}
Jul 27 20:59:06.165901 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.165880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx" event={"ID":"e5263c16-41f2-4e35-a7b5-b39db9696f73","Type":"ContainerStarted","Data":"b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f"}
Jul 27 20:59:06.166007 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.165931    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx" podUID="e5263c16-41f2-4e35-a7b5-b39db9696f73" containerName="registry-server" containerID="cri-o://b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f" gracePeriod=2
Jul 27 20:59:06.182926 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.182884    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x" podStartSLOduration=2.412869583 podStartE2EDuration="4.182867389s" totalImagesPullingTime="1.769997806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:06.181244304 +0000 UTC m=+477.544480601" watchObservedRunningTime="2026-07-27 20:59:06.182867389 +0000 UTC m=+477.546103682"
Jul 27 20:59:06.199818 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.199768    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx" podStartSLOduration=1.89568369 podStartE2EDuration="4.199752822s" totalImagesPullingTime="2.304069132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:06.19767638 +0000 UTC m=+477.560912676" watchObservedRunningTime="2026-07-27 20:59:06.199752822 +0000 UTC m=+477.562989115"
Jul 27 20:59:06.414754 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.414694    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:06.450587 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.450544    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csrqr\" (UniqueName: \"kubernetes.io/projected/e5263c16-41f2-4e35-a7b5-b39db9696f73-kube-api-access-csrqr\") pod \"e5263c16-41f2-4e35-a7b5-b39db9696f73\" (UID: \"e5263c16-41f2-4e35-a7b5-b39db9696f73\") "
Jul 27 20:59:06.452883 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.452852    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5263c16-41f2-4e35-a7b5-b39db9696f73-kube-api-access-csrqr" (OuterVolumeSpecName: "kube-api-access-csrqr") pod "e5263c16-41f2-4e35-a7b5-b39db9696f73" (UID: "e5263c16-41f2-4e35-a7b5-b39db9696f73"). InnerVolumeSpecName "kube-api-access-csrqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:06.551772 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:06.551733    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csrqr\" (UniqueName: \"kubernetes.io/projected/e5263c16-41f2-4e35-a7b5-b39db9696f73-kube-api-access-csrqr\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:07.172654 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.172621    2567 generic.go:356] "Generic (PLEG): container finished" podID="e5263c16-41f2-4e35-a7b5-b39db9696f73" containerID="b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f" exitCode=0
Jul 27 20:59:07.173046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.172664    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx"
Jul 27 20:59:07.173046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.172708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx" event={"ID":"e5263c16-41f2-4e35-a7b5-b39db9696f73","Type":"ContainerDied","Data":"b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f"}
Jul 27 20:59:07.173046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.172751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kqcvx" event={"ID":"e5263c16-41f2-4e35-a7b5-b39db9696f73","Type":"ContainerDied","Data":"d52405bc042c2a6368c219ac95321b6d2b3edd7be1b7589f03ed61f238eb7c00"}
Jul 27 20:59:07.173046 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.172776    2567 scope.go:117] "RemoveContainer" containerID="b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f"
Jul 27 20:59:07.181810 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.181791    2567 scope.go:117] "RemoveContainer" containerID="b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f"
Jul 27 20:59:07.182064 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:59:07.182046    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f\": container with ID starting with b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f not found: ID does not exist" containerID="b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f"
Jul 27 20:59:07.182106 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.182073    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f"} err="failed to get container status \"b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f\": rpc error: code = NotFound desc = could not find container \"b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f\": container with ID starting with b12a0a5da8d7c887b66875f274df6f1b99ab24d4ab58271f1e62dd85cd579c4f not found: ID does not exist"
Jul 27 20:59:07.191842 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.191818    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqcvx"]
Jul 27 20:59:07.196023 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:07.196000    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kqcvx"]
Jul 27 20:59:09.028362 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:09.028331    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5263c16-41f2-4e35-a7b5-b39db9696f73" path="/var/lib/kubelet/pods/e5263c16-41f2-4e35-a7b5-b39db9696f73/volumes"
Jul 27 20:59:13.224144 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:13.224109    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:13.224589 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:13.224383    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:13.245586 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:13.245545    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:14.227888 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:14.227861    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vpq2x"
Jul 27 20:59:18.133784 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.133753    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"]
Jul 27 20:59:18.134157 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.134082    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5263c16-41f2-4e35-a7b5-b39db9696f73" containerName="registry-server"
Jul 27 20:59:18.134157 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.134093    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5263c16-41f2-4e35-a7b5-b39db9696f73" containerName="registry-server"
Jul 27 20:59:18.134157 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.134147    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5263c16-41f2-4e35-a7b5-b39db9696f73" containerName="registry-server"
Jul 27 20:59:18.138738 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.138719    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.140681 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.140667    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lq9jt\""
Jul 27 20:59:18.144495 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.144470    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"]
Jul 27 20:59:18.255317 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.255282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.255499 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.255382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.255499 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.255432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgm98\" (UniqueName: \"kubernetes.io/projected/cd52ec70-0c85-4aa9-846d-5c81dab41851-kube-api-access-wgm98\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.356771 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.356738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.356960 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.356790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgm98\" (UniqueName: \"kubernetes.io/projected/cd52ec70-0c85-4aa9-846d-5c81dab41851-kube-api-access-wgm98\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.356960 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.356850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.357128 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.357107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.357221 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.357204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.364501 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.364478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgm98\" (UniqueName: \"kubernetes.io/projected/cd52ec70-0c85-4aa9-846d-5c81dab41851-kube-api-access-wgm98\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.449253 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.449169    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:18.579205 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.579179    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"]
Jul 27 20:59:18.580891 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:18.580858    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd52ec70_0c85_4aa9_846d_5c81dab41851.slice/crio-cfdddd7246b51da098ff33446edf274fd1938e58fd441048f773e47ace70f79c WatchSource:0}: Error finding container cfdddd7246b51da098ff33446edf274fd1938e58fd441048f773e47ace70f79c: Status 404 returned error can't find the container with id cfdddd7246b51da098ff33446edf274fd1938e58fd441048f773e47ace70f79c
Jul 27 20:59:18.929755 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.929723    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"]
Jul 27 20:59:18.933138 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.933120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:18.941027 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:18.941003    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"]
Jul 27 20:59:19.063900 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.063850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.064059 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.063953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc6xq\" (UniqueName: \"kubernetes.io/projected/d90bac72-7bd5-44e3-a009-51bb6d83f568-kube-api-access-cc6xq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.064059 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.064001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.164880 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.164847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc6xq\" (UniqueName: \"kubernetes.io/projected/d90bac72-7bd5-44e3-a009-51bb6d83f568-kube-api-access-cc6xq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.165338 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.164970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.165338 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.165020    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.165465 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.165385    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.165465 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.165394    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.172211 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.172183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc6xq\" (UniqueName: \"kubernetes.io/projected/d90bac72-7bd5-44e3-a009-51bb6d83f568-kube-api-access-cc6xq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.230764 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.230685    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerID="a4f0eaf8acd8d2f56606a5033e9ed12fa985fa381f20ca9ce28e7fbc5ccf1ad1" exitCode=0
Jul 27 20:59:19.230764 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.230752    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75" event={"ID":"cd52ec70-0c85-4aa9-846d-5c81dab41851","Type":"ContainerDied","Data":"a4f0eaf8acd8d2f56606a5033e9ed12fa985fa381f20ca9ce28e7fbc5ccf1ad1"}
Jul 27 20:59:19.230931 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.230791    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75" event={"ID":"cd52ec70-0c85-4aa9-846d-5c81dab41851","Type":"ContainerStarted","Data":"cfdddd7246b51da098ff33446edf274fd1938e58fd441048f773e47ace70f79c"}
Jul 27 20:59:19.243342 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.243320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:19.323527 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.323498    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"]
Jul 27 20:59:19.327412 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.327386    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.334812 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.334748    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"]
Jul 27 20:59:19.381195 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.381171    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"]
Jul 27 20:59:19.383130 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:19.383093    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90bac72_7bd5_44e3_a009_51bb6d83f568.slice/crio-2e6884a9f3436137b679bc2256bc416de1d13acb538c5444e848d14298704a6d WatchSource:0}: Error finding container 2e6884a9f3436137b679bc2256bc416de1d13acb538c5444e848d14298704a6d: Status 404 returned error can't find the container with id 2e6884a9f3436137b679bc2256bc416de1d13acb538c5444e848d14298704a6d
Jul 27 20:59:19.468297 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.468261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.468447 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.468311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4fqf\" (UniqueName: \"kubernetes.io/projected/509f72ec-3a82-465d-ab80-fc023a67fdcc-kube-api-access-x4fqf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.468447 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.468364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.568940 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.568905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.569103 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.568948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4fqf\" (UniqueName: \"kubernetes.io/projected/509f72ec-3a82-465d-ab80-fc023a67fdcc-kube-api-access-x4fqf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.569103 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.568964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.569339 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.569319    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.569412 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.569350    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.576784 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.576761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4fqf\" (UniqueName: \"kubernetes.io/projected/509f72ec-3a82-465d-ab80-fc023a67fdcc-kube-api-access-x4fqf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.640402 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.640372    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:19.737081 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.736996    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"]
Jul 27 20:59:19.743217 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.743194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.756232 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.756204    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"]
Jul 27 20:59:19.792635 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.792613    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"]
Jul 27 20:59:19.794320 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:19.794298    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509f72ec_3a82_465d_ab80_fc023a67fdcc.slice/crio-87096b3fd41d041884b48d90f9f56c3dc996bd7bf9df02c61e9ea17461cfa7d0 WatchSource:0}: Error finding container 87096b3fd41d041884b48d90f9f56c3dc996bd7bf9df02c61e9ea17461cfa7d0: Status 404 returned error can't find the container with id 87096b3fd41d041884b48d90f9f56c3dc996bd7bf9df02c61e9ea17461cfa7d0
Jul 27 20:59:19.871599 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.871574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt8qz\" (UniqueName: \"kubernetes.io/projected/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-kube-api-access-dt8qz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.871687 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.871641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.871687 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.871667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.972418 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.972382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt8qz\" (UniqueName: \"kubernetes.io/projected/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-kube-api-access-dt8qz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.972623 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.972460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.972623 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.972484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.972901 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.972883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.972971 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.972907    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:19.980686 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:19.980664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt8qz\" (UniqueName: \"kubernetes.io/projected/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-kube-api-access-dt8qz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:20.054437 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.054417    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:20.180323 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:59:20.180287    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd52ec70_0c85_4aa9_846d_5c81dab41851.slice/crio-conmon-d08a3445e19048d745ec3665a993d19c2aa0f141942f74f2f3e3973efa81a393.scope\": RecentStats: unable to find data in memory cache]"
Jul 27 20:59:20.206588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.206549    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"]
Jul 27 20:59:20.208797 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:20.208769    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c1b607_41b0_4d4b_a63e_20cd0fdc4dba.slice/crio-ac2dae51e9724bb9980eca36296ec8be1b5d8b5a6711c73e3dacd038032d49cb WatchSource:0}: Error finding container ac2dae51e9724bb9980eca36296ec8be1b5d8b5a6711c73e3dacd038032d49cb: Status 404 returned error can't find the container with id ac2dae51e9724bb9980eca36296ec8be1b5d8b5a6711c73e3dacd038032d49cb
Jul 27 20:59:20.236334 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.236309    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerID="d08a3445e19048d745ec3665a993d19c2aa0f141942f74f2f3e3973efa81a393" exitCode=0
Jul 27 20:59:20.236430 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.236390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75" event={"ID":"cd52ec70-0c85-4aa9-846d-5c81dab41851","Type":"ContainerDied","Data":"d08a3445e19048d745ec3665a993d19c2aa0f141942f74f2f3e3973efa81a393"}
Jul 27 20:59:20.237620 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.237597    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb" event={"ID":"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba","Type":"ContainerStarted","Data":"ac2dae51e9724bb9980eca36296ec8be1b5d8b5a6711c73e3dacd038032d49cb"}
Jul 27 20:59:20.238964 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.238946    2567 generic.go:356] "Generic (PLEG): container finished" podID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerID="9b7ce86a5cf60c3238ab36feea0c711d0ebfda527eb51f26a44c6cae7af4816a" exitCode=0
Jul 27 20:59:20.239047 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.239030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7" event={"ID":"d90bac72-7bd5-44e3-a009-51bb6d83f568","Type":"ContainerDied","Data":"9b7ce86a5cf60c3238ab36feea0c711d0ebfda527eb51f26a44c6cae7af4816a"}
Jul 27 20:59:20.239109 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.239074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7" event={"ID":"d90bac72-7bd5-44e3-a009-51bb6d83f568","Type":"ContainerStarted","Data":"2e6884a9f3436137b679bc2256bc416de1d13acb538c5444e848d14298704a6d"}
Jul 27 20:59:20.240464 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.240442    2567 generic.go:356] "Generic (PLEG): container finished" podID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerID="5961479ab5936eb831cbdb62f7d977d6a5d54e7060375485239492eebc617d30" exitCode=0
Jul 27 20:59:20.240578 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.240503    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97" event={"ID":"509f72ec-3a82-465d-ab80-fc023a67fdcc","Type":"ContainerDied","Data":"5961479ab5936eb831cbdb62f7d977d6a5d54e7060375485239492eebc617d30"}
Jul 27 20:59:20.240578 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:20.240538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97" event={"ID":"509f72ec-3a82-465d-ab80-fc023a67fdcc","Type":"ContainerStarted","Data":"87096b3fd41d041884b48d90f9f56c3dc996bd7bf9df02c61e9ea17461cfa7d0"}
Jul 27 20:59:21.248224 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.248138    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerID="ec159e11f55e0b349afc7fdc9b0b11e0eceda45d71baef0f29553620ffaa1831" exitCode=0
Jul 27 20:59:21.248224 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.248209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75" event={"ID":"cd52ec70-0c85-4aa9-846d-5c81dab41851","Type":"ContainerDied","Data":"ec159e11f55e0b349afc7fdc9b0b11e0eceda45d71baef0f29553620ffaa1831"}
Jul 27 20:59:21.249535 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.249515    2567 generic.go:356] "Generic (PLEG): container finished" podID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerID="848291816a4b50ffeea753006eb535b6ab71e792c172c21d099f857c83187602" exitCode=0
Jul 27 20:59:21.249656 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.249598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb" event={"ID":"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba","Type":"ContainerDied","Data":"848291816a4b50ffeea753006eb535b6ab71e792c172c21d099f857c83187602"}
Jul 27 20:59:21.251626 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.251606    2567 generic.go:356] "Generic (PLEG): container finished" podID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerID="63424cda4fcfd71fa205010a90998473088a319593f4ebd9a0a27041d5930391" exitCode=0
Jul 27 20:59:21.251764 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.251719    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7" event={"ID":"d90bac72-7bd5-44e3-a009-51bb6d83f568","Type":"ContainerDied","Data":"63424cda4fcfd71fa205010a90998473088a319593f4ebd9a0a27041d5930391"}
Jul 27 20:59:21.253642 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.253624    2567 generic.go:356] "Generic (PLEG): container finished" podID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerID="2caea12049d9ee5ea1c0c74a3e3a313dc9c296c222cbdb82e0101edc49bed648" exitCode=0
Jul 27 20:59:21.253723 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:21.253679    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97" event={"ID":"509f72ec-3a82-465d-ab80-fc023a67fdcc","Type":"ContainerDied","Data":"2caea12049d9ee5ea1c0c74a3e3a313dc9c296c222cbdb82e0101edc49bed648"}
Jul 27 20:59:22.260367 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.260335    2567 generic.go:356] "Generic (PLEG): container finished" podID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerID="f0bebb3f164220821c081ade9677b4a3f47e9cddbdecebbec29dffb63d0f2c75" exitCode=0
Jul 27 20:59:22.260799 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.260423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb" event={"ID":"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba","Type":"ContainerDied","Data":"f0bebb3f164220821c081ade9677b4a3f47e9cddbdecebbec29dffb63d0f2c75"}
Jul 27 20:59:22.262603 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.262584    2567 generic.go:356] "Generic (PLEG): container finished" podID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerID="9c3d3ffc5e4aa828ed9c0438eb8426b2401eac77a532144cfd75c7156c4c2e5d" exitCode=0
Jul 27 20:59:22.262716 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.262660    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7" event={"ID":"d90bac72-7bd5-44e3-a009-51bb6d83f568","Type":"ContainerDied","Data":"9c3d3ffc5e4aa828ed9c0438eb8426b2401eac77a532144cfd75c7156c4c2e5d"}
Jul 27 20:59:22.264728 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.264709    2567 generic.go:356] "Generic (PLEG): container finished" podID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerID="044767a04f37adc069e15741839c0fd03d8d0fa26bc5844a8f21f9b3960843ab" exitCode=0
Jul 27 20:59:22.264821 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.264763    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97" event={"ID":"509f72ec-3a82-465d-ab80-fc023a67fdcc","Type":"ContainerDied","Data":"044767a04f37adc069e15741839c0fd03d8d0fa26bc5844a8f21f9b3960843ab"}
Jul 27 20:59:22.398799 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.398778    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:22.491842 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.491813    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgm98\" (UniqueName: \"kubernetes.io/projected/cd52ec70-0c85-4aa9-846d-5c81dab41851-kube-api-access-wgm98\") pod \"cd52ec70-0c85-4aa9-846d-5c81dab41851\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") "
Jul 27 20:59:22.491970 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.491853    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-bundle\") pod \"cd52ec70-0c85-4aa9-846d-5c81dab41851\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") "
Jul 27 20:59:22.492023 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.491988    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-util\") pod \"cd52ec70-0c85-4aa9-846d-5c81dab41851\" (UID: \"cd52ec70-0c85-4aa9-846d-5c81dab41851\") "
Jul 27 20:59:22.492511 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.492483    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-bundle" (OuterVolumeSpecName: "bundle") pod "cd52ec70-0c85-4aa9-846d-5c81dab41851" (UID: "cd52ec70-0c85-4aa9-846d-5c81dab41851"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:22.494064 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.494039    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd52ec70-0c85-4aa9-846d-5c81dab41851-kube-api-access-wgm98" (OuterVolumeSpecName: "kube-api-access-wgm98") pod "cd52ec70-0c85-4aa9-846d-5c81dab41851" (UID: "cd52ec70-0c85-4aa9-846d-5c81dab41851"). InnerVolumeSpecName "kube-api-access-wgm98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:22.497458 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.497426    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-util" (OuterVolumeSpecName: "util") pod "cd52ec70-0c85-4aa9-846d-5c81dab41851" (UID: "cd52ec70-0c85-4aa9-846d-5c81dab41851"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:22.593588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.593500    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:22.593588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.593522    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgm98\" (UniqueName: \"kubernetes.io/projected/cd52ec70-0c85-4aa9-846d-5c81dab41851-kube-api-access-wgm98\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:22.593588 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:22.593531    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd52ec70-0c85-4aa9-846d-5c81dab41851-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:23.271337 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.271306    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75"
Jul 27 20:59:23.271772 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.271306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75" event={"ID":"cd52ec70-0c85-4aa9-846d-5c81dab41851","Type":"ContainerDied","Data":"cfdddd7246b51da098ff33446edf274fd1938e58fd441048f773e47ace70f79c"}
Jul 27 20:59:23.271772 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.271426    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfdddd7246b51da098ff33446edf274fd1938e58fd441048f773e47ace70f79c"
Jul 27 20:59:23.273659 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.273485    2567 generic.go:356] "Generic (PLEG): container finished" podID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerID="6fed9db39f5c329f80a5efc41ed626f9d36c83a77546631473e7be32d656df67" exitCode=0
Jul 27 20:59:23.273659 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.273588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb" event={"ID":"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba","Type":"ContainerDied","Data":"6fed9db39f5c329f80a5efc41ed626f9d36c83a77546631473e7be32d656df67"}
Jul 27 20:59:23.410929 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.410904    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:23.427256 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.427234    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:23.502276 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502249    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-bundle\") pod \"509f72ec-3a82-465d-ab80-fc023a67fdcc\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") "
Jul 27 20:59:23.502414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502304    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4fqf\" (UniqueName: \"kubernetes.io/projected/509f72ec-3a82-465d-ab80-fc023a67fdcc-kube-api-access-x4fqf\") pod \"509f72ec-3a82-465d-ab80-fc023a67fdcc\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") "
Jul 27 20:59:23.502414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502326    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-util\") pod \"d90bac72-7bd5-44e3-a009-51bb6d83f568\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") "
Jul 27 20:59:23.502414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502363    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc6xq\" (UniqueName: \"kubernetes.io/projected/d90bac72-7bd5-44e3-a009-51bb6d83f568-kube-api-access-cc6xq\") pod \"d90bac72-7bd5-44e3-a009-51bb6d83f568\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") "
Jul 27 20:59:23.502414 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-util\") pod \"509f72ec-3a82-465d-ab80-fc023a67fdcc\" (UID: \"509f72ec-3a82-465d-ab80-fc023a67fdcc\") "
Jul 27 20:59:23.502641 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502445    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-bundle\") pod \"d90bac72-7bd5-44e3-a009-51bb6d83f568\" (UID: \"d90bac72-7bd5-44e3-a009-51bb6d83f568\") "
Jul 27 20:59:23.502955 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.502927    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-bundle" (OuterVolumeSpecName: "bundle") pod "509f72ec-3a82-465d-ab80-fc023a67fdcc" (UID: "509f72ec-3a82-465d-ab80-fc023a67fdcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:23.503237 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.503059    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-bundle" (OuterVolumeSpecName: "bundle") pod "d90bac72-7bd5-44e3-a009-51bb6d83f568" (UID: "d90bac72-7bd5-44e3-a009-51bb6d83f568"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:23.504620 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.504596    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90bac72-7bd5-44e3-a009-51bb6d83f568-kube-api-access-cc6xq" (OuterVolumeSpecName: "kube-api-access-cc6xq") pod "d90bac72-7bd5-44e3-a009-51bb6d83f568" (UID: "d90bac72-7bd5-44e3-a009-51bb6d83f568"). InnerVolumeSpecName "kube-api-access-cc6xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:23.505025 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.505003    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/509f72ec-3a82-465d-ab80-fc023a67fdcc-kube-api-access-x4fqf" (OuterVolumeSpecName: "kube-api-access-x4fqf") pod "509f72ec-3a82-465d-ab80-fc023a67fdcc" (UID: "509f72ec-3a82-465d-ab80-fc023a67fdcc"). InnerVolumeSpecName "kube-api-access-x4fqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:23.508101 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.508072    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-util" (OuterVolumeSpecName: "util") pod "d90bac72-7bd5-44e3-a009-51bb6d83f568" (UID: "d90bac72-7bd5-44e3-a009-51bb6d83f568"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:23.508873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.508855    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-util" (OuterVolumeSpecName: "util") pod "509f72ec-3a82-465d-ab80-fc023a67fdcc" (UID: "509f72ec-3a82-465d-ab80-fc023a67fdcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:23.603873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.603803    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:23.603873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.603826    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4fqf\" (UniqueName: \"kubernetes.io/projected/509f72ec-3a82-465d-ab80-fc023a67fdcc-kube-api-access-x4fqf\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:23.603873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.603836    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:23.603873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.603847    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc6xq\" (UniqueName: \"kubernetes.io/projected/d90bac72-7bd5-44e3-a009-51bb6d83f568-kube-api-access-cc6xq\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:23.603873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.603854    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/509f72ec-3a82-465d-ab80-fc023a67fdcc-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:23.603873 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:23.603862    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d90bac72-7bd5-44e3-a009-51bb6d83f568-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:24.279732 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.279708    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97"
Jul 27 20:59:24.280203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.279731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97" event={"ID":"509f72ec-3a82-465d-ab80-fc023a67fdcc","Type":"ContainerDied","Data":"87096b3fd41d041884b48d90f9f56c3dc996bd7bf9df02c61e9ea17461cfa7d0"}
Jul 27 20:59:24.280203 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.279775    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87096b3fd41d041884b48d90f9f56c3dc996bd7bf9df02c61e9ea17461cfa7d0"
Jul 27 20:59:24.288145 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.281946    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7" event={"ID":"d90bac72-7bd5-44e3-a009-51bb6d83f568","Type":"ContainerDied","Data":"2e6884a9f3436137b679bc2256bc416de1d13acb538c5444e848d14298704a6d"}
Jul 27 20:59:24.288145 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.282041    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e6884a9f3436137b679bc2256bc416de1d13acb538c5444e848d14298704a6d"
Jul 27 20:59:24.288145 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.282102    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7"
Jul 27 20:59:24.418676 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.418650    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:24.511994 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.511960    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt8qz\" (UniqueName: \"kubernetes.io/projected/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-kube-api-access-dt8qz\") pod \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") "
Jul 27 20:59:24.512194 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.512053    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-bundle\") pod \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") "
Jul 27 20:59:24.512194 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.512088    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-util\") pod \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\" (UID: \"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba\") "
Jul 27 20:59:24.512531 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.512509    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-bundle" (OuterVolumeSpecName: "bundle") pod "d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" (UID: "d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:24.514340 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.514318    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-kube-api-access-dt8qz" (OuterVolumeSpecName: "kube-api-access-dt8qz") pod "d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" (UID: "d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba"). InnerVolumeSpecName "kube-api-access-dt8qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:24.517411 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.517368    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-util" (OuterVolumeSpecName: "util") pod "d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" (UID: "d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:59:24.613470 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.613387    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt8qz\" (UniqueName: \"kubernetes.io/projected/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-kube-api-access-dt8qz\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:24.613470 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.613414    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-bundle\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:24.613470 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:24.613424    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba-util\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 20:59:25.289150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:25.289059    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb" event={"ID":"d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba","Type":"ContainerDied","Data":"ac2dae51e9724bb9980eca36296ec8be1b5d8b5a6711c73e3dacd038032d49cb"}
Jul 27 20:59:25.289150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:25.289097    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb"
Jul 27 20:59:25.289150 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:25.289113    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac2dae51e9724bb9980eca36296ec8be1b5d8b5a6711c73e3dacd038032d49cb"
Jul 27 20:59:35.291217 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291180    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"]
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291693    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="pull"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291713    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="pull"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291736    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="pull"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291744    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="pull"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291755    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="extract"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291764    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="extract"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291775    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="extract"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291783    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="extract"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291793    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="util"
Jul 27 20:59:35.291800 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291801    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291817    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291824    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291832    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291839    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291849    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="pull"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291856    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="pull"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291869    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291877    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291889    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291897    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291913    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291922    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="util"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291933    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="pull"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.291941    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="pull"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.292029    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.292042    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d90bac72-7bd5-44e3-a009-51bb6d83f568" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.292053    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="509f72ec-3a82-465d-ab80-fc023a67fdcc" containerName="extract"
Jul 27 20:59:35.292295 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.292064    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd52ec70-0c85-4aa9-846d-5c81dab41851" containerName="extract"
Jul 27 20:59:35.295742 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.295722    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:35.298426 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.298408    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jf97l\""
Jul 27 20:59:35.308077 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.308055    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"]
Jul 27 20:59:35.414503 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.414469    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8s82\" (UniqueName: \"kubernetes.io/projected/8c3c2650-877d-4630-8926-d5c40cbb3d81-kube-api-access-p8s82\") pod \"authorino-operator-75cc8d5cb7-vsd4t\" (UID: \"8c3c2650-877d-4630-8926-d5c40cbb3d81\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:35.515642 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.515608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8s82\" (UniqueName: \"kubernetes.io/projected/8c3c2650-877d-4630-8926-d5c40cbb3d81-kube-api-access-p8s82\") pod \"authorino-operator-75cc8d5cb7-vsd4t\" (UID: \"8c3c2650-877d-4630-8926-d5c40cbb3d81\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:35.525542 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.525512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8s82\" (UniqueName: \"kubernetes.io/projected/8c3c2650-877d-4630-8926-d5c40cbb3d81-kube-api-access-p8s82\") pod \"authorino-operator-75cc8d5cb7-vsd4t\" (UID: \"8c3c2650-877d-4630-8926-d5c40cbb3d81\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:35.606212 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.606135    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:35.737023 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:35.736987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"]
Jul 27 20:59:35.744403 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:35.744366    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3c2650_877d_4630_8926_d5c40cbb3d81.slice/crio-784aacd0189c8a4f32833d06eb41adb69553d29dc79781910916c5e0d854d347 WatchSource:0}: Error finding container 784aacd0189c8a4f32833d06eb41adb69553d29dc79781910916c5e0d854d347: Status 404 returned error can't find the container with id 784aacd0189c8a4f32833d06eb41adb69553d29dc79781910916c5e0d854d347
Jul 27 20:59:36.344373 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:36.344330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t" event={"ID":"8c3c2650-877d-4630-8926-d5c40cbb3d81","Type":"ContainerStarted","Data":"784aacd0189c8a4f32833d06eb41adb69553d29dc79781910916c5e0d854d347"}
Jul 27 20:59:38.355603 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:38.355540    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t" event={"ID":"8c3c2650-877d-4630-8926-d5c40cbb3d81","Type":"ContainerStarted","Data":"7e8ab372065d9527e0f52dd7e7a3ba4f1771e36a7863c37ce656f48838d9e0da"}
Jul 27 20:59:38.356036 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:38.355698    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:44.975435 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.975379    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t" podStartSLOduration=7.8394966539999995 podStartE2EDuration="9.975360038s" totalImagesPullingTime="2.135863384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:38.376292985 +0000 UTC m=+509.739529279" watchObservedRunningTime="2026-07-27 20:59:44.975360038 +0000 UTC m=+516.338596330"
Jul 27 20:59:44.975861 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.975506    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"]
Jul 27 20:59:44.983074 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.983053    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:44.985257 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.985235    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qm5lx\""
Jul 27 20:59:44.992184 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.992164    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"]
Jul 27 20:59:44.998798 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.998772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7nh\" (UniqueName: \"kubernetes.io/projected/a03df216-a2a0-418b-a86e-38a73598c4d1-kube-api-access-dq7nh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:44.998900 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:44.998846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03df216-a2a0-418b-a86e-38a73598c4d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:45.099920 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:45.099889    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7nh\" (UniqueName: \"kubernetes.io/projected/a03df216-a2a0-418b-a86e-38a73598c4d1-kube-api-access-dq7nh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:45.100101 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:45.099936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03df216-a2a0-418b-a86e-38a73598c4d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:45.100324 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:45.100308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03df216-a2a0-418b-a86e-38a73598c4d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:45.108093 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:45.108060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7nh\" (UniqueName: \"kubernetes.io/projected/a03df216-a2a0-418b-a86e-38a73598c4d1-kube-api-access-dq7nh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:45.294340 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:45.294303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:45.432545 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:45.432521    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"]
Jul 27 20:59:45.434425 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:45.434395    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03df216_a2a0_418b_a86e_38a73598c4d1.slice/crio-63a6432fad9838e87fef4d77ce739311f9c5a83d6a197e60f7392d9dc6c8c95e WatchSource:0}: Error finding container 63a6432fad9838e87fef4d77ce739311f9c5a83d6a197e60f7392d9dc6c8c95e: Status 404 returned error can't find the container with id 63a6432fad9838e87fef4d77ce739311f9c5a83d6a197e60f7392d9dc6c8c95e
Jul 27 20:59:46.399467 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:46.399423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm" event={"ID":"a03df216-a2a0-418b-a86e-38a73598c4d1","Type":"ContainerStarted","Data":"63a6432fad9838e87fef4d77ce739311f9c5a83d6a197e60f7392d9dc6c8c95e"}
Jul 27 20:59:49.363492 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:49.363463    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vsd4t"
Jul 27 20:59:51.428867 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:51.428835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm" event={"ID":"a03df216-a2a0-418b-a86e-38a73598c4d1","Type":"ContainerStarted","Data":"c0c1e18d27e8df470cf9d6dce5c1b237d4ddf01218004c123e8e7c0527683bab"}
Jul 27 20:59:51.429252 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:51.428950    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 20:59:51.447808 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:51.447754    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm" podStartSLOduration=1.559427959 podStartE2EDuration="7.447737906s" totalImagesPullingTime="5.888309947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:51.446669258 +0000 UTC m=+522.809905552" watchObservedRunningTime="2026-07-27 20:59:51.447737906 +0000 UTC m=+522.810974199"
Jul 27 20:59:54.111034 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.110997    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"]
Jul 27 20:59:54.114681 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.114661    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.117654 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.117633    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 20:59:54.117786 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.117632    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 20:59:54.117786 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.117688    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lq9jt\""
Jul 27 20:59:54.124424 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.124403    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"]
Jul 27 20:59:54.187239 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.187210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13a43250-07a6-4102-9fa1-3ac5d399b32c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.187424 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.187258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a43250-07a6-4102-9fa1-3ac5d399b32c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.187424 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.187334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9c26\" (UniqueName: \"kubernetes.io/projected/13a43250-07a6-4102-9fa1-3ac5d399b32c-kube-api-access-l9c26\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.288513 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.288482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13a43250-07a6-4102-9fa1-3ac5d399b32c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.288704 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.288526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a43250-07a6-4102-9fa1-3ac5d399b32c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.288704 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:59:54.288653    2567 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 20:59:54.289133 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.288696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c26\" (UniqueName: \"kubernetes.io/projected/13a43250-07a6-4102-9fa1-3ac5d399b32c-kube-api-access-l9c26\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.289133 ip-10-0-131-91 kubenswrapper[2567]: E0727 20:59:54.288708    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13a43250-07a6-4102-9fa1-3ac5d399b32c-plugin-serving-cert podName:13a43250-07a6-4102-9fa1-3ac5d399b32c nodeName:}" failed. No retries permitted until 2026-07-27 20:59:54.788690695 +0000 UTC m=+526.151926970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/13a43250-07a6-4102-9fa1-3ac5d399b32c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zglqb" (UID: "13a43250-07a6-4102-9fa1-3ac5d399b32c") : secret "plugin-serving-cert" not found
Jul 27 20:59:54.289239 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.289200    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13a43250-07a6-4102-9fa1-3ac5d399b32c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.297784 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.297756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9c26\" (UniqueName: \"kubernetes.io/projected/13a43250-07a6-4102-9fa1-3ac5d399b32c-kube-api-access-l9c26\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.793003 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.792968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a43250-07a6-4102-9fa1-3ac5d399b32c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:54.795537 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:54.795517    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a43250-07a6-4102-9fa1-3ac5d399b32c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zglqb\" (UID: \"13a43250-07a6-4102-9fa1-3ac5d399b32c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:55.024261 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:55.024231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"
Jul 27 20:59:55.190173 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:55.190150    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb"]
Jul 27 20:59:55.191935 ip-10-0-131-91 kubenswrapper[2567]: W0727 20:59:55.191909    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13a43250_07a6_4102_9fa1_3ac5d399b32c.slice/crio-f1378001494f88db2fa9d07632c531586d85c9dcdce33ce9fce827a9d57ead13 WatchSource:0}: Error finding container f1378001494f88db2fa9d07632c531586d85c9dcdce33ce9fce827a9d57ead13: Status 404 returned error can't find the container with id f1378001494f88db2fa9d07632c531586d85c9dcdce33ce9fce827a9d57ead13
Jul 27 20:59:55.451302 ip-10-0-131-91 kubenswrapper[2567]: I0727 20:59:55.451216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb" event={"ID":"13a43250-07a6-4102-9fa1-3ac5d399b32c","Type":"ContainerStarted","Data":"f1378001494f88db2fa9d07632c531586d85c9dcdce33ce9fce827a9d57ead13"}
Jul 27 21:00:02.436839 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:02.436754    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:04.201399 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.201358    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"]
Jul 27 21:00:04.201916 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.201608    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" containerName="manager" containerID="cri-o://c0c1e18d27e8df470cf9d6dce5c1b237d4ddf01218004c123e8e7c0527683bab" gracePeriod=2
Jul 27 21:00:04.219307 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.219274    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"]
Jul 27 21:00:04.232813 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:04.232765    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a03df216-a2a0-418b-a86e-38a73598c4d1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-g58xm\": pods \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:04.252071 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.252039    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"]
Jul 27 21:00:04.252448 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.252434    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" containerName="manager"
Jul 27 21:00:04.252448 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.252450    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" containerName="manager"
Jul 27 21:00:04.252625 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.252551    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" containerName="manager"
Jul 27 21:00:04.255847 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.255824    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.294848 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.294807    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"]
Jul 27 21:00:04.304624 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:04.304578    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" is forbidden: User \"system:node:ip-10-0-131-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-91.ec2.internal' and this object" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:04.388082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.388047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt5bn\" (UniqueName: \"kubernetes.io/projected/920d3196-e44c-4cd1-97c4-24484df49fbe-kube-api-access-xt5bn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9wddc\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.388255 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.388115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/920d3196-e44c-4cd1-97c4-24484df49fbe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9wddc\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.489423 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.489323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt5bn\" (UniqueName: \"kubernetes.io/projected/920d3196-e44c-4cd1-97c4-24484df49fbe-kube-api-access-xt5bn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9wddc\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.489423 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.489396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/920d3196-e44c-4cd1-97c4-24484df49fbe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9wddc\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.489849 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.489815    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/920d3196-e44c-4cd1-97c4-24484df49fbe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9wddc\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.499105 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.499082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt5bn\" (UniqueName: \"kubernetes.io/projected/920d3196-e44c-4cd1-97c4-24484df49fbe-kube-api-access-xt5bn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9wddc\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:04.597466 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:04.597428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:16.588882 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.588773    2567 generic.go:356] "Generic (PLEG): container finished" podID="a03df216-a2a0-418b-a86e-38a73598c4d1" containerID="c0c1e18d27e8df470cf9d6dce5c1b237d4ddf01218004c123e8e7c0527683bab" exitCode=0
Jul 27 21:00:16.676265 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.676236    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"]
Jul 27 21:00:16.676785 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.676767    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:16.677165 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:00:16.677129    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920d3196_e44c_4cd1_97c4_24484df49fbe.slice/crio-69f5a155ed64165c0a5a8a2deb618acc2264436a49b9b8329a937e5736e7394f WatchSource:0}: Error finding container 69f5a155ed64165c0a5a8a2deb618acc2264436a49b9b8329a937e5736e7394f: Status 404 returned error can't find the container with id 69f5a155ed64165c0a5a8a2deb618acc2264436a49b9b8329a937e5736e7394f
Jul 27 21:00:16.678465 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:16.678431    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" is forbidden: User \"system:node:ip-10-0-131-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-91.ec2.internal' and this object" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:16.807776 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.807689    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03df216-a2a0-418b-a86e-38a73598c4d1-extensions-socket-volume\") pod \"a03df216-a2a0-418b-a86e-38a73598c4d1\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") "
Jul 27 21:00:16.807776 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.807766    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7nh\" (UniqueName: \"kubernetes.io/projected/a03df216-a2a0-418b-a86e-38a73598c4d1-kube-api-access-dq7nh\") pod \"a03df216-a2a0-418b-a86e-38a73598c4d1\" (UID: \"a03df216-a2a0-418b-a86e-38a73598c4d1\") "
Jul 27 21:00:16.808172 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.808148    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03df216-a2a0-418b-a86e-38a73598c4d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a03df216-a2a0-418b-a86e-38a73598c4d1" (UID: "a03df216-a2a0-418b-a86e-38a73598c4d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:16.809949 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.809917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03df216-a2a0-418b-a86e-38a73598c4d1-kube-api-access-dq7nh" (OuterVolumeSpecName: "kube-api-access-dq7nh") pod "a03df216-a2a0-418b-a86e-38a73598c4d1" (UID: "a03df216-a2a0-418b-a86e-38a73598c4d1"). InnerVolumeSpecName "kube-api-access-dq7nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:16.909109 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.909068    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a03df216-a2a0-418b-a86e-38a73598c4d1-extensions-socket-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:00:16.909109 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:16.909101    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq7nh\" (UniqueName: \"kubernetes.io/projected/a03df216-a2a0-418b-a86e-38a73598c4d1-kube-api-access-dq7nh\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:00:17.028314 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.028282    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" path="/var/lib/kubelet/pods/a03df216-a2a0-418b-a86e-38a73598c4d1/volumes"
Jul 27 21:00:17.595579 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.595525    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc" event={"ID":"920d3196-e44c-4cd1-97c4-24484df49fbe","Type":"ContainerStarted","Data":"4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53"}
Jul 27 21:00:17.596034 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.595607    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc" event={"ID":"920d3196-e44c-4cd1-97c4-24484df49fbe","Type":"ContainerStarted","Data":"69f5a155ed64165c0a5a8a2deb618acc2264436a49b9b8329a937e5736e7394f"}
Jul 27 21:00:17.596034 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.595759    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:17.597124 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.597094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb" event={"ID":"13a43250-07a6-4102-9fa1-3ac5d399b32c","Type":"ContainerStarted","Data":"b73591f9763c2c150963d34fd7064906b2e87097e8ad37892f0f9f66072a14ac"}
Jul 27 21:00:17.598261 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.598245    2567 scope.go:117] "RemoveContainer" containerID="c0c1e18d27e8df470cf9d6dce5c1b237d4ddf01218004c123e8e7c0527683bab"
Jul 27 21:00:17.598340 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.598247    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:17.630841 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:17.630818    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" is forbidden: User \"system:node:ip-10-0-131-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-91.ec2.internal' and this object" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:17.632303 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.632259    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc" podStartSLOduration=13.632243952 podStartE2EDuration="13.632243952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:17.628192415 +0000 UTC m=+548.991428708" watchObservedRunningTime="2026-07-27 21:00:17.632243952 +0000 UTC m=+548.995480245"
Jul 27 21:00:17.661457 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:17.661412    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zglqb" podStartSLOduration=2.227705067 podStartE2EDuration="23.661396461s" totalImagesPullingTime="21.433691394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:17.659059457 +0000 UTC m=+549.022295750" watchObservedRunningTime="2026-07-27 21:00:17.661396461 +0000 UTC m=+549.024632754"
Jul 27 21:00:19.027884 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:19.027843    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g58xm\" is forbidden: User \"system:node:ip-10-0-131-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-91.ec2.internal' and this object" podUID="a03df216-a2a0-418b-a86e-38a73598c4d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g58xm"
Jul 27 21:00:20.061123 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.060800    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"]
Jul 27 21:00:20.061123 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.061015    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc" podUID="920d3196-e44c-4cd1-97c4-24484df49fbe" containerName="manager" containerID="cri-o://4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53" gracePeriod=10
Jul 27 21:00:20.309606 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.309581    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:20.352845 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.352764    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"]
Jul 27 21:00:20.353200 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.353187    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="920d3196-e44c-4cd1-97c4-24484df49fbe" containerName="manager"
Jul 27 21:00:20.353247 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.353205    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="920d3196-e44c-4cd1-97c4-24484df49fbe" containerName="manager"
Jul 27 21:00:20.353304 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.353294    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="920d3196-e44c-4cd1-97c4-24484df49fbe" containerName="manager"
Jul 27 21:00:20.356338 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.356318    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.384815 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.381862    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"]
Jul 27 21:00:20.441501 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.441465    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt5bn\" (UniqueName: \"kubernetes.io/projected/920d3196-e44c-4cd1-97c4-24484df49fbe-kube-api-access-xt5bn\") pod \"920d3196-e44c-4cd1-97c4-24484df49fbe\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") "
Jul 27 21:00:20.441501 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.441507    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/920d3196-e44c-4cd1-97c4-24484df49fbe-extensions-socket-volume\") pod \"920d3196-e44c-4cd1-97c4-24484df49fbe\" (UID: \"920d3196-e44c-4cd1-97c4-24484df49fbe\") "
Jul 27 21:00:20.441981 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.441948    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/920d3196-e44c-4cd1-97c4-24484df49fbe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "920d3196-e44c-4cd1-97c4-24484df49fbe" (UID: "920d3196-e44c-4cd1-97c4-24484df49fbe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:00:20.443720 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.443695    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/920d3196-e44c-4cd1-97c4-24484df49fbe-kube-api-access-xt5bn" (OuterVolumeSpecName: "kube-api-access-xt5bn") pod "920d3196-e44c-4cd1-97c4-24484df49fbe" (UID: "920d3196-e44c-4cd1-97c4-24484df49fbe"). InnerVolumeSpecName "kube-api-access-xt5bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:20.542331 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.542296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfn7p\" (UniqueName: \"kubernetes.io/projected/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-kube-api-access-wfn7p\") pod \"kuadrant-operator-controller-manager-86878c769f-lgzdt\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.542469 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.542349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lgzdt\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.542469 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.542442    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt5bn\" (UniqueName: \"kubernetes.io/projected/920d3196-e44c-4cd1-97c4-24484df49fbe-kube-api-access-xt5bn\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:00:20.542469 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.542455    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/920d3196-e44c-4cd1-97c4-24484df49fbe-extensions-socket-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:00:20.615713 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.615628    2567 generic.go:356] "Generic (PLEG): container finished" podID="920d3196-e44c-4cd1-97c4-24484df49fbe" containerID="4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53" exitCode=0
Jul 27 21:00:20.615713 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.615680    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"
Jul 27 21:00:20.615713 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.615699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc" event={"ID":"920d3196-e44c-4cd1-97c4-24484df49fbe","Type":"ContainerDied","Data":"4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53"}
Jul 27 21:00:20.615907 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.615753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc" event={"ID":"920d3196-e44c-4cd1-97c4-24484df49fbe","Type":"ContainerDied","Data":"69f5a155ed64165c0a5a8a2deb618acc2264436a49b9b8329a937e5736e7394f"}
Jul 27 21:00:20.615907 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.615784    2567 scope.go:117] "RemoveContainer" containerID="4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53"
Jul 27 21:00:20.624894 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.624877    2567 scope.go:117] "RemoveContainer" containerID="4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53"
Jul 27 21:00:20.625153 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:20.625131    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53\": container with ID starting with 4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53 not found: ID does not exist" containerID="4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53"
Jul 27 21:00:20.625226 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.625161    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53"} err="failed to get container status \"4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53\": rpc error: code = NotFound desc = could not find container \"4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53\": container with ID starting with 4cbe756855d0e4d59b472c79d6a61bf1de3301165382b93df4256faa4cba0d53 not found: ID does not exist"
Jul 27 21:00:20.639603 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.639581    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"]
Jul 27 21:00:20.643267 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.643248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfn7p\" (UniqueName: \"kubernetes.io/projected/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-kube-api-access-wfn7p\") pod \"kuadrant-operator-controller-manager-86878c769f-lgzdt\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.643332 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.643292    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lgzdt\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.643640 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.643623    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lgzdt\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.648838 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.648820    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9wddc"]
Jul 27 21:00:20.652681 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.652664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfn7p\" (UniqueName: \"kubernetes.io/projected/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-kube-api-access-wfn7p\") pod \"kuadrant-operator-controller-manager-86878c769f-lgzdt\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.666433 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.666414    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:20.804995 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:20.804972    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"]
Jul 27 21:00:20.807364 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:00:20.807338    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ef1d78_3b23_4f4d_ad08_d3f3052b40d1.slice/crio-58700fe4b627e054de7c13a21ea5318bd8049389a047496115b215ec93d436c6 WatchSource:0}: Error finding container 58700fe4b627e054de7c13a21ea5318bd8049389a047496115b215ec93d436c6: Status 404 returned error can't find the container with id 58700fe4b627e054de7c13a21ea5318bd8049389a047496115b215ec93d436c6
Jul 27 21:00:21.029228 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:21.029197    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="920d3196-e44c-4cd1-97c4-24484df49fbe" path="/var/lib/kubelet/pods/920d3196-e44c-4cd1-97c4-24484df49fbe/volumes"
Jul 27 21:00:21.623784 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:21.623744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt" event={"ID":"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1","Type":"ContainerStarted","Data":"28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc"}
Jul 27 21:00:21.623784 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:21.623794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt" event={"ID":"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1","Type":"ContainerStarted","Data":"58700fe4b627e054de7c13a21ea5318bd8049389a047496115b215ec93d436c6"}
Jul 27 21:00:21.624296 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:21.623863    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:21.644309 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:21.644264    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt" podStartSLOduration=1.64424606 podStartE2EDuration="1.64424606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:21.642764997 +0000 UTC m=+553.006001289" watchObservedRunningTime="2026-07-27 21:00:21.64424606 +0000 UTC m=+553.007482352"
Jul 27 21:00:32.632470 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:32.632436    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:00:36.480761 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.480728    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"]
Jul 27 21:00:36.536814 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.536781    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"]
Jul 27 21:00:36.536981 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.536913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.538834 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.538812    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nqhqs\""
Jul 27 21:00:36.575043 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8nf2\" (UniqueName: \"kubernetes.io/projected/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-kube-api-access-n8nf2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575153    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575316 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575316 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575267    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575391 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575391 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.575462 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.575403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676313 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676498 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676498 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676498 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676698 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676698 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8nf2\" (UniqueName: \"kubernetes.io/projected/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-kube-api-access-n8nf2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.676809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.676796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.677183 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.677161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.677257 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.677180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.677257 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.677159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.679401 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.679379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.679509 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.679467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.684781 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.684758    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.684973 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.684951    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8nf2\" (UniqueName: \"kubernetes.io/projected/5284e6c3-64e0-45cd-b542-c34cce2aa7cf-kube-api-access-n8nf2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8tm2q\" (UID: \"5284e6c3-64e0-45cd-b542-c34cce2aa7cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:36.848661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:36.848620    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:37.078856 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.078828    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"]
Jul 27 21:00:37.081243 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:00:37.081214    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5284e6c3_64e0_45cd_b542_c34cce2aa7cf.slice/crio-2682ebd9f21fe80b5cb90d4a94a88d66ac623303d03cb981397d804532e12f5f WatchSource:0}: Error finding container 2682ebd9f21fe80b5cb90d4a94a88d66ac623303d03cb981397d804532e12f5f: Status 404 returned error can't find the container with id 2682ebd9f21fe80b5cb90d4a94a88d66ac623303d03cb981397d804532e12f5f
Jul 27 21:00:37.083895 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.083861    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:00:37.083979 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.083946    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:00:37.084034 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.083984    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:00:37.714360 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.714325    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" event={"ID":"5284e6c3-64e0-45cd-b542-c34cce2aa7cf","Type":"ContainerStarted","Data":"b6b03c24dd9e899cf0471e1c781efaed705569dc53ca15b503328fc1b85b483c"}
Jul 27 21:00:37.714799 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.714404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" event={"ID":"5284e6c3-64e0-45cd-b542-c34cce2aa7cf","Type":"ContainerStarted","Data":"2682ebd9f21fe80b5cb90d4a94a88d66ac623303d03cb981397d804532e12f5f"}
Jul 27 21:00:37.735628 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.735577    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" podStartSLOduration=1.735541309 podStartE2EDuration="1.735541309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:37.733181166 +0000 UTC m=+569.096417453" watchObservedRunningTime="2026-07-27 21:00:37.735541309 +0000 UTC m=+569.098777603"
Jul 27 21:00:37.849502 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:37.849468    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:38.853858 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:38.853826    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:39.725704 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:39.725671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:39.726654 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:39.726635    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:00:51.216071 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.216038    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mfbc2"]
Jul 27 21:00:51.251250 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.251222    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mfbc2"]
Jul 27 21:00:51.251407 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.251321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:51.253420 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.253401    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-csp79\""
Jul 27 21:00:51.312097 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.312061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2htc\" (UniqueName: \"kubernetes.io/projected/6edd352a-af9f-4dd4-88e0-57cbdce35bb1-kube-api-access-m2htc\") pod \"authorino-58cd955675-mfbc2\" (UID: \"6edd352a-af9f-4dd4-88e0-57cbdce35bb1\") " pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:51.412919 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.412886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2htc\" (UniqueName: \"kubernetes.io/projected/6edd352a-af9f-4dd4-88e0-57cbdce35bb1-kube-api-access-m2htc\") pod \"authorino-58cd955675-mfbc2\" (UID: \"6edd352a-af9f-4dd4-88e0-57cbdce35bb1\") " pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:51.421596 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.421538    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2htc\" (UniqueName: \"kubernetes.io/projected/6edd352a-af9f-4dd4-88e0-57cbdce35bb1-kube-api-access-m2htc\") pod \"authorino-58cd955675-mfbc2\" (UID: \"6edd352a-af9f-4dd4-88e0-57cbdce35bb1\") " pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:51.562103 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.562065    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:51.702693 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.702667    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mfbc2"]
Jul 27 21:00:51.704640 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:00:51.704613    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6edd352a_af9f_4dd4_88e0_57cbdce35bb1.slice/crio-dc28164620c881496abbda12278d885a04fb87661be3d6350704ae3df3c0a321 WatchSource:0}: Error finding container dc28164620c881496abbda12278d885a04fb87661be3d6350704ae3df3c0a321: Status 404 returned error can't find the container with id dc28164620c881496abbda12278d885a04fb87661be3d6350704ae3df3c0a321
Jul 27 21:00:51.790642 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:51.790606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mfbc2" event={"ID":"6edd352a-af9f-4dd4-88e0-57cbdce35bb1","Type":"ContainerStarted","Data":"dc28164620c881496abbda12278d885a04fb87661be3d6350704ae3df3c0a321"}
Jul 27 21:00:55.817577 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:55.817515    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mfbc2" event={"ID":"6edd352a-af9f-4dd4-88e0-57cbdce35bb1","Type":"ContainerStarted","Data":"4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a"}
Jul 27 21:00:55.830471 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:55.830412    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mfbc2" podStartSLOduration=1.660567478 podStartE2EDuration="4.830392486s" totalImagesPullingTime="3.169825008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:55.830352173 +0000 UTC m=+587.193588467" watchObservedRunningTime="2026-07-27 21:00:55.830392486 +0000 UTC m=+587.193628777"
Jul 27 21:00:56.568519 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:56.568486    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mfbc2"]
Jul 27 21:00:57.828626 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:57.828580    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mfbc2" podUID="6edd352a-af9f-4dd4-88e0-57cbdce35bb1" containerName="authorino" containerID="cri-o://4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a" gracePeriod=30
Jul 27 21:00:58.089528 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.089471    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:58.175289 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.175251    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2htc\" (UniqueName: \"kubernetes.io/projected/6edd352a-af9f-4dd4-88e0-57cbdce35bb1-kube-api-access-m2htc\") pod \"6edd352a-af9f-4dd4-88e0-57cbdce35bb1\" (UID: \"6edd352a-af9f-4dd4-88e0-57cbdce35bb1\") "
Jul 27 21:00:58.177458 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.177432    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6edd352a-af9f-4dd4-88e0-57cbdce35bb1-kube-api-access-m2htc" (OuterVolumeSpecName: "kube-api-access-m2htc") pod "6edd352a-af9f-4dd4-88e0-57cbdce35bb1" (UID: "6edd352a-af9f-4dd4-88e0-57cbdce35bb1"). InnerVolumeSpecName "kube-api-access-m2htc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:00:58.276874 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.276835    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2htc\" (UniqueName: \"kubernetes.io/projected/6edd352a-af9f-4dd4-88e0-57cbdce35bb1-kube-api-access-m2htc\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:00:58.834935 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.834897    2567 generic.go:356] "Generic (PLEG): container finished" podID="6edd352a-af9f-4dd4-88e0-57cbdce35bb1" containerID="4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a" exitCode=0
Jul 27 21:00:58.835381 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.834949    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mfbc2"
Jul 27 21:00:58.835381 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.835020    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mfbc2" event={"ID":"6edd352a-af9f-4dd4-88e0-57cbdce35bb1","Type":"ContainerDied","Data":"4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a"}
Jul 27 21:00:58.835381 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.835058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mfbc2" event={"ID":"6edd352a-af9f-4dd4-88e0-57cbdce35bb1","Type":"ContainerDied","Data":"dc28164620c881496abbda12278d885a04fb87661be3d6350704ae3df3c0a321"}
Jul 27 21:00:58.835381 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.835074    2567 scope.go:117] "RemoveContainer" containerID="4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a"
Jul 27 21:00:58.843975 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.843956    2567 scope.go:117] "RemoveContainer" containerID="4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a"
Jul 27 21:00:58.844230 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:00:58.844212    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a\": container with ID starting with 4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a not found: ID does not exist" containerID="4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a"
Jul 27 21:00:58.844294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.844242    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a"} err="failed to get container status \"4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a\": rpc error: code = NotFound desc = could not find container \"4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a\": container with ID starting with 4a4fc7d0cd1de5d362f83515e055719daffa0efb3ce81b41c228e73cd939024a not found: ID does not exist"
Jul 27 21:00:58.855143 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.855119    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mfbc2"]
Jul 27 21:00:58.858027 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:58.858009    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mfbc2"]
Jul 27 21:00:59.029357 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:00:59.029326    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6edd352a-af9f-4dd4-88e0-57cbdce35bb1" path="/var/lib/kubelet/pods/6edd352a-af9f-4dd4-88e0-57cbdce35bb1/volumes"
Jul 27 21:01:24.486306 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.486270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85b57bd999-bm2wb"]
Jul 27 21:01:24.486836 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.486682    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6edd352a-af9f-4dd4-88e0-57cbdce35bb1" containerName="authorino"
Jul 27 21:01:24.486836 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.486695    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6edd352a-af9f-4dd4-88e0-57cbdce35bb1" containerName="authorino"
Jul 27 21:01:24.486836 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.486771    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6edd352a-af9f-4dd4-88e0-57cbdce35bb1" containerName="authorino"
Jul 27 21:01:24.491279 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.491261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:24.493433 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.493410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-csp79\""
Jul 27 21:01:24.495927 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.495902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85b57bd999-bm2wb"]
Jul 27 21:01:24.560306 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.560269    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85b57bd999-bm2wb"]
Jul 27 21:01:24.560577 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:01:24.560540    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-75pzl], unattached volumes=[], failed to process volumes=[kube-api-access-75pzl]: context canceled" pod="kuadrant-system/authorino-85b57bd999-bm2wb" podUID="c0f2ee15-3f85-4e79-b08c-9a807c61ea91"
Jul 27 21:01:24.586967 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.586936    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-766fd8f5dc-rnnss"]
Jul 27 21:01:24.590400 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.590385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.592364 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.592347    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 21:01:24.598268 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.598243    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-766fd8f5dc-rnnss"]
Jul 27 21:01:24.621954 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.621916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75pzl\" (UniqueName: \"kubernetes.io/projected/c0f2ee15-3f85-4e79-b08c-9a807c61ea91-kube-api-access-75pzl\") pod \"authorino-85b57bd999-bm2wb\" (UID: \"c0f2ee15-3f85-4e79-b08c-9a807c61ea91\") " pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:24.722962 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.722924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75pzl\" (UniqueName: \"kubernetes.io/projected/c0f2ee15-3f85-4e79-b08c-9a807c61ea91-kube-api-access-75pzl\") pod \"authorino-85b57bd999-bm2wb\" (UID: \"c0f2ee15-3f85-4e79-b08c-9a807c61ea91\") " pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:24.723155 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.722984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84931f0-db98-4280-b207-639b6f3212c8-tls-cert\") pod \"authorino-766fd8f5dc-rnnss\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") " pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.723155 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.723042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lz5\" (UniqueName: \"kubernetes.io/projected/b84931f0-db98-4280-b207-639b6f3212c8-kube-api-access-m2lz5\") pod \"authorino-766fd8f5dc-rnnss\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") " pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.730848 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.730823    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75pzl\" (UniqueName: \"kubernetes.io/projected/c0f2ee15-3f85-4e79-b08c-9a807c61ea91-kube-api-access-75pzl\") pod \"authorino-85b57bd999-bm2wb\" (UID: \"c0f2ee15-3f85-4e79-b08c-9a807c61ea91\") " pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:24.823858 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.823828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84931f0-db98-4280-b207-639b6f3212c8-tls-cert\") pod \"authorino-766fd8f5dc-rnnss\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") " pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.824039 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.823885    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lz5\" (UniqueName: \"kubernetes.io/projected/b84931f0-db98-4280-b207-639b6f3212c8-kube-api-access-m2lz5\") pod \"authorino-766fd8f5dc-rnnss\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") " pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.826378 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.826358    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84931f0-db98-4280-b207-639b6f3212c8-tls-cert\") pod \"authorino-766fd8f5dc-rnnss\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") " pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.831123 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.831090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lz5\" (UniqueName: \"kubernetes.io/projected/b84931f0-db98-4280-b207-639b6f3212c8-kube-api-access-m2lz5\") pod \"authorino-766fd8f5dc-rnnss\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") " pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.900873 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.900850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:01:24.970050 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.970022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:24.979425 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:24.979404    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:25.025964 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.025940    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75pzl\" (UniqueName: \"kubernetes.io/projected/c0f2ee15-3f85-4e79-b08c-9a807c61ea91-kube-api-access-75pzl\") pod \"c0f2ee15-3f85-4e79-b08c-9a807c61ea91\" (UID: \"c0f2ee15-3f85-4e79-b08c-9a807c61ea91\") "
Jul 27 21:01:25.028083 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.028060    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f2ee15-3f85-4e79-b08c-9a807c61ea91-kube-api-access-75pzl" (OuterVolumeSpecName: "kube-api-access-75pzl") pod "c0f2ee15-3f85-4e79-b08c-9a807c61ea91" (UID: "c0f2ee15-3f85-4e79-b08c-9a807c61ea91"). InnerVolumeSpecName "kube-api-access-75pzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:01:25.035747 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.035724    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-766fd8f5dc-rnnss"]
Jul 27 21:01:25.037591 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:01:25.037570    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb84931f0_db98_4280_b207_639b6f3212c8.slice/crio-a97721c618c2507ee2db1ccf49f982e4c3b18c0edaed8fc44e16102b6bc87f44 WatchSource:0}: Error finding container a97721c618c2507ee2db1ccf49f982e4c3b18c0edaed8fc44e16102b6bc87f44: Status 404 returned error can't find the container with id a97721c618c2507ee2db1ccf49f982e4c3b18c0edaed8fc44e16102b6bc87f44
Jul 27 21:01:25.126984 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.126913    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75pzl\" (UniqueName: \"kubernetes.io/projected/c0f2ee15-3f85-4e79-b08c-9a807c61ea91-kube-api-access-75pzl\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:01:25.976966 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.976936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-766fd8f5dc-rnnss" event={"ID":"b84931f0-db98-4280-b207-639b6f3212c8","Type":"ContainerStarted","Data":"a97721c618c2507ee2db1ccf49f982e4c3b18c0edaed8fc44e16102b6bc87f44"}
Jul 27 21:01:25.977341 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.977000    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85b57bd999-bm2wb"
Jul 27 21:01:25.999898 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:25.999872    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85b57bd999-bm2wb"]
Jul 27 21:01:26.003302 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:26.003281    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85b57bd999-bm2wb"]
Jul 27 21:01:26.984205 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:26.984173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-766fd8f5dc-rnnss" event={"ID":"b84931f0-db98-4280-b207-639b6f3212c8","Type":"ContainerStarted","Data":"5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869"}
Jul 27 21:01:27.030314 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:01:27.030282    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f2ee15-3f85-4e79-b08c-9a807c61ea91" path="/var/lib/kubelet/pods/c0f2ee15-3f85-4e79-b08c-9a807c61ea91/volumes"
Jul 27 21:02:18.257135 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.257103    2567 generic.go:356] "Generic (PLEG): container finished" podID="5284e6c3-64e0-45cd-b542-c34cce2aa7cf" containerID="b6b03c24dd9e899cf0471e1c781efaed705569dc53ca15b503328fc1b85b483c" exitCode=0
Jul 27 21:02:18.257592 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.257178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" event={"ID":"5284e6c3-64e0-45cd-b542-c34cce2aa7cf","Type":"ContainerDied","Data":"b6b03c24dd9e899cf0471e1c781efaed705569dc53ca15b503328fc1b85b483c"}
Jul 27 21:02:18.257647 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.257621    2567 scope.go:117] "RemoveContainer" containerID="b6b03c24dd9e899cf0471e1c781efaed705569dc53ca15b503328fc1b85b483c"
Jul 27 21:02:18.258732 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.258709    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:02:18.258813 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.258769    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:02:18.258813 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.258798    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:02:18.277188 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:18.277084    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-766fd8f5dc-rnnss" podStartSLOduration=53.405831919 podStartE2EDuration="54.27706613s" totalImagesPullingTime="871.234211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:27.014354053 +0000 UTC m=+618.377590345" watchObservedRunningTime="2026-07-27 21:02:18.27706613 +0000 UTC m=+669.640302459"
Jul 27 21:02:19.265650 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:19.265614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" event={"ID":"5284e6c3-64e0-45cd-b542-c34cce2aa7cf","Type":"ContainerStarted","Data":"de7803f764940993b6f43b2b7e7a05c7185950db8e8c7c76fb2301824bb21f80"}
Jul 27 21:02:19.849925 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:19.849882    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:02:19.850920 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:19.850886    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8tm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 27 21:02:19.851050 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:19.850963    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" podUID="5284e6c3-64e0-45cd-b542-c34cce2aa7cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 27 21:02:20.851082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:20.851032    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8tm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 27 21:02:20.851626 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:20.851107    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" podUID="5284e6c3-64e0-45cd-b542-c34cce2aa7cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 27 21:02:21.850052 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:21.850006    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8tm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 27 21:02:21.850269 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:21.850096    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" podUID="5284e6c3-64e0-45cd-b542-c34cce2aa7cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 27 21:02:22.849152 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:22.849112    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8tm2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 27 21:02:22.849750 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:22.849717    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q" podUID="5284e6c3-64e0-45cd-b542-c34cce2aa7cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 27 21:02:23.853168 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:23.853138    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:02:23.853663 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:23.853453    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:02:23.854309 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:02:23.854294    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tm2q"
Jul 27 21:03:07.894505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.894419    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"]
Jul 27 21:03:07.898012 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.897992    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:07.902241 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.902216    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 21:03:07.902365 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.902259    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 21:03:07.902896 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.902871    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bt4k8\""
Jul 27 21:03:07.903089 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.903068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 21:03:07.912104 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.912077    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"]
Jul 27 21:03:07.994667 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.994629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:07.994862 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.994687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:07.994862 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.994783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05f8c74f-7b6e-4296-a5c2-704516f45d40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:07.994965 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.994858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:07.994965 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.994892    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mb5v\" (UniqueName: \"kubernetes.io/projected/05f8c74f-7b6e-4296-a5c2-704516f45d40-kube-api-access-2mb5v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:07.994965 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:07.994932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096090 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05f8c74f-7b6e-4296-a5c2-704516f45d40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mb5v\" (UniqueName: \"kubernetes.io/projected/05f8c74f-7b6e-4296-a5c2-704516f45d40-kube-api-access-2mb5v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096657 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096680    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.096772 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.096728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.098635 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.098613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05f8c74f-7b6e-4296-a5c2-704516f45d40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.098912 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.098892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05f8c74f-7b6e-4296-a5c2-704516f45d40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.104504 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.104483    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mb5v\" (UniqueName: \"kubernetes.io/projected/05f8c74f-7b6e-4296-a5c2-704516f45d40-kube-api-access-2mb5v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd\" (UID: \"05f8c74f-7b6e-4296-a5c2-704516f45d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.209855 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.209756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:08.343293 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.343260    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"]
Jul 27 21:03:08.344954 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:03:08.344930    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f8c74f_7b6e_4296_a5c2_704516f45d40.slice/crio-58f756b9d7139bf160a9561962e8b2ab9d84e7ac61a1f720862ade2e5c7b2f6c WatchSource:0}: Error finding container 58f756b9d7139bf160a9561962e8b2ab9d84e7ac61a1f720862ade2e5c7b2f6c: Status 404 returned error can't find the container with id 58f756b9d7139bf160a9561962e8b2ab9d84e7ac61a1f720862ade2e5c7b2f6c
Jul 27 21:03:08.346846 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.346829    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:03:08.528535 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:08.528496    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd" event={"ID":"05f8c74f-7b6e-4296-a5c2-704516f45d40","Type":"ContainerStarted","Data":"58f756b9d7139bf160a9561962e8b2ab9d84e7ac61a1f720862ade2e5c7b2f6c"}
Jul 27 21:03:09.538463 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:09.538421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd" event={"ID":"05f8c74f-7b6e-4296-a5c2-704516f45d40","Type":"ContainerStarted","Data":"67a6afe7c4150540e6c18e9618a03d6bf832a5b021e1b8b5d5acbce85ca91a50"}
Jul 27 21:03:09.566426 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:09.558693    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd" podStartSLOduration=1.556564692 podStartE2EDuration="2.55818894s" totalImagesPullingTime="1.001624248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:09.55625589 +0000 UTC m=+720.919492175" watchObservedRunningTime="2026-07-27 21:03:09.55818894 +0000 UTC m=+720.921425264"
Jul 27 21:03:18.209961 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:18.209910    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:18.210472 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:18.209989    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:18.222751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:18.222726    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:03:18.598655 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:03:18.598628    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd"
Jul 27 21:04:08.206948 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.206901    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56ff65b466-d75db"]
Jul 27 21:04:08.210415 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.210391    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.221205 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.221178    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56ff65b466-d75db"]
Jul 27 21:04:08.250993 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.250957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6950fab-31b5-4f97-9634-bd805f92d20d-tls-cert\") pod \"authorino-56ff65b466-d75db\" (UID: \"b6950fab-31b5-4f97-9634-bd805f92d20d\") " pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.251179 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.251039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rkwf\" (UniqueName: \"kubernetes.io/projected/b6950fab-31b5-4f97-9634-bd805f92d20d-kube-api-access-7rkwf\") pod \"authorino-56ff65b466-d75db\" (UID: \"b6950fab-31b5-4f97-9634-bd805f92d20d\") " pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.352688 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.352641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rkwf\" (UniqueName: \"kubernetes.io/projected/b6950fab-31b5-4f97-9634-bd805f92d20d-kube-api-access-7rkwf\") pod \"authorino-56ff65b466-d75db\" (UID: \"b6950fab-31b5-4f97-9634-bd805f92d20d\") " pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.352887 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.352757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6950fab-31b5-4f97-9634-bd805f92d20d-tls-cert\") pod \"authorino-56ff65b466-d75db\" (UID: \"b6950fab-31b5-4f97-9634-bd805f92d20d\") " pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.355545 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.355518    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6950fab-31b5-4f97-9634-bd805f92d20d-tls-cert\") pod \"authorino-56ff65b466-d75db\" (UID: \"b6950fab-31b5-4f97-9634-bd805f92d20d\") " pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.364776 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.364750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rkwf\" (UniqueName: \"kubernetes.io/projected/b6950fab-31b5-4f97-9634-bd805f92d20d-kube-api-access-7rkwf\") pod \"authorino-56ff65b466-d75db\" (UID: \"b6950fab-31b5-4f97-9634-bd805f92d20d\") " pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.522447 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.522409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56ff65b466-d75db"
Jul 27 21:04:08.679702 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.679673    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56ff65b466-d75db"]
Jul 27 21:04:08.682171 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:04:08.682138    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6950fab_31b5_4f97_9634_bd805f92d20d.slice/crio-dc88358ce34765380d63df67f79278dfc722849532e755f8b96e826ee12b59ee WatchSource:0}: Error finding container dc88358ce34765380d63df67f79278dfc722849532e755f8b96e826ee12b59ee: Status 404 returned error can't find the container with id dc88358ce34765380d63df67f79278dfc722849532e755f8b96e826ee12b59ee
Jul 27 21:04:08.857936 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:08.857849    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56ff65b466-d75db" event={"ID":"b6950fab-31b5-4f97-9634-bd805f92d20d","Type":"ContainerStarted","Data":"dc88358ce34765380d63df67f79278dfc722849532e755f8b96e826ee12b59ee"}
Jul 27 21:04:09.867452 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:09.867416    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56ff65b466-d75db" event={"ID":"b6950fab-31b5-4f97-9634-bd805f92d20d","Type":"ContainerStarted","Data":"ca74083e3209fb78ffd19c402d119a20927c73588ee9db91286a5185bf548b49"}
Jul 27 21:04:09.888020 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:09.887959    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56ff65b466-d75db" podStartSLOduration=1.323677869 podStartE2EDuration="1.88793579s" totalImagesPullingTime="564.257921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:09.884780819 +0000 UTC m=+781.248017124" watchObservedRunningTime="2026-07-27 21:04:09.88793579 +0000 UTC m=+781.251172084"
Jul 27 21:04:09.953424 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:09.953383    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-766fd8f5dc-rnnss"]
Jul 27 21:04:09.953918 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:09.953890    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-766fd8f5dc-rnnss" podUID="b84931f0-db98-4280-b207-639b6f3212c8" containerName="authorino" containerID="cri-o://5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869" gracePeriod=30
Jul 27 21:04:10.226411 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.226377    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:04:10.272818 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.272781    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2lz5\" (UniqueName: \"kubernetes.io/projected/b84931f0-db98-4280-b207-639b6f3212c8-kube-api-access-m2lz5\") pod \"b84931f0-db98-4280-b207-639b6f3212c8\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") "
Jul 27 21:04:10.273018 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.272847    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84931f0-db98-4280-b207-639b6f3212c8-tls-cert\") pod \"b84931f0-db98-4280-b207-639b6f3212c8\" (UID: \"b84931f0-db98-4280-b207-639b6f3212c8\") "
Jul 27 21:04:10.275126 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.275087    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84931f0-db98-4280-b207-639b6f3212c8-kube-api-access-m2lz5" (OuterVolumeSpecName: "kube-api-access-m2lz5") pod "b84931f0-db98-4280-b207-639b6f3212c8" (UID: "b84931f0-db98-4280-b207-639b6f3212c8"). InnerVolumeSpecName "kube-api-access-m2lz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:10.288047 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.288018    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b84931f0-db98-4280-b207-639b6f3212c8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b84931f0-db98-4280-b207-639b6f3212c8" (UID: "b84931f0-db98-4280-b207-639b6f3212c8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:04:10.374218 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.374187    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2lz5\" (UniqueName: \"kubernetes.io/projected/b84931f0-db98-4280-b207-639b6f3212c8-kube-api-access-m2lz5\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:04:10.374218 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.374214    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84931f0-db98-4280-b207-639b6f3212c8-tls-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:04:10.876053 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.876022    2567 generic.go:356] "Generic (PLEG): container finished" podID="b84931f0-db98-4280-b207-639b6f3212c8" containerID="5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869" exitCode=0
Jul 27 21:04:10.876539 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.876072    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766fd8f5dc-rnnss"
Jul 27 21:04:10.876539 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.876108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-766fd8f5dc-rnnss" event={"ID":"b84931f0-db98-4280-b207-639b6f3212c8","Type":"ContainerDied","Data":"5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869"}
Jul 27 21:04:10.876539 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.876157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-766fd8f5dc-rnnss" event={"ID":"b84931f0-db98-4280-b207-639b6f3212c8","Type":"ContainerDied","Data":"a97721c618c2507ee2db1ccf49f982e4c3b18c0edaed8fc44e16102b6bc87f44"}
Jul 27 21:04:10.876539 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.876183    2567 scope.go:117] "RemoveContainer" containerID="5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869"
Jul 27 21:04:10.887298 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.887279    2567 scope.go:117] "RemoveContainer" containerID="5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869"
Jul 27 21:04:10.887597 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:04:10.887574    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869\": container with ID starting with 5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869 not found: ID does not exist" containerID="5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869"
Jul 27 21:04:10.887672 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.887604    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869"} err="failed to get container status \"5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869\": rpc error: code = NotFound desc = could not find container \"5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869\": container with ID starting with 5ab36adf60e7f01ac3b558017e5546f92f2aa1b34c8d60b0e01d349cadb52869 not found: ID does not exist"
Jul 27 21:04:10.904431 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.904401    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-766fd8f5dc-rnnss"]
Jul 27 21:04:10.917266 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:10.917227    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-766fd8f5dc-rnnss"]
Jul 27 21:04:11.029853 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:04:11.029805    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84931f0-db98-4280-b207-639b6f3212c8" path="/var/lib/kubelet/pods/b84931f0-db98-4280-b207-639b6f3212c8/volumes"
Jul 27 21:11:06.472929 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:06.472891    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"]
Jul 27 21:11:06.473515 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:06.473169    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt" podUID="f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" containerName="manager" containerID="cri-o://28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc" gracePeriod=10
Jul 27 21:11:10.121194 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.121166    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:11:10.218309 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.218218    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-extensions-socket-volume\") pod \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") "
Jul 27 21:11:10.218309 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.218305    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfn7p\" (UniqueName: \"kubernetes.io/projected/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-kube-api-access-wfn7p\") pod \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\" (UID: \"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1\") "
Jul 27 21:11:10.218671 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.218645    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" (UID: "f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:11:10.220591 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.220538    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-kube-api-access-wfn7p" (OuterVolumeSpecName: "kube-api-access-wfn7p") pod "f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" (UID: "f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1"). InnerVolumeSpecName "kube-api-access-wfn7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:11:10.226583 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.226524    2567 generic.go:356] "Generic (PLEG): container finished" podID="f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" containerID="28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc" exitCode=0
Jul 27 21:11:10.226717 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.226592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt" event={"ID":"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1","Type":"ContainerDied","Data":"28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc"}
Jul 27 21:11:10.226717 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.226610    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"
Jul 27 21:11:10.226717 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.226645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt" event={"ID":"f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1","Type":"ContainerDied","Data":"58700fe4b627e054de7c13a21ea5318bd8049389a047496115b215ec93d436c6"}
Jul 27 21:11:10.226717 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.226668    2567 scope.go:117] "RemoveContainer" containerID="28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc"
Jul 27 21:11:10.243646 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.243626    2567 scope.go:117] "RemoveContainer" containerID="28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc"
Jul 27 21:11:10.243979 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:11:10.243960    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc\": container with ID starting with 28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc not found: ID does not exist" containerID="28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc"
Jul 27 21:11:10.244020 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.243989    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc"} err="failed to get container status \"28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc\": rpc error: code = NotFound desc = could not find container \"28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc\": container with ID starting with 28304a622bc9afe8deb8e7a3c78d369fd5ccedf3ce3fbf81c11505c4fc1cdadc not found: ID does not exist"
Jul 27 21:11:10.255520 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.255491    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"]
Jul 27 21:11:10.259279 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.259255    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgzdt"]
Jul 27 21:11:10.319737 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.319697    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-extensions-socket-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:11:10.319737 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:10.319729    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfn7p\" (UniqueName: \"kubernetes.io/projected/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1-kube-api-access-wfn7p\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:11:11.029772 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:11:11.029739    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" path="/var/lib/kubelet/pods/f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1/volumes"
Jul 27 21:12:07.664530 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664452    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"]
Jul 27 21:12:07.664998 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664873    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84931f0-db98-4280-b207-639b6f3212c8" containerName="authorino"
Jul 27 21:12:07.664998 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664885    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84931f0-db98-4280-b207-639b6f3212c8" containerName="authorino"
Jul 27 21:12:07.664998 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664904    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" containerName="manager"
Jul 27 21:12:07.664998 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664910    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" containerName="manager"
Jul 27 21:12:07.664998 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664967    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ef1d78-3b23-4f4d-ad08-d3f3052b40d1" containerName="manager"
Jul 27 21:12:07.664998 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.664976    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84931f0-db98-4280-b207-639b6f3212c8" containerName="authorino"
Jul 27 21:12:07.667922 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.667904    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.670016 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.669990    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qm5lx\""
Jul 27 21:12:07.682130 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.682105    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"]
Jul 27 21:12:07.757778 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.757739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hq2s\" (UniqueName: \"kubernetes.io/projected/8443de16-5570-46db-bed1-2c73d4d1f578-kube-api-access-9hq2s\") pod \"kuadrant-operator-controller-manager-86878c769f-lxzq6\" (UID: \"8443de16-5570-46db-bed1-2c73d4d1f578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.757937 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.757790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8443de16-5570-46db-bed1-2c73d4d1f578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lxzq6\" (UID: \"8443de16-5570-46db-bed1-2c73d4d1f578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.858986 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.858950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hq2s\" (UniqueName: \"kubernetes.io/projected/8443de16-5570-46db-bed1-2c73d4d1f578-kube-api-access-9hq2s\") pod \"kuadrant-operator-controller-manager-86878c769f-lxzq6\" (UID: \"8443de16-5570-46db-bed1-2c73d4d1f578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.859152 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.858998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8443de16-5570-46db-bed1-2c73d4d1f578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lxzq6\" (UID: \"8443de16-5570-46db-bed1-2c73d4d1f578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.859394 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.859378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8443de16-5570-46db-bed1-2c73d4d1f578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lxzq6\" (UID: \"8443de16-5570-46db-bed1-2c73d4d1f578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.869836 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.869812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hq2s\" (UniqueName: \"kubernetes.io/projected/8443de16-5570-46db-bed1-2c73d4d1f578-kube-api-access-9hq2s\") pod \"kuadrant-operator-controller-manager-86878c769f-lxzq6\" (UID: \"8443de16-5570-46db-bed1-2c73d4d1f578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:07.984614 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:07.984493    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:08.126267 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:08.126240    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"]
Jul 27 21:12:08.131927 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:12:08.131902    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8443de16_5570_46db_bed1_2c73d4d1f578.slice/crio-f8e1bfccbaea695f8f3de90c776019a6cf83d11bac55d1f03d040891f97e6be5 WatchSource:0}: Error finding container f8e1bfccbaea695f8f3de90c776019a6cf83d11bac55d1f03d040891f97e6be5: Status 404 returned error can't find the container with id f8e1bfccbaea695f8f3de90c776019a6cf83d11bac55d1f03d040891f97e6be5
Jul 27 21:12:08.536709 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:08.536673    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6" event={"ID":"8443de16-5570-46db-bed1-2c73d4d1f578","Type":"ContainerStarted","Data":"3bca33ee0706e5a8ba9e20f501cd969b53e77c4d5d894a705767154f3e0d5bbb"}
Jul 27 21:12:08.536909 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:08.536730    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6" event={"ID":"8443de16-5570-46db-bed1-2c73d4d1f578","Type":"ContainerStarted","Data":"f8e1bfccbaea695f8f3de90c776019a6cf83d11bac55d1f03d040891f97e6be5"}
Jul 27 21:12:08.536909 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:08.536897    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:12:08.556224 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:08.556165    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6" podStartSLOduration=1.556147036 podStartE2EDuration="1.556147036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:12:08.555403531 +0000 UTC m=+1259.918639838" watchObservedRunningTime="2026-07-27 21:12:08.556147036 +0000 UTC m=+1259.919383330"
Jul 27 21:12:19.544692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:12:19.544663    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lxzq6"
Jul 27 21:19:16.395584 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.395535    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"]
Jul 27 21:19:16.399222 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.399201    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.401196 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.401169    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-39c7c327-openshift-default-dockercfg-9zw8d\""
Jul 27 21:19:16.422307 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.422279    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"]
Jul 27 21:19:16.519819 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.519776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-credential-socket\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.519819 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.519821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-envoy\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.519850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-data\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.519883    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-certs\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.519908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-podinfo\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.519990    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-socket\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.520012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-token\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520298 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.520061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istiod-ca-cert\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.520298 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.520159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tst9b\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-kube-api-access-tst9b\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621133 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-socket\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621133 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621133    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-token\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621396 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istiod-ca-cert\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621396 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tst9b\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-kube-api-access-tst9b\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621396 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621279    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-credential-socket\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621396 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-envoy\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621396 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621331    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-data\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621396 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-certs\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621783 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-podinfo\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621783 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621542    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-socket\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621783 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621621    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-credential-socket\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621945 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-certs\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.621945 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621859    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-data\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.622015 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.621995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istiod-ca-cert\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.623956 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.623936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-envoy\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.624062 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.624053    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-podinfo\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.628452 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.628430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-token\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.628701 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.628683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tst9b\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-kube-api-access-tst9b\") pod \"e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") " pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.709205 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.709124    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:16.852322 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.852298    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"]
Jul 27 21:19:16.854825 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:19:16.854797    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b2154f_871f_4dde_b9f9_f006ff3fd2af.slice/crio-0fbbe729cfea275a58b759c8ac23faa8177fcfe8b55e02b89f77b24cbdf70d4a WatchSource:0}: Error finding container 0fbbe729cfea275a58b759c8ac23faa8177fcfe8b55e02b89f77b24cbdf70d4a: Status 404 returned error can't find the container with id 0fbbe729cfea275a58b759c8ac23faa8177fcfe8b55e02b89f77b24cbdf70d4a
Jul 27 21:19:16.857284 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.857254    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:19:16.857344 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.857321    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:19:16.857381 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.857355    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:19:16.898453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:16.898426    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" event={"ID":"53b2154f-871f-4dde-b9f9-f006ff3fd2af","Type":"ContainerStarted","Data":"0fbbe729cfea275a58b759c8ac23faa8177fcfe8b55e02b89f77b24cbdf70d4a"}
Jul 27 21:19:17.904746 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:17.904710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" event={"ID":"53b2154f-871f-4dde-b9f9-f006ff3fd2af","Type":"ContainerStarted","Data":"d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"}
Jul 27 21:19:17.928067 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:17.928015    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" podStartSLOduration=1.9280004050000001 podStartE2EDuration="1.928000405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:19:17.924886806 +0000 UTC m=+1689.288123100" watchObservedRunningTime="2026-07-27 21:19:17.928000405 +0000 UTC m=+1689.291236697"
Jul 27 21:19:18.710016 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:18.709986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:18.714708 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:18.714687    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:18.910202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:18.910171    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:18.911057 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:18.911039    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:29.980037 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:29.980003    2567 generic.go:356] "Generic (PLEG): container finished" podID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerID="d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b" exitCode=0
Jul 27 21:19:29.980458 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:29.980075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" event={"ID":"53b2154f-871f-4dde-b9f9-f006ff3fd2af","Type":"ContainerDied","Data":"d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"}
Jul 27 21:19:29.980506 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:29.980473    2567 scope.go:117] "RemoveContainer" containerID="d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"
Jul 27 21:19:29.981519 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:29.981493    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:19:29.981665 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:29.981605    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:19:29.981665 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:29.981657    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:19:30.988031 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:30.987990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" event={"ID":"53b2154f-871f-4dde-b9f9-f006ff3fd2af","Type":"ContainerStarted","Data":"d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1"}
Jul 27 21:19:31.710339 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:31.710304    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:31.711679 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:31.711648    2567 patch_prober.go:28] interesting pod/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:19:31.711809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:31.711710    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 27 21:19:32.710441 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:32.710404    2567 patch_prober.go:28] interesting pod/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:19:32.710870 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:32.710458    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 27 21:19:33.710054 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:33.710015    2567 patch_prober.go:28] interesting pod/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:19:33.710245 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:33.710083    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 27 21:19:33.910804 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:33.910769    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:34.710283 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:34.710249    2567 patch_prober.go:28] interesting pod/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:19:34.710471 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:34.710303    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 27 21:19:35.713551 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:35.713513    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:19:35.714426 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:19:35.714408    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:20:00.088278 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:00.088241    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"]
Jul 27 21:20:00.088853 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:00.088540    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy" containerID="cri-o://d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1" gracePeriod=30
Jul 27 21:20:05.352757 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.352663    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:20:05.504991 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.504953    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tst9b\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-kube-api-access-tst9b\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.504991 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.504997    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-data\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505019    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-certs\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505042    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-token\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505066    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-socket\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505113    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-podinfo\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505136    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istiod-ca-cert\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505162    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-envoy\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505202    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-credential-socket\") pod \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\" (UID: \"53b2154f-871f-4dde-b9f9-f006ff3fd2af\") "
Jul 27 21:20:05.505661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505376    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:20:05.505661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505458    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:20:05.505661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505622    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-certs\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.505840 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505667    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-workload-socket\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.505840 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505725    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:20:05.505840 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.505809    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:20:05.506272 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.506247    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-data" (OuterVolumeSpecName: "istio-data") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:20:05.507675 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.507640    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-token" (OuterVolumeSpecName: "istio-token") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:20:05.507675 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.507662    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:20:05.507853 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.507832    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:20:05.507853 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.507844    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-kube-api-access-tst9b" (OuterVolumeSpecName: "kube-api-access-tst9b") pod "53b2154f-871f-4dde-b9f9-f006ff3fd2af" (UID: "53b2154f-871f-4dde-b9f9-f006ff3fd2af"). InnerVolumeSpecName "kube-api-access-tst9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606598    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-credential-socket\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606627    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tst9b\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-kube-api-access-tst9b\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606638    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-data\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606646    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-token\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606654    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-podinfo\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606661    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istiod-ca-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:05.606684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:05.606669    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53b2154f-871f-4dde-b9f9-f006ff3fd2af-istio-envoy\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:06.185649 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.185613    2567 generic.go:356] "Generic (PLEG): container finished" podID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerID="d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1" exitCode=0
Jul 27 21:20:06.185828 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.185660    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"
Jul 27 21:20:06.185828 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.185693    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" event={"ID":"53b2154f-871f-4dde-b9f9-f006ff3fd2af","Type":"ContainerDied","Data":"d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1"}
Jul 27 21:20:06.185828 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.185741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7" event={"ID":"53b2154f-871f-4dde-b9f9-f006ff3fd2af","Type":"ContainerDied","Data":"0fbbe729cfea275a58b759c8ac23faa8177fcfe8b55e02b89f77b24cbdf70d4a"}
Jul 27 21:20:06.185828 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.185768    2567 scope.go:117] "RemoveContainer" containerID="d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1"
Jul 27 21:20:06.195879 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.195862    2567 scope.go:117] "RemoveContainer" containerID="d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"
Jul 27 21:20:06.204473 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.204304    2567 scope.go:117] "RemoveContainer" containerID="d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1"
Jul 27 21:20:06.204619 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:20:06.204601    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1\": container with ID starting with d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1 not found: ID does not exist" containerID="d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1"
Jul 27 21:20:06.204675 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.204627    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1"} err="failed to get container status \"d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1\": rpc error: code = NotFound desc = could not find container \"d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1\": container with ID starting with d49238baf0e6cb513c7e326cb0b4d854406949d2bb6bc2c1cc57f00cf8cd83d1 not found: ID does not exist"
Jul 27 21:20:06.204675 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.204645    2567 scope.go:117] "RemoveContainer" containerID="d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"
Jul 27 21:20:06.204865 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:20:06.204849    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b\": container with ID starting with d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b not found: ID does not exist" containerID="d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"
Jul 27 21:20:06.204910 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.204869    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b"} err="failed to get container status \"d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b\": rpc error: code = NotFound desc = could not find container \"d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b\": container with ID starting with d9c36308331c83b781128e05940dc009d78c4f1e70e0d6bff3f8894acf95ae8b not found: ID does not exist"
Jul 27 21:20:06.208979 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.208958    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"]
Jul 27 21:20:06.211948 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:06.211927    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-39c7c327-openshift-default-88fcb7774-nv5t7"]
Jul 27 21:20:07.028882 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:07.028845    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" path="/var/lib/kubelet/pods/53b2154f-871f-4dde-b9f9-f006ff3fd2af/volumes"
Jul 27 21:20:32.856275 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856236    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"]
Jul 27 21:20:32.856782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856648    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy"
Jul 27 21:20:32.856782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856660    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy"
Jul 27 21:20:32.856782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856684    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy"
Jul 27 21:20:32.856782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856690    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy"
Jul 27 21:20:32.856782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856744    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy"
Jul 27 21:20:32.856782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.856751    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b2154f-871f-4dde-b9f9-f006ff3fd2af" containerName="istio-proxy"
Jul 27 21:20:32.860973 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.860957    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:32.864244 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.864217    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:20:32.864389 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.864217    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:20:32.866196 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.866165    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"]
Jul 27 21:20:32.962313 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:32.962279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58ee24f-d137-4090-93ad-925709e4f053-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm\" (UID: \"a58ee24f-d137-4090-93ad-925709e4f053\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:33.063619 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:33.063584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58ee24f-d137-4090-93ad-925709e4f053-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm\" (UID: \"a58ee24f-d137-4090-93ad-925709e4f053\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:33.064202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:33.064181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58ee24f-d137-4090-93ad-925709e4f053-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm\" (UID: \"a58ee24f-d137-4090-93ad-925709e4f053\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:33.173861 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:33.173773    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:33.316482 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:33.316454    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"]
Jul 27 21:20:33.318310 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:20:33.318283    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58ee24f_d137_4090_93ad_925709e4f053.slice/crio-2208fdafbf50ce418326135090ea2f2782339703927991baeafb3d12b472ce49 WatchSource:0}: Error finding container 2208fdafbf50ce418326135090ea2f2782339703927991baeafb3d12b472ce49: Status 404 returned error can't find the container with id 2208fdafbf50ce418326135090ea2f2782339703927991baeafb3d12b472ce49
Jul 27 21:20:33.320148 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:33.320132    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:20:33.335156 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:33.335130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm" event={"ID":"a58ee24f-d137-4090-93ad-925709e4f053","Type":"ContainerStarted","Data":"2208fdafbf50ce418326135090ea2f2782339703927991baeafb3d12b472ce49"}
Jul 27 21:20:36.353359 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:36.353327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm" event={"ID":"a58ee24f-d137-4090-93ad-925709e4f053","Type":"ContainerStarted","Data":"e94c288be937cfd15b8f313bae9b56f56bd13477d7f890351db2c4d78e1358bf"}
Jul 27 21:20:36.370351 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:36.370303    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm" podStartSLOduration=1.985892283 podStartE2EDuration="4.370289125s" totalImagesPullingTime="2.384396842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:20:36.368914236 +0000 UTC m=+1767.732150530" watchObservedRunningTime="2026-07-27 21:20:36.370289125 +0000 UTC m=+1767.733525418"
Jul 27 21:20:37.361219 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:37.361180    2567 generic.go:356] "Generic (PLEG): container finished" podID="a58ee24f-d137-4090-93ad-925709e4f053" containerID="e94c288be937cfd15b8f313bae9b56f56bd13477d7f890351db2c4d78e1358bf" exitCode=0
Jul 27 21:20:37.361636 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:37.361227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm" event={"ID":"a58ee24f-d137-4090-93ad-925709e4f053","Type":"ContainerDied","Data":"e94c288be937cfd15b8f313bae9b56f56bd13477d7f890351db2c4d78e1358bf"}
Jul 27 21:20:38.502428 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:38.502398    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:38.616836 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:38.616790    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58ee24f-d137-4090-93ad-925709e4f053-maas-api-service-ca\") pod \"a58ee24f-d137-4090-93ad-925709e4f053\" (UID: \"a58ee24f-d137-4090-93ad-925709e4f053\") "
Jul 27 21:20:38.617242 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:38.617195    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a58ee24f-d137-4090-93ad-925709e4f053-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a58ee24f-d137-4090-93ad-925709e4f053" (UID: "a58ee24f-d137-4090-93ad-925709e4f053"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:20:38.717869 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:38.717819    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58ee24f-d137-4090-93ad-925709e4f053-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:20:39.373069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:39.372983    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"
Jul 27 21:20:39.373069 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:39.372983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm" event={"ID":"a58ee24f-d137-4090-93ad-925709e4f053","Type":"ContainerDied","Data":"2208fdafbf50ce418326135090ea2f2782339703927991baeafb3d12b472ce49"}
Jul 27 21:20:39.373291 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:39.373099    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2208fdafbf50ce418326135090ea2f2782339703927991baeafb3d12b472ce49"
Jul 27 21:20:47.924752 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:47.924712    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"]
Jul 27 21:20:47.927352 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:47.927329    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-338bbf37-c42vm"]
Jul 27 21:20:49.029573 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:49.029526    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a58ee24f-d137-4090-93ad-925709e4f053" path="/var/lib/kubelet/pods/a58ee24f-d137-4090-93ad-925709e4f053/volumes"
Jul 27 21:20:51.845720 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.845673    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"]
Jul 27 21:20:51.846270 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.846245    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a58ee24f-d137-4090-93ad-925709e4f053" containerName="revoke-keys"
Jul 27 21:20:51.846270 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.846271    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58ee24f-d137-4090-93ad-925709e4f053" containerName="revoke-keys"
Jul 27 21:20:51.846438 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.846369    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a58ee24f-d137-4090-93ad-925709e4f053" containerName="revoke-keys"
Jul 27 21:20:51.852873 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.852841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:51.855260 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.855232    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-54ece799\""
Jul 27 21:20:51.855745 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.855719    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-54ece799-dockercfg-n28tz\""
Jul 27 21:20:51.858365 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.858332    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"]
Jul 27 21:20:51.946482 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.946443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll8tl\" (UniqueName: \"kubernetes.io/projected/a65e98a0-8054-4b63-a867-2335cfea93c8-kube-api-access-ll8tl\") pod \"payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") " pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:51.947006 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:51.946954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65e98a0-8054-4b63-a867-2335cfea93c8-plugins-config-volume\") pod \"payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") " pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:52.048245 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.048199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65e98a0-8054-4b63-a867-2335cfea93c8-plugins-config-volume\") pod \"payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") " pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:52.048245 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.048246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll8tl\" (UniqueName: \"kubernetes.io/projected/a65e98a0-8054-4b63-a867-2335cfea93c8-kube-api-access-ll8tl\") pod \"payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") " pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:52.048960 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.048940    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65e98a0-8054-4b63-a867-2335cfea93c8-plugins-config-volume\") pod \"payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") " pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:52.056037 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.056013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll8tl\" (UniqueName: \"kubernetes.io/projected/a65e98a0-8054-4b63-a867-2335cfea93c8-kube-api-access-ll8tl\") pod \"payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") " pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:52.165422 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.165333    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:52.306271 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.306121    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"]
Jul 27 21:20:52.308643 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:20:52.308619    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65e98a0_8054_4b63_a867_2335cfea93c8.slice/crio-8566e2da6c33c827422e8a18599fb4c5a20f08e036c184b5e7807d6dd83a50e7 WatchSource:0}: Error finding container 8566e2da6c33c827422e8a18599fb4c5a20f08e036c184b5e7807d6dd83a50e7: Status 404 returned error can't find the container with id 8566e2da6c33c827422e8a18599fb4c5a20f08e036c184b5e7807d6dd83a50e7
Jul 27 21:20:52.450355 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:52.450274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl" event={"ID":"a65e98a0-8054-4b63-a867-2335cfea93c8","Type":"ContainerStarted","Data":"8566e2da6c33c827422e8a18599fb4c5a20f08e036c184b5e7807d6dd83a50e7"}
Jul 27 21:20:54.469200 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:54.469104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl" event={"ID":"a65e98a0-8054-4b63-a867-2335cfea93c8","Type":"ContainerStarted","Data":"47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198"}
Jul 27 21:20:54.469584 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:54.469205    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:20:54.484134 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:20:54.484087    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl" podStartSLOduration=1.710261724 podStartE2EDuration="3.484071562s" totalImagesPullingTime="1.773809838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:20:54.482051126 +0000 UTC m=+1785.845287419" watchObservedRunningTime="2026-07-27 21:20:54.484071562 +0000 UTC m=+1785.847307854"
Jul 27 21:21:05.476795 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:05.476716    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:21:16.844257 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:16.844216    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"]
Jul 27 21:21:16.847452 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:16.847433    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:16.849486 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:16.849464    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:21:16.849486 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:16.849480    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:21:16.854632 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:16.854604    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"]
Jul 27 21:21:16.979207 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:16.979171    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d65b18-8b83-4e38-9192-b134f5cc4ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-54ece799-bc4d9\" (UID: \"86d65b18-8b83-4e38-9192-b134f5cc4ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:17.079799 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.079760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d65b18-8b83-4e38-9192-b134f5cc4ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-54ece799-bc4d9\" (UID: \"86d65b18-8b83-4e38-9192-b134f5cc4ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:17.080431 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.080405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d65b18-8b83-4e38-9192-b134f5cc4ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-54ece799-bc4d9\" (UID: \"86d65b18-8b83-4e38-9192-b134f5cc4ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:17.161608 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.161497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:17.297674 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.297644    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"]
Jul 27 21:21:17.297808 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:21:17.297729    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d65b18_8b83_4e38_9192_b134f5cc4ddf.slice/crio-8ab3b33d936ff4d1b1f8f5e617ec5cd345d0742dbc48cd0c03255714a84bed15 WatchSource:0}: Error finding container 8ab3b33d936ff4d1b1f8f5e617ec5cd345d0742dbc48cd0c03255714a84bed15: Status 404 returned error can't find the container with id 8ab3b33d936ff4d1b1f8f5e617ec5cd345d0742dbc48cd0c03255714a84bed15
Jul 27 21:21:17.608307 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.608269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9" event={"ID":"86d65b18-8b83-4e38-9192-b134f5cc4ddf","Type":"ContainerStarted","Data":"73ae92d48e17cafe48d0f8bc32f4660e733d2c8c5c798b2d0efbc1ba60478ee7"}
Jul 27 21:21:17.608497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.608338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9" event={"ID":"86d65b18-8b83-4e38-9192-b134f5cc4ddf","Type":"ContainerStarted","Data":"8ab3b33d936ff4d1b1f8f5e617ec5cd345d0742dbc48cd0c03255714a84bed15"}
Jul 27 21:21:17.634712 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:17.634660    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9" podStartSLOduration=1.63464426 podStartE2EDuration="1.63464426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:21:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:21:17.634203024 +0000 UTC m=+1808.997439328" watchObservedRunningTime="2026-07-27 21:21:17.63464426 +0000 UTC m=+1808.997880552"
Jul 27 21:21:18.614582 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:18.614527    2567 generic.go:356] "Generic (PLEG): container finished" podID="86d65b18-8b83-4e38-9192-b134f5cc4ddf" containerID="73ae92d48e17cafe48d0f8bc32f4660e733d2c8c5c798b2d0efbc1ba60478ee7" exitCode=0
Jul 27 21:21:18.614964 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:18.614594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9" event={"ID":"86d65b18-8b83-4e38-9192-b134f5cc4ddf","Type":"ContainerDied","Data":"73ae92d48e17cafe48d0f8bc32f4660e733d2c8c5c798b2d0efbc1ba60478ee7"}
Jul 27 21:21:19.751974 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:19.751945    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:19.907212 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:19.907117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d65b18-8b83-4e38-9192-b134f5cc4ddf-maas-api-service-ca\") pod \"86d65b18-8b83-4e38-9192-b134f5cc4ddf\" (UID: \"86d65b18-8b83-4e38-9192-b134f5cc4ddf\") "
Jul 27 21:21:19.907490 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:19.907466    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d65b18-8b83-4e38-9192-b134f5cc4ddf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86d65b18-8b83-4e38-9192-b134f5cc4ddf" (UID: "86d65b18-8b83-4e38-9192-b134f5cc4ddf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:21:20.008259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:20.008214    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86d65b18-8b83-4e38-9192-b134f5cc4ddf-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:21:20.625575 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:20.625532    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"
Jul 27 21:21:20.625739 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:20.625585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9" event={"ID":"86d65b18-8b83-4e38-9192-b134f5cc4ddf","Type":"ContainerDied","Data":"8ab3b33d936ff4d1b1f8f5e617ec5cd345d0742dbc48cd0c03255714a84bed15"}
Jul 27 21:21:20.625739 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:20.625636    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ab3b33d936ff4d1b1f8f5e617ec5cd345d0742dbc48cd0c03255714a84bed15"
Jul 27 21:21:27.289675 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.289636    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"]
Jul 27 21:21:27.290768 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.290709    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl" podUID="a65e98a0-8054-4b63-a867-2335cfea93c8" containerName="payload-processing" containerID="cri-o://47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198" gracePeriod=30
Jul 27 21:21:27.553731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.553661    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:21:27.665761 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.665714    2567 generic.go:356] "Generic (PLEG): container finished" podID="a65e98a0-8054-4b63-a867-2335cfea93c8" containerID="47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198" exitCode=0
Jul 27 21:21:27.665940 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.665776    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"
Jul 27 21:21:27.665940 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.665801    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl" event={"ID":"a65e98a0-8054-4b63-a867-2335cfea93c8","Type":"ContainerDied","Data":"47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198"}
Jul 27 21:21:27.665940 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.665871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl" event={"ID":"a65e98a0-8054-4b63-a867-2335cfea93c8","Type":"ContainerDied","Data":"8566e2da6c33c827422e8a18599fb4c5a20f08e036c184b5e7807d6dd83a50e7"}
Jul 27 21:21:27.665940 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.665895    2567 scope.go:117] "RemoveContainer" containerID="47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198"
Jul 27 21:21:27.674971 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.674949    2567 scope.go:117] "RemoveContainer" containerID="47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198"
Jul 27 21:21:27.675296 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:21:27.675274    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198\": container with ID starting with 47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198 not found: ID does not exist" containerID="47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198"
Jul 27 21:21:27.675366 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.675305    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198"} err="failed to get container status \"47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198\": rpc error: code = NotFound desc = could not find container \"47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198\": container with ID starting with 47cd9c114c8db8db42295a5edbd63711400e181db109e4499295ef547fcb6198 not found: ID does not exist"
Jul 27 21:21:27.683697 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.683671    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll8tl\" (UniqueName: \"kubernetes.io/projected/a65e98a0-8054-4b63-a867-2335cfea93c8-kube-api-access-ll8tl\") pod \"a65e98a0-8054-4b63-a867-2335cfea93c8\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") "
Jul 27 21:21:27.683826 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.683783    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65e98a0-8054-4b63-a867-2335cfea93c8-plugins-config-volume\") pod \"a65e98a0-8054-4b63-a867-2335cfea93c8\" (UID: \"a65e98a0-8054-4b63-a867-2335cfea93c8\") "
Jul 27 21:21:27.684158 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.684135    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a65e98a0-8054-4b63-a867-2335cfea93c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a65e98a0-8054-4b63-a867-2335cfea93c8" (UID: "a65e98a0-8054-4b63-a867-2335cfea93c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:21:27.685999 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.685973    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a65e98a0-8054-4b63-a867-2335cfea93c8-kube-api-access-ll8tl" (OuterVolumeSpecName: "kube-api-access-ll8tl") pod "a65e98a0-8054-4b63-a867-2335cfea93c8" (UID: "a65e98a0-8054-4b63-a867-2335cfea93c8"). InnerVolumeSpecName "kube-api-access-ll8tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:21:27.784531 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.784490    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll8tl\" (UniqueName: \"kubernetes.io/projected/a65e98a0-8054-4b63-a867-2335cfea93c8-kube-api-access-ll8tl\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:21:27.784531 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.784522    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a65e98a0-8054-4b63-a867-2335cfea93c8-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:21:27.989307 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.989272    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"]
Jul 27 21:21:27.994032 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:27.994003    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-54ece799-7857d574c4-pjrnl"]
Jul 27 21:21:29.037430 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:29.037396    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a65e98a0-8054-4b63-a867-2335cfea93c8" path="/var/lib/kubelet/pods/a65e98a0-8054-4b63-a867-2335cfea93c8/volumes"
Jul 27 21:21:31.912594 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:31.912544    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"]
Jul 27 21:21:31.914792 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:31.914770    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-54ece799-bc4d9"]
Jul 27 21:21:33.030118 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:33.030086    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d65b18-8b83-4e38-9192-b134f5cc4ddf" path="/var/lib/kubelet/pods/86d65b18-8b83-4e38-9192-b134f5cc4ddf/volumes"
Jul 27 21:21:36.990091 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990055    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"]
Jul 27 21:21:36.990654 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990638    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a65e98a0-8054-4b63-a867-2335cfea93c8" containerName="payload-processing"
Jul 27 21:21:36.990708 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990657    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a65e98a0-8054-4b63-a867-2335cfea93c8" containerName="payload-processing"
Jul 27 21:21:36.990708 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990681    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d65b18-8b83-4e38-9192-b134f5cc4ddf" containerName="revoke-keys"
Jul 27 21:21:36.990708 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990690    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d65b18-8b83-4e38-9192-b134f5cc4ddf" containerName="revoke-keys"
Jul 27 21:21:36.990810 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990791    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a65e98a0-8054-4b63-a867-2335cfea93c8" containerName="payload-processing"
Jul 27 21:21:36.990810 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.990805    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d65b18-8b83-4e38-9192-b134f5cc4ddf" containerName="revoke-keys"
Jul 27 21:21:36.996798 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:36.996769    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.010123 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.010099    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"]
Jul 27 21:21:37.012514 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.012490    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f154b44a\""
Jul 27 21:21:37.012660 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.012598    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f154b44a-dockercfg-w7hhg\""
Jul 27 21:21:37.070921 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.070888    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljnlk\" (UniqueName: \"kubernetes.io/projected/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-kube-api-access-ljnlk\") pod \"payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.070921 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.070928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.171969 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.171937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljnlk\" (UniqueName: \"kubernetes.io/projected/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-kube-api-access-ljnlk\") pod \"payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.171969 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.171976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.172689 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.172659    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.187045 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.187015    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljnlk\" (UniqueName: \"kubernetes.io/projected/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-kube-api-access-ljnlk\") pod \"payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.308372 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.308341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.460898 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.460870    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"]
Jul 27 21:21:37.462914 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:21:37.462872    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d9c8bc_2ef4_4481_91f9_aee9cc9b3965.slice/crio-6d838f7c504b5acf97203fa5b74f648deefc1053495d25ac43e5fc45bbc78d67 WatchSource:0}: Error finding container 6d838f7c504b5acf97203fa5b74f648deefc1053495d25ac43e5fc45bbc78d67: Status 404 returned error can't find the container with id 6d838f7c504b5acf97203fa5b74f648deefc1053495d25ac43e5fc45bbc78d67
Jul 27 21:21:37.723598 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.723502    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24" event={"ID":"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965","Type":"ContainerStarted","Data":"a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0"}
Jul 27 21:21:37.723598 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.723577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24" event={"ID":"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965","Type":"ContainerStarted","Data":"6d838f7c504b5acf97203fa5b74f648deefc1053495d25ac43e5fc45bbc78d67"}
Jul 27 21:21:37.723777 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.723621    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:37.738625 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:37.738574    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24" podStartSLOduration=1.738534604 podStartE2EDuration="1.738534604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:21:37.737193506 +0000 UTC m=+1829.100429799" watchObservedRunningTime="2026-07-27 21:21:37.738534604 +0000 UTC m=+1829.101770898"
Jul 27 21:21:48.730547 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:48.730514    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:21:50.815658 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:50.815619    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"]
Jul 27 21:21:50.819296 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:50.819271    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:50.824780 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:50.824752    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:21:50.825306 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:50.825277    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:21:50.841686 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:50.841652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"]
Jul 27 21:21:50.900427 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:50.900383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a3352c-d96f-4465-9e2d-9d8abdf6c259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t\" (UID: \"79a3352c-d96f-4465-9e2d-9d8abdf6c259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:51.001289 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.001232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a3352c-d96f-4465-9e2d-9d8abdf6c259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t\" (UID: \"79a3352c-d96f-4465-9e2d-9d8abdf6c259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:51.001933 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.001913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a3352c-d96f-4465-9e2d-9d8abdf6c259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t\" (UID: \"79a3352c-d96f-4465-9e2d-9d8abdf6c259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:51.130015 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.129925    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:51.280982 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.280953    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"]
Jul 27 21:21:51.283011 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:21:51.282975    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a3352c_d96f_4465_9e2d_9d8abdf6c259.slice/crio-b3aacada5187ca97f747216dd59d002286a1b1d06950239a0627e2a381332bae WatchSource:0}: Error finding container b3aacada5187ca97f747216dd59d002286a1b1d06950239a0627e2a381332bae: Status 404 returned error can't find the container with id b3aacada5187ca97f747216dd59d002286a1b1d06950239a0627e2a381332bae
Jul 27 21:21:51.805621 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.805586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t" event={"ID":"79a3352c-d96f-4465-9e2d-9d8abdf6c259","Type":"ContainerStarted","Data":"905aa8013439b1ec97864e4ea8ad3a4fcf8721e218910cd1b860017fa2cc913d"}
Jul 27 21:21:51.805781 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.805635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t" event={"ID":"79a3352c-d96f-4465-9e2d-9d8abdf6c259","Type":"ContainerStarted","Data":"b3aacada5187ca97f747216dd59d002286a1b1d06950239a0627e2a381332bae"}
Jul 27 21:21:51.821093 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:51.821042    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t" podStartSLOduration=1.821024397 podStartE2EDuration="1.821024397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:21:51.819852565 +0000 UTC m=+1843.183088859" watchObservedRunningTime="2026-07-27 21:21:51.821024397 +0000 UTC m=+1843.184260689"
Jul 27 21:21:52.813216 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:52.813181    2567 generic.go:356] "Generic (PLEG): container finished" podID="79a3352c-d96f-4465-9e2d-9d8abdf6c259" containerID="905aa8013439b1ec97864e4ea8ad3a4fcf8721e218910cd1b860017fa2cc913d" exitCode=0
Jul 27 21:21:52.813402 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:52.813271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t" event={"ID":"79a3352c-d96f-4465-9e2d-9d8abdf6c259","Type":"ContainerDied","Data":"905aa8013439b1ec97864e4ea8ad3a4fcf8721e218910cd1b860017fa2cc913d"}
Jul 27 21:21:53.959117 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:53.959087    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:54.026440 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:54.026405    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a3352c-d96f-4465-9e2d-9d8abdf6c259-maas-api-service-ca\") pod \"79a3352c-d96f-4465-9e2d-9d8abdf6c259\" (UID: \"79a3352c-d96f-4465-9e2d-9d8abdf6c259\") "
Jul 27 21:21:54.026801 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:54.026778    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a3352c-d96f-4465-9e2d-9d8abdf6c259-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79a3352c-d96f-4465-9e2d-9d8abdf6c259" (UID: "79a3352c-d96f-4465-9e2d-9d8abdf6c259"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:21:54.127353 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:54.127230    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79a3352c-d96f-4465-9e2d-9d8abdf6c259-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:21:54.832015 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:54.831985    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"
Jul 27 21:21:54.832015 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:54.832000    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t" event={"ID":"79a3352c-d96f-4465-9e2d-9d8abdf6c259","Type":"ContainerDied","Data":"b3aacada5187ca97f747216dd59d002286a1b1d06950239a0627e2a381332bae"}
Jul 27 21:21:54.832227 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:21:54.832079    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3aacada5187ca97f747216dd59d002286a1b1d06950239a0627e2a381332bae"
Jul 27 21:22:01.260920 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.260883    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"]
Jul 27 21:22:01.261477 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.261182    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24" podUID="c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" containerName="payload-pre-processing" containerID="cri-o://a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0" gracePeriod=30
Jul 27 21:22:01.518002 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.517936    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:22:01.605174 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.605134    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-plugins-config-volume\") pod \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") "
Jul 27 21:22:01.605374 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.605209    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljnlk\" (UniqueName: \"kubernetes.io/projected/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-kube-api-access-ljnlk\") pod \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\" (UID: \"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965\") "
Jul 27 21:22:01.605632 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.605553    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" (UID: "c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:22:01.607472 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.607448    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-kube-api-access-ljnlk" (OuterVolumeSpecName: "kube-api-access-ljnlk") pod "c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" (UID: "c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965"). InnerVolumeSpecName "kube-api-access-ljnlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:22:01.706317 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.706277    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljnlk\" (UniqueName: \"kubernetes.io/projected/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-kube-api-access-ljnlk\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:22:01.706317 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.706312    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:22:01.872634 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.872514    2567 generic.go:356] "Generic (PLEG): container finished" podID="c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" containerID="a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0" exitCode=0
Jul 27 21:22:01.872634 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.872578    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"
Jul 27 21:22:01.872634 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.872600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24" event={"ID":"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965","Type":"ContainerDied","Data":"a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0"}
Jul 27 21:22:01.872852 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.872665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24" event={"ID":"c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965","Type":"ContainerDied","Data":"6d838f7c504b5acf97203fa5b74f648deefc1053495d25ac43e5fc45bbc78d67"}
Jul 27 21:22:01.872852 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.872694    2567 scope.go:117] "RemoveContainer" containerID="a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0"
Jul 27 21:22:01.884582 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.884550    2567 scope.go:117] "RemoveContainer" containerID="a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0"
Jul 27 21:22:01.885081 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:22:01.885060    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0\": container with ID starting with a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0 not found: ID does not exist" containerID="a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0"
Jul 27 21:22:01.885165 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.885089    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0"} err="failed to get container status \"a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0\": rpc error: code = NotFound desc = could not find container \"a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0\": container with ID starting with a0f1f7a594d6c5f75c4cb46537a27cc814b6658c073ea7d38516b3ff87fafdc0 not found: ID does not exist"
Jul 27 21:22:01.894872 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.894842    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"]
Jul 27 21:22:01.901513 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:01.901487    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f154b44a-6449c5b976-lxm24"]
Jul 27 21:22:03.028387 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:03.028348    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" path="/var/lib/kubelet/pods/c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965/volumes"
Jul 27 21:22:05.871744 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:05.871661    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"]
Jul 27 21:22:05.874293 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:05.874267    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f154b44a-rbm8t"]
Jul 27 21:22:07.028836 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:22:07.028795    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a3352c-d96f-4465-9e2d-9d8abdf6c259" path="/var/lib/kubelet/pods/79a3352c-d96f-4465-9e2d-9d8abdf6c259/volumes"
Jul 27 21:23:58.306583 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.306521    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"]
Jul 27 21:23:58.307100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.306903    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a3352c-d96f-4465-9e2d-9d8abdf6c259" containerName="revoke-keys"
Jul 27 21:23:58.307100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.306914    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a3352c-d96f-4465-9e2d-9d8abdf6c259" containerName="revoke-keys"
Jul 27 21:23:58.307100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.306924    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" containerName="payload-pre-processing"
Jul 27 21:23:58.307100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.306930    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" containerName="payload-pre-processing"
Jul 27 21:23:58.307100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.307015    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d9c8bc-2ef4-4481-91f9-aee9cc9b3965" containerName="payload-pre-processing"
Jul 27 21:23:58.307100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.307029    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a3352c-d96f-4465-9e2d-9d8abdf6c259" containerName="revoke-keys"
Jul 27 21:23:58.310397 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.310381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:23:58.312632 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.312612    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:23:58.312731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.312671    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:23:58.317342 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.317319    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"]
Jul 27 21:23:58.423094 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.423055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd06cfe-1479-441e-957c-d433c02fa28b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5876a31-82j5f\" (UID: \"8cd06cfe-1479-441e-957c-d433c02fa28b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:23:58.524691 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.524648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd06cfe-1479-441e-957c-d433c02fa28b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5876a31-82j5f\" (UID: \"8cd06cfe-1479-441e-957c-d433c02fa28b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:23:58.525282 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.525263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd06cfe-1479-441e-957c-d433c02fa28b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5876a31-82j5f\" (UID: \"8cd06cfe-1479-441e-957c-d433c02fa28b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:23:58.622406 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.622317    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:23:58.766850 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:58.766823    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"]
Jul 27 21:23:58.768743 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:23:58.768705    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd06cfe_1479_441e_957c_d433c02fa28b.slice/crio-780b883f78ddfb590220517c87204936cc6868a86fbd3d0f348abeee7f5f1289 WatchSource:0}: Error finding container 780b883f78ddfb590220517c87204936cc6868a86fbd3d0f348abeee7f5f1289: Status 404 returned error can't find the container with id 780b883f78ddfb590220517c87204936cc6868a86fbd3d0f348abeee7f5f1289
Jul 27 21:23:59.562537 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:59.562501    2567 generic.go:356] "Generic (PLEG): container finished" podID="8cd06cfe-1479-441e-957c-d433c02fa28b" containerID="cd16f361cd4de348e407dec834dd30d74612c4e32a8d3b218326931e9672561b" exitCode=0
Jul 27 21:23:59.562944 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:59.562591    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f" event={"ID":"8cd06cfe-1479-441e-957c-d433c02fa28b","Type":"ContainerDied","Data":"cd16f361cd4de348e407dec834dd30d74612c4e32a8d3b218326931e9672561b"}
Jul 27 21:23:59.562944 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:23:59.562647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f" event={"ID":"8cd06cfe-1479-441e-957c-d433c02fa28b","Type":"ContainerStarted","Data":"780b883f78ddfb590220517c87204936cc6868a86fbd3d0f348abeee7f5f1289"}
Jul 27 21:24:00.704970 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:00.704944    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:24:00.845446 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:00.845353    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd06cfe-1479-441e-957c-d433c02fa28b-maas-api-service-ca\") pod \"8cd06cfe-1479-441e-957c-d433c02fa28b\" (UID: \"8cd06cfe-1479-441e-957c-d433c02fa28b\") "
Jul 27 21:24:00.845816 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:00.845774    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd06cfe-1479-441e-957c-d433c02fa28b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8cd06cfe-1479-441e-957c-d433c02fa28b" (UID: "8cd06cfe-1479-441e-957c-d433c02fa28b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:24:00.947171 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:00.947130    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd06cfe-1479-441e-957c-d433c02fa28b-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:24:01.575219 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:01.575181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f" event={"ID":"8cd06cfe-1479-441e-957c-d433c02fa28b","Type":"ContainerDied","Data":"780b883f78ddfb590220517c87204936cc6868a86fbd3d0f348abeee7f5f1289"}
Jul 27 21:24:01.575421 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:01.575223    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"
Jul 27 21:24:01.575421 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:01.575255    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="780b883f78ddfb590220517c87204936cc6868a86fbd3d0f348abeee7f5f1289"
Jul 27 21:24:13.378542 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:13.378495    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"]
Jul 27 21:24:13.380961 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:13.380939    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5876a31-82j5f"]
Jul 27 21:24:15.028986 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:15.028950    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd06cfe-1479-441e-957c-d433c02fa28b" path="/var/lib/kubelet/pods/8cd06cfe-1479-441e-957c-d433c02fa28b/volumes"
Jul 27 21:24:43.837485 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.837443    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"]
Jul 27 21:24:43.840017 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.838111    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd06cfe-1479-441e-957c-d433c02fa28b" containerName="revoke-keys"
Jul 27 21:24:43.840017 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.838130    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd06cfe-1479-441e-957c-d433c02fa28b" containerName="revoke-keys"
Jul 27 21:24:43.840017 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.838271    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd06cfe-1479-441e-957c-d433c02fa28b" containerName="revoke-keys"
Jul 27 21:24:43.841602 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.841584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:43.846303 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.846286    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3499910e-dockercfg-tmzkd\""
Jul 27 21:24:43.846303 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.846294    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3499910e\""
Jul 27 21:24:43.854848 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.854821    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"]
Jul 27 21:24:43.921660 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.921626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chwqk\" (UniqueName: \"kubernetes.io/projected/74447719-74f0-4732-b2ba-0e0eb3a5e41d-kube-api-access-chwqk\") pod \"payload-processing-e2e-mt-3499910e-97b94b58-vdfhk\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") " pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:43.921832 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:43.921680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74447719-74f0-4732-b2ba-0e0eb3a5e41d-plugins-config-volume\") pod \"payload-processing-e2e-mt-3499910e-97b94b58-vdfhk\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") " pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.022546 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.022504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chwqk\" (UniqueName: \"kubernetes.io/projected/74447719-74f0-4732-b2ba-0e0eb3a5e41d-kube-api-access-chwqk\") pod \"payload-processing-e2e-mt-3499910e-97b94b58-vdfhk\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") " pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.022755 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.022588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74447719-74f0-4732-b2ba-0e0eb3a5e41d-plugins-config-volume\") pod \"payload-processing-e2e-mt-3499910e-97b94b58-vdfhk\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") " pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.023388 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.023361    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74447719-74f0-4732-b2ba-0e0eb3a5e41d-plugins-config-volume\") pod \"payload-processing-e2e-mt-3499910e-97b94b58-vdfhk\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") " pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.031280 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.031249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chwqk\" (UniqueName: \"kubernetes.io/projected/74447719-74f0-4732-b2ba-0e0eb3a5e41d-kube-api-access-chwqk\") pod \"payload-processing-e2e-mt-3499910e-97b94b58-vdfhk\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") " pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.152530 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.152438    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.298553 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.298528    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"]
Jul 27 21:24:44.300493 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:24:44.300465    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74447719_74f0_4732_b2ba_0e0eb3a5e41d.slice/crio-10ade9fbcbcf830fde9af0f6db52dd329a03d00a95493ef4202d50b5146a1b43 WatchSource:0}: Error finding container 10ade9fbcbcf830fde9af0f6db52dd329a03d00a95493ef4202d50b5146a1b43: Status 404 returned error can't find the container with id 10ade9fbcbcf830fde9af0f6db52dd329a03d00a95493ef4202d50b5146a1b43
Jul 27 21:24:44.821451 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.821416    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk" event={"ID":"74447719-74f0-4732-b2ba-0e0eb3a5e41d","Type":"ContainerStarted","Data":"4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219"}
Jul 27 21:24:44.821644 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.821495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk" event={"ID":"74447719-74f0-4732-b2ba-0e0eb3a5e41d","Type":"ContainerStarted","Data":"10ade9fbcbcf830fde9af0f6db52dd329a03d00a95493ef4202d50b5146a1b43"}
Jul 27 21:24:44.821644 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.821569    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:24:44.838157 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:44.838099    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk" podStartSLOduration=1.83807744 podStartE2EDuration="1.83807744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:24:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:24:44.838023676 +0000 UTC m=+2016.201259971" watchObservedRunningTime="2026-07-27 21:24:44.83807744 +0000 UTC m=+2016.201313734"
Jul 27 21:24:55.829310 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:24:55.829278    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:25:16.423774 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.423737    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"]
Jul 27 21:25:16.427362 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.427343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:16.429318 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.429295    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:25:16.429453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.429295    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:25:16.433673 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.433646    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"]
Jul 27 21:25:16.521826 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.521791    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3499910e-skpn5\" (UID: \"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:16.623009 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.622971    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3499910e-skpn5\" (UID: \"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:16.623653 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.623632    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3499910e-skpn5\" (UID: \"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:16.740229 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.740136    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:16.881339 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:16.881314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"]
Jul 27 21:25:16.883085 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:25:16.883058    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d01e7e5_e014_47b4_b45f_83dcb6fdcda7.slice/crio-5d46ea818ea691b27ac1b76f011a97ba30aaa19f4f6d28a14d6a73e39a4999cc WatchSource:0}: Error finding container 5d46ea818ea691b27ac1b76f011a97ba30aaa19f4f6d28a14d6a73e39a4999cc: Status 404 returned error can't find the container with id 5d46ea818ea691b27ac1b76f011a97ba30aaa19f4f6d28a14d6a73e39a4999cc
Jul 27 21:25:17.003337 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:17.003301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5" event={"ID":"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7","Type":"ContainerStarted","Data":"5d46ea818ea691b27ac1b76f011a97ba30aaa19f4f6d28a14d6a73e39a4999cc"}
Jul 27 21:25:18.010817 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:18.010779    2567 generic.go:356] "Generic (PLEG): container finished" podID="9d01e7e5-e014-47b4-b45f-83dcb6fdcda7" containerID="c350c6fe26c6457943a90a47f50a8378ce36fee7e6f37bf969a98e2827d617ea" exitCode=0
Jul 27 21:25:18.011263 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:18.010870    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5" event={"ID":"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7","Type":"ContainerDied","Data":"c350c6fe26c6457943a90a47f50a8378ce36fee7e6f37bf969a98e2827d617ea"}
Jul 27 21:25:19.162268 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:19.162243    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:19.251181 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:19.251138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7-maas-api-service-ca\") pod \"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7\" (UID: \"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7\") "
Jul 27 21:25:19.251530 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:19.251501    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d01e7e5-e014-47b4-b45f-83dcb6fdcda7" (UID: "9d01e7e5-e014-47b4-b45f-83dcb6fdcda7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:19.352799 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:19.352705    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:25:20.023062 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:20.023033    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"
Jul 27 21:25:20.023239 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:20.023064    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5" event={"ID":"9d01e7e5-e014-47b4-b45f-83dcb6fdcda7","Type":"ContainerDied","Data":"5d46ea818ea691b27ac1b76f011a97ba30aaa19f4f6d28a14d6a73e39a4999cc"}
Jul 27 21:25:20.023239 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:20.023107    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d46ea818ea691b27ac1b76f011a97ba30aaa19f4f6d28a14d6a73e39a4999cc"
Jul 27 21:25:31.999131 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:31.999036    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"]
Jul 27 21:25:31.999633 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:31.999288    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk" podUID="74447719-74f0-4732-b2ba-0e0eb3a5e41d" containerName="payload-processing" containerID="cri-o://4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219" gracePeriod=30
Jul 27 21:25:32.256739 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.256670    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:25:32.375464 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.375432    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chwqk\" (UniqueName: \"kubernetes.io/projected/74447719-74f0-4732-b2ba-0e0eb3a5e41d-kube-api-access-chwqk\") pod \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") "
Jul 27 21:25:32.375676 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.375512    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74447719-74f0-4732-b2ba-0e0eb3a5e41d-plugins-config-volume\") pod \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\" (UID: \"74447719-74f0-4732-b2ba-0e0eb3a5e41d\") "
Jul 27 21:25:32.375996 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.375951    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74447719-74f0-4732-b2ba-0e0eb3a5e41d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74447719-74f0-4732-b2ba-0e0eb3a5e41d" (UID: "74447719-74f0-4732-b2ba-0e0eb3a5e41d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:32.377832 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.377804    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74447719-74f0-4732-b2ba-0e0eb3a5e41d-kube-api-access-chwqk" (OuterVolumeSpecName: "kube-api-access-chwqk") pod "74447719-74f0-4732-b2ba-0e0eb3a5e41d" (UID: "74447719-74f0-4732-b2ba-0e0eb3a5e41d"). InnerVolumeSpecName "kube-api-access-chwqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:32.476545 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.476508    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74447719-74f0-4732-b2ba-0e0eb3a5e41d-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:25:32.476545 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:32.476538    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chwqk\" (UniqueName: \"kubernetes.io/projected/74447719-74f0-4732-b2ba-0e0eb3a5e41d-kube-api-access-chwqk\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:25:33.095865 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.095829    2567 generic.go:356] "Generic (PLEG): container finished" podID="74447719-74f0-4732-b2ba-0e0eb3a5e41d" containerID="4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219" exitCode=0
Jul 27 21:25:33.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.095875    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"
Jul 27 21:25:33.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.095909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk" event={"ID":"74447719-74f0-4732-b2ba-0e0eb3a5e41d","Type":"ContainerDied","Data":"4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219"}
Jul 27 21:25:33.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.095970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk" event={"ID":"74447719-74f0-4732-b2ba-0e0eb3a5e41d","Type":"ContainerDied","Data":"10ade9fbcbcf830fde9af0f6db52dd329a03d00a95493ef4202d50b5146a1b43"}
Jul 27 21:25:33.096294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.095996    2567 scope.go:117] "RemoveContainer" containerID="4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219"
Jul 27 21:25:33.104992 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.104971    2567 scope.go:117] "RemoveContainer" containerID="4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219"
Jul 27 21:25:33.105268 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:25:33.105249    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219\": container with ID starting with 4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219 not found: ID does not exist" containerID="4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219"
Jul 27 21:25:33.105330 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.105281    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219"} err="failed to get container status \"4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219\": rpc error: code = NotFound desc = could not find container \"4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219\": container with ID starting with 4615e6f1f95f9e49e9ccb08dc2a958a24e897dfe5137e70ab47e97f7fb0ea219 not found: ID does not exist"
Jul 27 21:25:33.112397 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.112374    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"]
Jul 27 21:25:33.115409 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:33.115383    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3499910e-97b94b58-vdfhk"]
Jul 27 21:25:35.028497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:35.028463    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74447719-74f0-4732-b2ba-0e0eb3a5e41d" path="/var/lib/kubelet/pods/74447719-74f0-4732-b2ba-0e0eb3a5e41d/volumes"
Jul 27 21:25:36.491418 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:36.491385    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"]
Jul 27 21:25:36.493689 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:36.493668    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3499910e-skpn5"]
Jul 27 21:25:37.028472 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:25:37.028441    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d01e7e5-e014-47b4-b45f-83dcb6fdcda7" path="/var/lib/kubelet/pods/9d01e7e5-e014-47b4-b45f-83dcb6fdcda7/volumes"
Jul 27 21:27:09.258081 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:09.258003    2567 scope.go:117] "RemoveContainer" containerID="e94c288be937cfd15b8f313bae9b56f56bd13477d7f890351db2c4d78e1358bf"
Jul 27 21:27:27.579044 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579006    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"]
Jul 27 21:27:27.579505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579380    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74447719-74f0-4732-b2ba-0e0eb3a5e41d" containerName="payload-processing"
Jul 27 21:27:27.579505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579392    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="74447719-74f0-4732-b2ba-0e0eb3a5e41d" containerName="payload-processing"
Jul 27 21:27:27.579505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579411    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d01e7e5-e014-47b4-b45f-83dcb6fdcda7" containerName="revoke-keys"
Jul 27 21:27:27.579505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579417    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d01e7e5-e014-47b4-b45f-83dcb6fdcda7" containerName="revoke-keys"
Jul 27 21:27:27.579505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579482    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="74447719-74f0-4732-b2ba-0e0eb3a5e41d" containerName="payload-processing"
Jul 27 21:27:27.579505 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.579490    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d01e7e5-e014-47b4-b45f-83dcb6fdcda7" containerName="revoke-keys"
Jul 27 21:27:27.582625 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.582606    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.584961 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.584938    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-029d89-dockercfg-6gb4z\""
Jul 27 21:27:27.585101 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.585085    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-029d89\""
Jul 27 21:27:27.592599 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.592575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"]
Jul 27 21:27:27.623698 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.623672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2gx\" (UniqueName: \"kubernetes.io/projected/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-kube-api-access-5l2gx\") pod \"payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.623822 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.623718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.724620 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.724581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.724791 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.724701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2gx\" (UniqueName: \"kubernetes.io/projected/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-kube-api-access-5l2gx\") pod \"payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.725282 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.725264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.732763 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.732740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2gx\" (UniqueName: \"kubernetes.io/projected/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-kube-api-access-5l2gx\") pod \"payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:27.894739 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:27.894659    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:28.039339 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:28.039307    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"]
Jul 27 21:27:28.041362 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:27:28.041336    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e518f1_45e3_4de2_86f1_d4d8d89953fc.slice/crio-18b5da47e03718726b7ab3c04a57f77df269462f1589949cac6b7b59ff4db8aa WatchSource:0}: Error finding container 18b5da47e03718726b7ab3c04a57f77df269462f1589949cac6b7b59ff4db8aa: Status 404 returned error can't find the container with id 18b5da47e03718726b7ab3c04a57f77df269462f1589949cac6b7b59ff4db8aa
Jul 27 21:27:28.762886 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:28.762843    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9" event={"ID":"a3e518f1-45e3-4de2-86f1-d4d8d89953fc","Type":"ContainerStarted","Data":"1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9"}
Jul 27 21:27:28.763285 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:28.762911    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:28.763285 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:28.762937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9" event={"ID":"a3e518f1-45e3-4de2-86f1-d4d8d89953fc","Type":"ContainerStarted","Data":"18b5da47e03718726b7ab3c04a57f77df269462f1589949cac6b7b59ff4db8aa"}
Jul 27 21:27:28.780598 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:28.780529    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9" podStartSLOduration=1.7805133020000001 podStartE2EDuration="1.780513302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:27:28.778400559 +0000 UTC m=+2180.141636852" watchObservedRunningTime="2026-07-27 21:27:28.780513302 +0000 UTC m=+2180.143749613"
Jul 27 21:27:36.185259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.185223    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"]
Jul 27 21:27:36.188830 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.188812    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.198936 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.198911    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ccc682-dockercfg-gjgq5\""
Jul 27 21:27:36.204637 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.204617    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ccc682\""
Jul 27 21:27:36.214783 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.214750    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"]
Jul 27 21:27:36.218825 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.218804    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"]
Jul 27 21:27:36.218948 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.218894    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.246983 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.246956    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"]
Jul 27 21:27:36.304803 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.304771    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/b5037bea-f516-4add-9c2f-d13f748652a7-kube-api-access-gsqsw\") pod \"payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.304972 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.304809    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df0174d8-fe71-499b-822b-16e227121755-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.304972 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.304837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ttq\" (UniqueName: \"kubernetes.io/projected/df0174d8-fe71-499b-822b-16e227121755-kube-api-access-m7ttq\") pod \"payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.304972 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.304918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5037bea-f516-4add-9c2f-d13f748652a7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.405431 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.405396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/b5037bea-f516-4add-9c2f-d13f748652a7-kube-api-access-gsqsw\") pod \"payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.405431 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.405437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df0174d8-fe71-499b-822b-16e227121755-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.405688 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.405454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ttq\" (UniqueName: \"kubernetes.io/projected/df0174d8-fe71-499b-822b-16e227121755-kube-api-access-m7ttq\") pod \"payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.405688 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.405596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5037bea-f516-4add-9c2f-d13f748652a7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.406178 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.406161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df0174d8-fe71-499b-822b-16e227121755-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.406283 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.406265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5037bea-f516-4add-9c2f-d13f748652a7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.419973 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.419941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ttq\" (UniqueName: \"kubernetes.io/projected/df0174d8-fe71-499b-822b-16e227121755-kube-api-access-m7ttq\") pod \"payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.419973 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.419956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/b5037bea-f516-4add-9c2f-d13f748652a7-kube-api-access-gsqsw\") pod \"payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.499024 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.498988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.539343 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.539312    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.664919 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.664892    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"]
Jul 27 21:27:36.667824 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:27:36.667781    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0174d8_fe71_499b_822b_16e227121755.slice/crio-c85082e257fe4addbbb471489970e7bdc1f9a41a14e6bc3f275163dc7bfb9ec9 WatchSource:0}: Error finding container c85082e257fe4addbbb471489970e7bdc1f9a41a14e6bc3f275163dc7bfb9ec9: Status 404 returned error can't find the container with id c85082e257fe4addbbb471489970e7bdc1f9a41a14e6bc3f275163dc7bfb9ec9
Jul 27 21:27:36.726502 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.726438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"]
Jul 27 21:27:36.728725 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:27:36.728697    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5037bea_f516_4add_9c2f_d13f748652a7.slice/crio-8bb51b1ff47b63a8035d37813f2e639aeb4fa1f4cc61dadcb06d024241fb0ffc WatchSource:0}: Error finding container 8bb51b1ff47b63a8035d37813f2e639aeb4fa1f4cc61dadcb06d024241fb0ffc: Status 404 returned error can't find the container with id 8bb51b1ff47b63a8035d37813f2e639aeb4fa1f4cc61dadcb06d024241fb0ffc
Jul 27 21:27:36.808746 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.808710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n" event={"ID":"b5037bea-f516-4add-9c2f-d13f748652a7","Type":"ContainerStarted","Data":"4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd"}
Jul 27 21:27:36.808905 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.808775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n" event={"ID":"b5037bea-f516-4add-9c2f-d13f748652a7","Type":"ContainerStarted","Data":"8bb51b1ff47b63a8035d37813f2e639aeb4fa1f4cc61dadcb06d024241fb0ffc"}
Jul 27 21:27:36.809080 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.809046    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:27:36.810626 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.810597    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw" event={"ID":"df0174d8-fe71-499b-822b-16e227121755","Type":"ContainerStarted","Data":"fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece"}
Jul 27 21:27:36.810751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.810643    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw" event={"ID":"df0174d8-fe71-499b-822b-16e227121755","Type":"ContainerStarted","Data":"c85082e257fe4addbbb471489970e7bdc1f9a41a14e6bc3f275163dc7bfb9ec9"}
Jul 27 21:27:36.810751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.810677    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:36.854587 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.854518    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n" podStartSLOduration=0.854501966 podStartE2EDuration="854.501966ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:27:36.850446376 +0000 UTC m=+2188.213682669" watchObservedRunningTime="2026-07-27 21:27:36.854501966 +0000 UTC m=+2188.217738238"
Jul 27 21:27:36.901177 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:36.901114    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw" podStartSLOduration=0.901093086 podStartE2EDuration="901.093086ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:27:36.900505435 +0000 UTC m=+2188.263741731" watchObservedRunningTime="2026-07-27 21:27:36.901093086 +0000 UTC m=+2188.264329378"
Jul 27 21:27:39.770416 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:39.770391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:27:47.819362 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:47.819332    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:27:48.824126 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:27:48.824097    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:28:09.279870 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:09.279838    2567 scope.go:117] "RemoveContainer" containerID="73ae92d48e17cafe48d0f8bc32f4660e733d2c8c5c798b2d0efbc1ba60478ee7"
Jul 27 21:28:09.288596 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:09.288571    2567 scope.go:117] "RemoveContainer" containerID="905aa8013439b1ec97864e4ea8ad3a4fcf8721e218910cd1b860017fa2cc913d"
Jul 27 21:28:54.982295 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:54.982257    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"]
Jul 27 21:28:54.985818 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:54.985800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:54.988857 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:54.988835    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:28:54.988857 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:54.988846    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:28:54.999878 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:54.999856    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"]
Jul 27 21:28:55.031775 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:55.031742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-029d89-t94jp\" (UID: \"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:55.133259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:55.133219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-029d89-t94jp\" (UID: \"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:55.133890 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:55.133869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-029d89-t94jp\" (UID: \"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:55.296766 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:55.296729    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:55.455032 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:55.454989    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"]
Jul 27 21:28:55.456347 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:28:55.456319    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0aa5b3d_e0f3_41b1_af13_1b5ad4cbee72.slice/crio-d6271e7dc6238a8a5e7852595a3168411eb77a0144cc499d8ef01302a41b2254 WatchSource:0}: Error finding container d6271e7dc6238a8a5e7852595a3168411eb77a0144cc499d8ef01302a41b2254: Status 404 returned error can't find the container with id d6271e7dc6238a8a5e7852595a3168411eb77a0144cc499d8ef01302a41b2254
Jul 27 21:28:56.257892 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:56.257859    2567 generic.go:356] "Generic (PLEG): container finished" podID="f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72" containerID="367af0b7c65d9cb5f97aae164fa0858aca1abb594534e2b743f71aeec4f39726" exitCode=0
Jul 27 21:28:56.258299 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:56.257955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp" event={"ID":"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72","Type":"ContainerDied","Data":"367af0b7c65d9cb5f97aae164fa0858aca1abb594534e2b743f71aeec4f39726"}
Jul 27 21:28:56.258299 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:56.258033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp" event={"ID":"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72","Type":"ContainerStarted","Data":"d6271e7dc6238a8a5e7852595a3168411eb77a0144cc499d8ef01302a41b2254"}
Jul 27 21:28:57.399957 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:57.399929    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:57.457669 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:57.457632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72-maas-api-service-ca\") pod \"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72\" (UID: \"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72\") "
Jul 27 21:28:57.457996 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:57.457973    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72" (UID: "f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:28:57.559283 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:57.559194    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:28:58.270371 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:58.270340    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"
Jul 27 21:28:58.270371 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:58.270348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp" event={"ID":"f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72","Type":"ContainerDied","Data":"d6271e7dc6238a8a5e7852595a3168411eb77a0144cc499d8ef01302a41b2254"}
Jul 27 21:28:58.270606 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:28:58.270392    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6271e7dc6238a8a5e7852595a3168411eb77a0144cc499d8ef01302a41b2254"
Jul 27 21:29:05.963973 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:05.963939    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"]
Jul 27 21:29:05.964372 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:05.964187    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9" podUID="a3e518f1-45e3-4de2-86f1-d4d8d89953fc" containerName="payload-processing" containerID="cri-o://1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9" gracePeriod=30
Jul 27 21:29:06.232305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.232278    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:29:06.314442 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.314403    2567 generic.go:356] "Generic (PLEG): container finished" podID="a3e518f1-45e3-4de2-86f1-d4d8d89953fc" containerID="1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9" exitCode=0
Jul 27 21:29:06.314442 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.314443    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"
Jul 27 21:29:06.314661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.314485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9" event={"ID":"a3e518f1-45e3-4de2-86f1-d4d8d89953fc","Type":"ContainerDied","Data":"1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9"}
Jul 27 21:29:06.314661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.314528    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9" event={"ID":"a3e518f1-45e3-4de2-86f1-d4d8d89953fc","Type":"ContainerDied","Data":"18b5da47e03718726b7ab3c04a57f77df269462f1589949cac6b7b59ff4db8aa"}
Jul 27 21:29:06.314661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.314568    2567 scope.go:117] "RemoveContainer" containerID="1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9"
Jul 27 21:29:06.323654 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.323637    2567 scope.go:117] "RemoveContainer" containerID="1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9"
Jul 27 21:29:06.323900 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:29:06.323881    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9\": container with ID starting with 1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9 not found: ID does not exist" containerID="1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9"
Jul 27 21:29:06.323949 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.323909    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9"} err="failed to get container status \"1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9\": rpc error: code = NotFound desc = could not find container \"1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9\": container with ID starting with 1422359b1364460c67a0d28412202ab4e0b3c636f9079cd740eccd32bfcd7ee9 not found: ID does not exist"
Jul 27 21:29:06.342207 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.342188    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l2gx\" (UniqueName: \"kubernetes.io/projected/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-kube-api-access-5l2gx\") pod \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") "
Jul 27 21:29:06.342382 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.342371    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-plugins-config-volume\") pod \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\" (UID: \"a3e518f1-45e3-4de2-86f1-d4d8d89953fc\") "
Jul 27 21:29:06.342713 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.342691    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3e518f1-45e3-4de2-86f1-d4d8d89953fc" (UID: "a3e518f1-45e3-4de2-86f1-d4d8d89953fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:06.344483 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.344459    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-kube-api-access-5l2gx" (OuterVolumeSpecName: "kube-api-access-5l2gx") pod "a3e518f1-45e3-4de2-86f1-d4d8d89953fc" (UID: "a3e518f1-45e3-4de2-86f1-d4d8d89953fc"). InnerVolumeSpecName "kube-api-access-5l2gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:29:06.443868 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.443832    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l2gx\" (UniqueName: \"kubernetes.io/projected/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-kube-api-access-5l2gx\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:29:06.443868 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.443861    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3e518f1-45e3-4de2-86f1-d4d8d89953fc-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:29:06.657232 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.657193    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"]
Jul 27 21:29:06.664641 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:06.664613    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-029d89-578fc579b6-qtqs9"]
Jul 27 21:29:07.029345 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:07.029312    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3e518f1-45e3-4de2-86f1-d4d8d89953fc" path="/var/lib/kubelet/pods/a3e518f1-45e3-4de2-86f1-d4d8d89953fc/volumes"
Jul 27 21:29:10.153450 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:10.153411    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"]
Jul 27 21:29:10.161386 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:10.161356    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-029d89-t94jp"]
Jul 27 21:29:11.028915 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:11.028877    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72" path="/var/lib/kubelet/pods/f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72/volumes"
Jul 27 21:29:29.370159 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.370127    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"]
Jul 27 21:29:29.370707 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.370342    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw" podUID="df0174d8-fe71-499b-822b-16e227121755" containerName="payload-pre-processing" containerID="cri-o://fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece" gracePeriod=30
Jul 27 21:29:29.372435 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.372411    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"]
Jul 27 21:29:29.372662 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.372629    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n" podUID="b5037bea-f516-4add-9c2f-d13f748652a7" containerName="payload-processing" containerID="cri-o://4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd" gracePeriod=30
Jul 27 21:29:29.667483 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.667458    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:29:29.670194 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.670172    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:29:29.758627 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.758594    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7ttq\" (UniqueName: \"kubernetes.io/projected/df0174d8-fe71-499b-822b-16e227121755-kube-api-access-m7ttq\") pod \"df0174d8-fe71-499b-822b-16e227121755\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") "
Jul 27 21:29:29.758826 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.758641    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/b5037bea-f516-4add-9c2f-d13f748652a7-kube-api-access-gsqsw\") pod \"b5037bea-f516-4add-9c2f-d13f748652a7\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") "
Jul 27 21:29:29.758826 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.758702    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df0174d8-fe71-499b-822b-16e227121755-plugins-config-volume\") pod \"df0174d8-fe71-499b-822b-16e227121755\" (UID: \"df0174d8-fe71-499b-822b-16e227121755\") "
Jul 27 21:29:29.758826 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.758746    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5037bea-f516-4add-9c2f-d13f748652a7-plugins-config-volume\") pod \"b5037bea-f516-4add-9c2f-d13f748652a7\" (UID: \"b5037bea-f516-4add-9c2f-d13f748652a7\") "
Jul 27 21:29:29.759109 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.759079    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5037bea-f516-4add-9c2f-d13f748652a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5037bea-f516-4add-9c2f-d13f748652a7" (UID: "b5037bea-f516-4add-9c2f-d13f748652a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:29.759109 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.759096    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df0174d8-fe71-499b-822b-16e227121755-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df0174d8-fe71-499b-822b-16e227121755" (UID: "df0174d8-fe71-499b-822b-16e227121755"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:29.761051 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.761017    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0174d8-fe71-499b-822b-16e227121755-kube-api-access-m7ttq" (OuterVolumeSpecName: "kube-api-access-m7ttq") pod "df0174d8-fe71-499b-822b-16e227121755" (UID: "df0174d8-fe71-499b-822b-16e227121755"). InnerVolumeSpecName "kube-api-access-m7ttq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:29:29.761168 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.761077    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5037bea-f516-4add-9c2f-d13f748652a7-kube-api-access-gsqsw" (OuterVolumeSpecName: "kube-api-access-gsqsw") pod "b5037bea-f516-4add-9c2f-d13f748652a7" (UID: "b5037bea-f516-4add-9c2f-d13f748652a7"). InnerVolumeSpecName "kube-api-access-gsqsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:29:29.860104 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.860065    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7ttq\" (UniqueName: \"kubernetes.io/projected/df0174d8-fe71-499b-822b-16e227121755-kube-api-access-m7ttq\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:29:29.860104 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.860099    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/b5037bea-f516-4add-9c2f-d13f748652a7-kube-api-access-gsqsw\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:29:29.860104 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.860110    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df0174d8-fe71-499b-822b-16e227121755-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:29:29.860350 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:29.860119    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5037bea-f516-4add-9c2f-d13f748652a7-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:29:30.457618 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.457547    2567 generic.go:356] "Generic (PLEG): container finished" podID="df0174d8-fe71-499b-822b-16e227121755" containerID="fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece" exitCode=0
Jul 27 21:29:30.457618 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.457604    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"
Jul 27 21:29:30.458148 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.457658    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw" event={"ID":"df0174d8-fe71-499b-822b-16e227121755","Type":"ContainerDied","Data":"fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece"}
Jul 27 21:29:30.458148 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.457707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw" event={"ID":"df0174d8-fe71-499b-822b-16e227121755","Type":"ContainerDied","Data":"c85082e257fe4addbbb471489970e7bdc1f9a41a14e6bc3f275163dc7bfb9ec9"}
Jul 27 21:29:30.458148 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.457733    2567 scope.go:117] "RemoveContainer" containerID="fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece"
Jul 27 21:29:30.459147 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.459122    2567 generic.go:356] "Generic (PLEG): container finished" podID="b5037bea-f516-4add-9c2f-d13f748652a7" containerID="4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd" exitCode=0
Jul 27 21:29:30.459226 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.459165    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"
Jul 27 21:29:30.459285 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.459205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n" event={"ID":"b5037bea-f516-4add-9c2f-d13f748652a7","Type":"ContainerDied","Data":"4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd"}
Jul 27 21:29:30.459447 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.459431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n" event={"ID":"b5037bea-f516-4add-9c2f-d13f748652a7","Type":"ContainerDied","Data":"8bb51b1ff47b63a8035d37813f2e639aeb4fa1f4cc61dadcb06d024241fb0ffc"}
Jul 27 21:29:30.468140 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.468081    2567 scope.go:117] "RemoveContainer" containerID="fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece"
Jul 27 21:29:30.468516 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:29:30.468416    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece\": container with ID starting with fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece not found: ID does not exist" containerID="fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece"
Jul 27 21:29:30.468516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.468452    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece"} err="failed to get container status \"fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece\": rpc error: code = NotFound desc = could not find container \"fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece\": container with ID starting with fa9677aef30a8327114ee86e6256d802b0d28e7c6c588eba99fed2cfa0e94ece not found: ID does not exist"
Jul 27 21:29:30.468516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.468475    2567 scope.go:117] "RemoveContainer" containerID="4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd"
Jul 27 21:29:30.477669 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.477649    2567 scope.go:117] "RemoveContainer" containerID="4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd"
Jul 27 21:29:30.477985 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:29:30.477960    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd\": container with ID starting with 4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd not found: ID does not exist" containerID="4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd"
Jul 27 21:29:30.478087 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.477993    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd"} err="failed to get container status \"4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd\": rpc error: code = NotFound desc = could not find container \"4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd\": container with ID starting with 4126f0aad483a83432c2262db4ed616070642aa9f6c3d05c6ed86f5595fc49fd not found: ID does not exist"
Jul 27 21:29:30.487866 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.487835    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"]
Jul 27 21:29:30.491650 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.491621    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ccc682-75d79d75d-fm84n"]
Jul 27 21:29:30.513453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.513423    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"]
Jul 27 21:29:30.518571 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:30.518530    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ccc682-56bbfdfbdd-9knrw"]
Jul 27 21:29:31.029024 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:31.028991    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5037bea-f516-4add-9c2f-d13f748652a7" path="/var/lib/kubelet/pods/b5037bea-f516-4add-9c2f-d13f748652a7/volumes"
Jul 27 21:29:31.029349 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:31.029336    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0174d8-fe71-499b-822b-16e227121755" path="/var/lib/kubelet/pods/df0174d8-fe71-499b-822b-16e227121755/volumes"
Jul 27 21:29:53.468073 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468031    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"]
Jul 27 21:29:53.468619 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468578    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0174d8-fe71-499b-822b-16e227121755" containerName="payload-pre-processing"
Jul 27 21:29:53.468619 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468594    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0174d8-fe71-499b-822b-16e227121755" containerName="payload-pre-processing"
Jul 27 21:29:53.468619 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468611    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5037bea-f516-4add-9c2f-d13f748652a7" containerName="payload-processing"
Jul 27 21:29:53.468619 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468616    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5037bea-f516-4add-9c2f-d13f748652a7" containerName="payload-processing"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468632    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72" containerName="revoke-keys"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468638    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72" containerName="revoke-keys"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468651    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e518f1-45e3-4de2-86f1-d4d8d89953fc" containerName="payload-processing"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468656    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e518f1-45e3-4de2-86f1-d4d8d89953fc" containerName="payload-processing"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468758    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5037bea-f516-4add-9c2f-d13f748652a7" containerName="payload-processing"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468772    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0aa5b3d-e0f3-41b1-af13-1b5ad4cbee72" containerName="revoke-keys"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468784    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e518f1-45e3-4de2-86f1-d4d8d89953fc" containerName="payload-processing"
Jul 27 21:29:53.468829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.468793    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0174d8-fe71-499b-822b-16e227121755" containerName="payload-pre-processing"
Jul 27 21:29:53.471837 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.471820    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.476364 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.476326    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jc7bw\""
Jul 27 21:29:53.476491 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.476325    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-55137c-serving-cert\""
Jul 27 21:29:53.476491 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.476343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:29:53.476491 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.476344    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:29:53.495774 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.495748    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"]
Jul 27 21:29:53.589549 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.589509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f57772c-54e8-479e-a48c-2bb4399787bf-maas-api-tls\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.589777 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.589598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg7hm\" (UniqueName: \"kubernetes.io/projected/8f57772c-54e8-479e-a48c-2bb4399787bf-kube-api-access-vg7hm\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.589777 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.589675    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f57772c-54e8-479e-a48c-2bb4399787bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.690581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.690466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f57772c-54e8-479e-a48c-2bb4399787bf-maas-api-tls\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.690581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.690504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg7hm\" (UniqueName: \"kubernetes.io/projected/8f57772c-54e8-479e-a48c-2bb4399787bf-kube-api-access-vg7hm\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.690581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.690529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f57772c-54e8-479e-a48c-2bb4399787bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.691230 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.691180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f57772c-54e8-479e-a48c-2bb4399787bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.693189 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.693163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f57772c-54e8-479e-a48c-2bb4399787bf-maas-api-tls\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.707617 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.707593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg7hm\" (UniqueName: \"kubernetes.io/projected/8f57772c-54e8-479e-a48c-2bb4399787bf-kube-api-access-vg7hm\") pod \"maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.782336 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.782302    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:53.949088 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.949063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"]
Jul 27 21:29:53.951228 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:29:53.951205    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f57772c_54e8_479e_a48c_2bb4399787bf.slice/crio-895b822252f329b52e0dd1206bec0e0a8194fb81149e9cc43bbb23051a3ed4d8 WatchSource:0}: Error finding container 895b822252f329b52e0dd1206bec0e0a8194fb81149e9cc43bbb23051a3ed4d8: Status 404 returned error can't find the container with id 895b822252f329b52e0dd1206bec0e0a8194fb81149e9cc43bbb23051a3ed4d8
Jul 27 21:29:53.952972 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:53.952954    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:29:54.604123 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.604082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7" event={"ID":"8f57772c-54e8-479e-a48c-2bb4399787bf","Type":"ContainerStarted","Data":"895b822252f329b52e0dd1206bec0e0a8194fb81149e9cc43bbb23051a3ed4d8"}
Jul 27 21:29:54.694822 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.694785    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"]
Jul 27 21:29:54.698417 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.698389    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:54.703046 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.703019    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-55137c\""
Jul 27 21:29:54.724690 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.724345    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"]
Jul 27 21:29:54.753367 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.753333    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"]
Jul 27 21:29:54.757713 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.757686    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:54.761115 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.761088    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-55137c-dockercfg-5jf52\""
Jul 27 21:29:54.780783 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.780702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"]
Jul 27 21:29:54.801992 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.801805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnp2v\" (UniqueName: \"kubernetes.io/projected/6661f758-0299-4bb8-b41f-5c6420ef9c23-kube-api-access-hnp2v\") pod \"payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:54.801992 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.801949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6661f758-0299-4bb8-b41f-5c6420ef9c23-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:54.903547 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.903454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6661f758-0299-4bb8-b41f-5c6420ef9c23-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:54.903547 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.903534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7kmt\" (UniqueName: \"kubernetes.io/projected/3198a853-41c5-4016-83da-dce3efd3bec4-kube-api-access-m7kmt\") pod \"payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") " pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:54.903809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.903597    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnp2v\" (UniqueName: \"kubernetes.io/projected/6661f758-0299-4bb8-b41f-5c6420ef9c23-kube-api-access-hnp2v\") pod \"payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:54.903809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.903632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3198a853-41c5-4016-83da-dce3efd3bec4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") " pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:54.904363 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.904336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6661f758-0299-4bb8-b41f-5c6420ef9c23-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:54.915003 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:54.914841    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnp2v\" (UniqueName: \"kubernetes.io/projected/6661f758-0299-4bb8-b41f-5c6420ef9c23-kube-api-access-hnp2v\") pod \"payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:55.004236 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.004198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3198a853-41c5-4016-83da-dce3efd3bec4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") " pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:55.004434 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.004344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7kmt\" (UniqueName: \"kubernetes.io/projected/3198a853-41c5-4016-83da-dce3efd3bec4-kube-api-access-m7kmt\") pod \"payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") " pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:55.005148 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.005123    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3198a853-41c5-4016-83da-dce3efd3bec4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") " pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:55.013145 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.013113    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:55.014805 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.014778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7kmt\" (UniqueName: \"kubernetes.io/projected/3198a853-41c5-4016-83da-dce3efd3bec4-kube-api-access-m7kmt\") pod \"payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") " pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:55.072904 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.072857    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:55.203151 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.203120    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"]
Jul 27 21:29:55.260522 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:55.260496    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"]
Jul 27 21:29:56.292775 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:29:56.292745    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6661f758_0299_4bb8_b41f_5c6420ef9c23.slice/crio-3dd84a43109e73cf37fd54d915b906f1e2d8abae3b45748bd28a1c54d056d885 WatchSource:0}: Error finding container 3dd84a43109e73cf37fd54d915b906f1e2d8abae3b45748bd28a1c54d056d885: Status 404 returned error can't find the container with id 3dd84a43109e73cf37fd54d915b906f1e2d8abae3b45748bd28a1c54d056d885
Jul 27 21:29:56.293605 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:29:56.293340    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3198a853_41c5_4016_83da_dce3efd3bec4.slice/crio-cf8183e8e464845c09fd03418d2f58f373a4c288c6ca00fa63fb6374c02cb04f WatchSource:0}: Error finding container cf8183e8e464845c09fd03418d2f58f373a4c288c6ca00fa63fb6374c02cb04f: Status 404 returned error can't find the container with id cf8183e8e464845c09fd03418d2f58f373a4c288c6ca00fa63fb6374c02cb04f
Jul 27 21:29:56.618887 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.618784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7" event={"ID":"8f57772c-54e8-479e-a48c-2bb4399787bf","Type":"ContainerStarted","Data":"9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c"}
Jul 27 21:29:56.618887 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.618855    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:29:56.620329 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.620306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj" event={"ID":"3198a853-41c5-4016-83da-dce3efd3bec4","Type":"ContainerStarted","Data":"081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847"}
Jul 27 21:29:56.620464 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.620352    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:29:56.620464 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.620371    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj" event={"ID":"3198a853-41c5-4016-83da-dce3efd3bec4","Type":"ContainerStarted","Data":"cf8183e8e464845c09fd03418d2f58f373a4c288c6ca00fa63fb6374c02cb04f"}
Jul 27 21:29:56.621744 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.621722    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh" event={"ID":"6661f758-0299-4bb8-b41f-5c6420ef9c23","Type":"ContainerStarted","Data":"f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3"}
Jul 27 21:29:56.621841 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.621764    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh" event={"ID":"6661f758-0299-4bb8-b41f-5c6420ef9c23","Type":"ContainerStarted","Data":"3dd84a43109e73cf37fd54d915b906f1e2d8abae3b45748bd28a1c54d056d885"}
Jul 27 21:29:56.621841 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.621793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:29:56.642496 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.642446    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7" podStartSLOduration=1.244098111 podStartE2EDuration="3.642432923s" totalImagesPullingTime="2.398334812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:56.639938878 +0000 UTC m=+2328.003175171" watchObservedRunningTime="2026-07-27 21:29:56.642432923 +0000 UTC m=+2328.005669215"
Jul 27 21:29:56.667486 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.667427    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj" podStartSLOduration=2.667409051 podStartE2EDuration="2.667409051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:56.66687803 +0000 UTC m=+2328.030114324" watchObservedRunningTime="2026-07-27 21:29:56.667409051 +0000 UTC m=+2328.030645345"
Jul 27 21:29:56.695321 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:29:56.695265    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh" podStartSLOduration=2.6952461210000003 podStartE2EDuration="2.695246121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:56.694839556 +0000 UTC m=+2328.058075859" watchObservedRunningTime="2026-07-27 21:29:56.695246121 +0000 UTC m=+2328.058482415"
Jul 27 21:30:00.144713 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.144624    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"]
Jul 27 21:30:00.148414 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.148390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"
Jul 27 21:30:00.151484 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.151458    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:30:00.160680 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.160640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"]
Jul 27 21:30:00.161455 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.161427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"
Jul 27 21:30:00.322361 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.322328    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"]
Jul 27 21:30:00.325472 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:30:00.325445    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c6dbda_a271_415b_9094_746689b497ac.slice/crio-2ae70fcfeb193177dd716f5d912248a85ee14110fc9239516df152ce58eced0c WatchSource:0}: Error finding container 2ae70fcfeb193177dd716f5d912248a85ee14110fc9239516df152ce58eced0c: Status 404 returned error can't find the container with id 2ae70fcfeb193177dd716f5d912248a85ee14110fc9239516df152ce58eced0c
Jul 27 21:30:00.648385 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:00.648341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt" event={"ID":"90c6dbda-a271-415b-9094-746689b497ac","Type":"ContainerStarted","Data":"2ae70fcfeb193177dd716f5d912248a85ee14110fc9239516df152ce58eced0c"}
Jul 27 21:30:01.656437 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:01.656401    2567 generic.go:356] "Generic (PLEG): container finished" podID="90c6dbda-a271-415b-9094-746689b497ac" containerID="50a0a25cc82dafe055bd94afd33e0b3a69582e42b4d641bf86d5c799ebcf1dd8" exitCode=0
Jul 27 21:30:01.656437 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:01.656440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt" event={"ID":"90c6dbda-a271-415b-9094-746689b497ac","Type":"ContainerDied","Data":"50a0a25cc82dafe055bd94afd33e0b3a69582e42b4d641bf86d5c799ebcf1dd8"}
Jul 27 21:30:02.632790 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:02.632759    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:30:02.802226 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:02.802201    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"
Jul 27 21:30:03.672429 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:03.671006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt" event={"ID":"90c6dbda-a271-415b-9094-746689b497ac","Type":"ContainerDied","Data":"2ae70fcfeb193177dd716f5d912248a85ee14110fc9239516df152ce58eced0c"}
Jul 27 21:30:03.672429 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:03.671071    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ae70fcfeb193177dd716f5d912248a85ee14110fc9239516df152ce58eced0c"
Jul 27 21:30:03.672429 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:03.671141    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"
Jul 27 21:30:05.824892 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.824857    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"]
Jul 27 21:30:05.825286 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.825266    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c6dbda-a271-415b-9094-746689b497ac" containerName="cleanup"
Jul 27 21:30:05.825286 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.825277    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c6dbda-a271-415b-9094-746689b497ac" containerName="cleanup"
Jul 27 21:30:05.825358 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.825341    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c6dbda-a271-415b-9094-746689b497ac" containerName="cleanup"
Jul 27 21:30:05.828285 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.828269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:05.830262 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.830240    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:30:05.837513 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:05.837493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"]
Jul 27 21:30:06.013316 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.013278    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9d44e2-6497j\" (UID: \"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:06.114078 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.113977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9d44e2-6497j\" (UID: \"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:06.114641 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.114621    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9d44e2-6497j\" (UID: \"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:06.139942 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.139913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:06.279924 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.279901    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"]
Jul 27 21:30:06.282026 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:30:06.281988    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe8761b_066a_4f8a_b19f_fe9fef99c5f3.slice/crio-b348c1fa9f3560e6f864da0ef6170f8ff1fb8981ff5b2dbd4e268363343f2d14 WatchSource:0}: Error finding container b348c1fa9f3560e6f864da0ef6170f8ff1fb8981ff5b2dbd4e268363343f2d14: Status 404 returned error can't find the container with id b348c1fa9f3560e6f864da0ef6170f8ff1fb8981ff5b2dbd4e268363343f2d14
Jul 27 21:30:06.691581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.691518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j" event={"ID":"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3","Type":"ContainerStarted","Data":"d205b045e55dbabbf5feb72cd5af591989848ecbe7a62dcdf9f81a3715004a27"}
Jul 27 21:30:06.691747 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:06.691615    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j" event={"ID":"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3","Type":"ContainerStarted","Data":"b348c1fa9f3560e6f864da0ef6170f8ff1fb8981ff5b2dbd4e268363343f2d14"}
Jul 27 21:30:07.629676 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:07.629643    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:30:07.630078 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:07.629728    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:30:07.647981 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:07.647928    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j" podStartSLOduration=2.647911633 podStartE2EDuration="2.647911633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:06.714699579 +0000 UTC m=+2338.077935871" watchObservedRunningTime="2026-07-27 21:30:07.647911633 +0000 UTC m=+2339.011147933"
Jul 27 21:30:07.699887 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:07.699853    2567 generic.go:356] "Generic (PLEG): container finished" podID="6fe8761b-066a-4f8a-b19f-fe9fef99c5f3" containerID="d205b045e55dbabbf5feb72cd5af591989848ecbe7a62dcdf9f81a3715004a27" exitCode=0
Jul 27 21:30:07.700059 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:07.699893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j" event={"ID":"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3","Type":"ContainerDied","Data":"d205b045e55dbabbf5feb72cd5af591989848ecbe7a62dcdf9f81a3715004a27"}
Jul 27 21:30:08.844060 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:08.844026    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:09.042043 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.042015    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3-maas-api-service-ca\") pod \"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3\" (UID: \"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3\") "
Jul 27 21:30:09.042421 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.042392    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6fe8761b-066a-4f8a-b19f-fe9fef99c5f3" (UID: "6fe8761b-066a-4f8a-b19f-fe9fef99c5f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:09.143119 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.143086    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:09.331641 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.331548    2567 scope.go:117] "RemoveContainer" containerID="cd16f361cd4de348e407dec834dd30d74612c4e32a8d3b218326931e9672561b"
Jul 27 21:30:09.713221 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.713128    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"
Jul 27 21:30:09.713221 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.713159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j" event={"ID":"6fe8761b-066a-4f8a-b19f-fe9fef99c5f3","Type":"ContainerDied","Data":"b348c1fa9f3560e6f864da0ef6170f8ff1fb8981ff5b2dbd4e268363343f2d14"}
Jul 27 21:30:09.713221 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:09.713214    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b348c1fa9f3560e6f864da0ef6170f8ff1fb8981ff5b2dbd4e268363343f2d14"
Jul 27 21:30:22.185461 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:22.185403    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"]
Jul 27 21:30:22.188117 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:22.188095    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-9d44e2-29753130-xpnkt"]
Jul 27 21:30:23.028775 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:23.028744    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c6dbda-a271-415b-9094-746689b497ac" path="/var/lib/kubelet/pods/90c6dbda-a271-415b-9094-746689b497ac/volumes"
Jul 27 21:30:25.906415 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:25.906374    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"]
Jul 27 21:30:25.909726 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:25.909699    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d44e2-6497j"]
Jul 27 21:30:27.030042 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:27.030009    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe8761b-066a-4f8a-b19f-fe9fef99c5f3" path="/var/lib/kubelet/pods/6fe8761b-066a-4f8a-b19f-fe9fef99c5f3/volumes"
Jul 27 21:30:32.861365 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.861334    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"]
Jul 27 21:30:32.861884 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.861741    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe8761b-066a-4f8a-b19f-fe9fef99c5f3" containerName="revoke-keys"
Jul 27 21:30:32.861884 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.861752    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe8761b-066a-4f8a-b19f-fe9fef99c5f3" containerName="revoke-keys"
Jul 27 21:30:32.861884 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.861841    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe8761b-066a-4f8a-b19f-fe9fef99c5f3" containerName="revoke-keys"
Jul 27 21:30:32.868508 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.868489    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:32.870906 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.870861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:30:32.872822 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.872797    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"]
Jul 27 21:30:32.965334 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:32.965303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1524bec9-5417-4ae5-ab41-e069553ba029-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-55137c-5bb8h\" (UID: \"1524bec9-5417-4ae5-ab41-e069553ba029\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:33.065990 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.065958    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1524bec9-5417-4ae5-ab41-e069553ba029-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-55137c-5bb8h\" (UID: \"1524bec9-5417-4ae5-ab41-e069553ba029\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:33.066532 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.066513    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1524bec9-5417-4ae5-ab41-e069553ba029-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-55137c-5bb8h\" (UID: \"1524bec9-5417-4ae5-ab41-e069553ba029\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:33.180693 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.180623    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:33.328461 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.328438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"]
Jul 27 21:30:33.330416 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:30:33.330381    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1524bec9_5417_4ae5_ab41_e069553ba029.slice/crio-affcae0ed7c4dbd02ec121c20b817fd4374e13e7bb7bfed8df5102c5db6953af WatchSource:0}: Error finding container affcae0ed7c4dbd02ec121c20b817fd4374e13e7bb7bfed8df5102c5db6953af: Status 404 returned error can't find the container with id affcae0ed7c4dbd02ec121c20b817fd4374e13e7bb7bfed8df5102c5db6953af
Jul 27 21:30:33.864525 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.864486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h" event={"ID":"1524bec9-5417-4ae5-ab41-e069553ba029","Type":"ContainerStarted","Data":"0591b1f05855e874ba83d77c4c8b38d09e0a9ac4d6c1df04ed676f7cee76b082"}
Jul 27 21:30:33.864962 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.864542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h" event={"ID":"1524bec9-5417-4ae5-ab41-e069553ba029","Type":"ContainerStarted","Data":"affcae0ed7c4dbd02ec121c20b817fd4374e13e7bb7bfed8df5102c5db6953af"}
Jul 27 21:30:33.880782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:33.880714    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h" podStartSLOduration=1.880699043 podStartE2EDuration="1.880699043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:33.879637094 +0000 UTC m=+2365.242873387" watchObservedRunningTime="2026-07-27 21:30:33.880699043 +0000 UTC m=+2365.243935335"
Jul 27 21:30:34.871853 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:34.871820    2567 generic.go:356] "Generic (PLEG): container finished" podID="1524bec9-5417-4ae5-ab41-e069553ba029" containerID="0591b1f05855e874ba83d77c4c8b38d09e0a9ac4d6c1df04ed676f7cee76b082" exitCode=0
Jul 27 21:30:34.872299 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:34.871904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h" event={"ID":"1524bec9-5417-4ae5-ab41-e069553ba029","Type":"ContainerDied","Data":"0591b1f05855e874ba83d77c4c8b38d09e0a9ac4d6c1df04ed676f7cee76b082"}
Jul 27 21:30:36.014489 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.014464    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:36.096776 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.096737    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1524bec9-5417-4ae5-ab41-e069553ba029-maas-api-service-ca\") pod \"1524bec9-5417-4ae5-ab41-e069553ba029\" (UID: \"1524bec9-5417-4ae5-ab41-e069553ba029\") "
Jul 27 21:30:36.097086 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.097061    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1524bec9-5417-4ae5-ab41-e069553ba029-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1524bec9-5417-4ae5-ab41-e069553ba029" (UID: "1524bec9-5417-4ae5-ab41-e069553ba029"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:36.197908 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.197819    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1524bec9-5417-4ae5-ab41-e069553ba029-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:36.885366 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.885333    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"
Jul 27 21:30:36.885517 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.885369    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h" event={"ID":"1524bec9-5417-4ae5-ab41-e069553ba029","Type":"ContainerDied","Data":"affcae0ed7c4dbd02ec121c20b817fd4374e13e7bb7bfed8df5102c5db6953af"}
Jul 27 21:30:36.885517 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:36.885417    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="affcae0ed7c4dbd02ec121c20b817fd4374e13e7bb7bfed8df5102c5db6953af"
Jul 27 21:30:48.295402 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.295367    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"]
Jul 27 21:30:48.295893 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.295606    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7" podUID="8f57772c-54e8-479e-a48c-2bb4399787bf" containerName="maas-api" containerID="cri-o://9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c" gracePeriod=30
Jul 27 21:30:48.346825 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.346775    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"]
Jul 27 21:30:48.347061 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.347017    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj" podUID="3198a853-41c5-4016-83da-dce3efd3bec4" containerName="payload-processing" containerID="cri-o://081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847" gracePeriod=30
Jul 27 21:30:48.354744 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.354414    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"]
Jul 27 21:30:48.354744 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.354663    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh" podUID="6661f758-0299-4bb8-b41f-5c6420ef9c23" containerName="payload-pre-processing" containerID="cri-o://f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3" gracePeriod=30
Jul 27 21:30:48.612903 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.612875    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:30:48.639923 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.639896    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:30:48.654133 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.654108    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:30:48.707128 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.707094    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg7hm\" (UniqueName: \"kubernetes.io/projected/8f57772c-54e8-479e-a48c-2bb4399787bf-kube-api-access-vg7hm\") pod \"8f57772c-54e8-479e-a48c-2bb4399787bf\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") "
Jul 27 21:30:48.707302 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.707151    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f57772c-54e8-479e-a48c-2bb4399787bf-maas-api-tls\") pod \"8f57772c-54e8-479e-a48c-2bb4399787bf\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") "
Jul 27 21:30:48.707302 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.707222    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f57772c-54e8-479e-a48c-2bb4399787bf-openshift-service-ca\") pod \"8f57772c-54e8-479e-a48c-2bb4399787bf\" (UID: \"8f57772c-54e8-479e-a48c-2bb4399787bf\") "
Jul 27 21:30:48.707661 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.707634    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f57772c-54e8-479e-a48c-2bb4399787bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f57772c-54e8-479e-a48c-2bb4399787bf" (UID: "8f57772c-54e8-479e-a48c-2bb4399787bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:48.709508 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.709483    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f57772c-54e8-479e-a48c-2bb4399787bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f57772c-54e8-479e-a48c-2bb4399787bf" (UID: "8f57772c-54e8-479e-a48c-2bb4399787bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:30:48.709587 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.709528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f57772c-54e8-479e-a48c-2bb4399787bf-kube-api-access-vg7hm" (OuterVolumeSpecName: "kube-api-access-vg7hm") pod "8f57772c-54e8-479e-a48c-2bb4399787bf" (UID: "8f57772c-54e8-479e-a48c-2bb4399787bf"). InnerVolumeSpecName "kube-api-access-vg7hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:48.808696 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.808663    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnp2v\" (UniqueName: \"kubernetes.io/projected/6661f758-0299-4bb8-b41f-5c6420ef9c23-kube-api-access-hnp2v\") pod \"6661f758-0299-4bb8-b41f-5c6420ef9c23\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") "
Jul 27 21:30:48.808902 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.808706    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3198a853-41c5-4016-83da-dce3efd3bec4-plugins-config-volume\") pod \"3198a853-41c5-4016-83da-dce3efd3bec4\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") "
Jul 27 21:30:48.808902 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.808733    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7kmt\" (UniqueName: \"kubernetes.io/projected/3198a853-41c5-4016-83da-dce3efd3bec4-kube-api-access-m7kmt\") pod \"3198a853-41c5-4016-83da-dce3efd3bec4\" (UID: \"3198a853-41c5-4016-83da-dce3efd3bec4\") "
Jul 27 21:30:48.808902 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.808772    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6661f758-0299-4bb8-b41f-5c6420ef9c23-plugins-config-volume\") pod \"6661f758-0299-4bb8-b41f-5c6420ef9c23\" (UID: \"6661f758-0299-4bb8-b41f-5c6420ef9c23\") "
Jul 27 21:30:48.809107 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.809085    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg7hm\" (UniqueName: \"kubernetes.io/projected/8f57772c-54e8-479e-a48c-2bb4399787bf-kube-api-access-vg7hm\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.809107 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.809107    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f57772c-54e8-479e-a48c-2bb4399787bf-maas-api-tls\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.809209 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.809116    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f57772c-54e8-479e-a48c-2bb4399787bf-openshift-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.809251 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.809201    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3198a853-41c5-4016-83da-dce3efd3bec4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3198a853-41c5-4016-83da-dce3efd3bec4" (UID: "3198a853-41c5-4016-83da-dce3efd3bec4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:48.809251 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.809230    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6661f758-0299-4bb8-b41f-5c6420ef9c23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6661f758-0299-4bb8-b41f-5c6420ef9c23" (UID: "6661f758-0299-4bb8-b41f-5c6420ef9c23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:48.810986 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.810962    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6661f758-0299-4bb8-b41f-5c6420ef9c23-kube-api-access-hnp2v" (OuterVolumeSpecName: "kube-api-access-hnp2v") pod "6661f758-0299-4bb8-b41f-5c6420ef9c23" (UID: "6661f758-0299-4bb8-b41f-5c6420ef9c23"). InnerVolumeSpecName "kube-api-access-hnp2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:48.811076 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.811000    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3198a853-41c5-4016-83da-dce3efd3bec4-kube-api-access-m7kmt" (OuterVolumeSpecName: "kube-api-access-m7kmt") pod "3198a853-41c5-4016-83da-dce3efd3bec4" (UID: "3198a853-41c5-4016-83da-dce3efd3bec4"). InnerVolumeSpecName "kube-api-access-m7kmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:48.909607 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.909514    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnp2v\" (UniqueName: \"kubernetes.io/projected/6661f758-0299-4bb8-b41f-5c6420ef9c23-kube-api-access-hnp2v\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.909607 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.909543    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3198a853-41c5-4016-83da-dce3efd3bec4-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.909607 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.909553    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7kmt\" (UniqueName: \"kubernetes.io/projected/3198a853-41c5-4016-83da-dce3efd3bec4-kube-api-access-m7kmt\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.909607 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.909598    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6661f758-0299-4bb8-b41f-5c6420ef9c23-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:30:48.955929 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.955890    2567 generic.go:356] "Generic (PLEG): container finished" podID="3198a853-41c5-4016-83da-dce3efd3bec4" containerID="081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847" exitCode=0
Jul 27 21:30:48.956086 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.955972    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"
Jul 27 21:30:48.956086 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.955975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj" event={"ID":"3198a853-41c5-4016-83da-dce3efd3bec4","Type":"ContainerDied","Data":"081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847"}
Jul 27 21:30:48.956086 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.956082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj" event={"ID":"3198a853-41c5-4016-83da-dce3efd3bec4","Type":"ContainerDied","Data":"cf8183e8e464845c09fd03418d2f58f373a4c288c6ca00fa63fb6374c02cb04f"}
Jul 27 21:30:48.956275 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.956114    2567 scope.go:117] "RemoveContainer" containerID="081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847"
Jul 27 21:30:48.957452 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.957430    2567 generic.go:356] "Generic (PLEG): container finished" podID="6661f758-0299-4bb8-b41f-5c6420ef9c23" containerID="f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3" exitCode=0
Jul 27 21:30:48.957592 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.957496    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"
Jul 27 21:30:48.957592 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.957522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh" event={"ID":"6661f758-0299-4bb8-b41f-5c6420ef9c23","Type":"ContainerDied","Data":"f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3"}
Jul 27 21:30:48.957711 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.957591    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh" event={"ID":"6661f758-0299-4bb8-b41f-5c6420ef9c23","Type":"ContainerDied","Data":"3dd84a43109e73cf37fd54d915b906f1e2d8abae3b45748bd28a1c54d056d885"}
Jul 27 21:30:48.959036 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.959009    2567 generic.go:356] "Generic (PLEG): container finished" podID="8f57772c-54e8-479e-a48c-2bb4399787bf" containerID="9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c" exitCode=0
Jul 27 21:30:48.959146 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.959074    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"
Jul 27 21:30:48.959146 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.959084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7" event={"ID":"8f57772c-54e8-479e-a48c-2bb4399787bf","Type":"ContainerDied","Data":"9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c"}
Jul 27 21:30:48.959146 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.959142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7" event={"ID":"8f57772c-54e8-479e-a48c-2bb4399787bf","Type":"ContainerDied","Data":"895b822252f329b52e0dd1206bec0e0a8194fb81149e9cc43bbb23051a3ed4d8"}
Jul 27 21:30:48.967616 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.967591    2567 scope.go:117] "RemoveContainer" containerID="081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847"
Jul 27 21:30:48.967953 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:30:48.967923    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847\": container with ID starting with 081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847 not found: ID does not exist" containerID="081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847"
Jul 27 21:30:48.968044 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.967961    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847"} err="failed to get container status \"081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847\": rpc error: code = NotFound desc = could not find container \"081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847\": container with ID starting with 081f8dc016255641629ac514115cad14c7dff12fb303ec0a9bc17c926e604847 not found: ID does not exist"
Jul 27 21:30:48.968044 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.967983    2567 scope.go:117] "RemoveContainer" containerID="f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3"
Jul 27 21:30:48.976626 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.976613    2567 scope.go:117] "RemoveContainer" containerID="f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3"
Jul 27 21:30:48.976884 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:30:48.976864    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3\": container with ID starting with f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3 not found: ID does not exist" containerID="f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3"
Jul 27 21:30:48.977001 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.976889    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3"} err="failed to get container status \"f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3\": rpc error: code = NotFound desc = could not find container \"f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3\": container with ID starting with f656c0c3b7f76b58a47f4b726894c52c08952da558dd43a8e0b0895706b72ab3 not found: ID does not exist"
Jul 27 21:30:48.977001 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.976909    2567 scope.go:117] "RemoveContainer" containerID="9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c"
Jul 27 21:30:48.980728 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.980709    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"]
Jul 27 21:30:48.985681 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.985657    2567 scope.go:117] "RemoveContainer" containerID="9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c"
Jul 27 21:30:48.985979 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:30:48.985959    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c\": container with ID starting with 9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c not found: ID does not exist" containerID="9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c"
Jul 27 21:30:48.986051 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.985991    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c"} err="failed to get container status \"9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c\": rpc error: code = NotFound desc = could not find container \"9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c\": container with ID starting with 9d2233fa24e7b0cb09a3d560a539387a7f72de597dbfcd1b9d19d4db6278738c not found: ID does not exist"
Jul 27 21:30:48.986110 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.986094    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-55137c-574cb6b4c4-44wpj"]
Jul 27 21:30:48.994728 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.994706    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"]
Jul 27 21:30:48.996781 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:48.996764    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-55137c-7c7cf84fb9-2wkn7"]
Jul 27 21:30:49.005627 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:49.005606    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"]
Jul 27 21:30:49.009284 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:49.009264    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-55137c-b9844c868-g4qsh"]
Jul 27 21:30:49.028701 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:49.028678    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3198a853-41c5-4016-83da-dce3efd3bec4" path="/var/lib/kubelet/pods/3198a853-41c5-4016-83da-dce3efd3bec4/volumes"
Jul 27 21:30:49.029019 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:49.029006    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6661f758-0299-4bb8-b41f-5c6420ef9c23" path="/var/lib/kubelet/pods/6661f758-0299-4bb8-b41f-5c6420ef9c23/volumes"
Jul 27 21:30:49.029391 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:49.029373    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f57772c-54e8-479e-a48c-2bb4399787bf" path="/var/lib/kubelet/pods/8f57772c-54e8-479e-a48c-2bb4399787bf/volumes"
Jul 27 21:30:52.939888 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:52.939851    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"]
Jul 27 21:30:52.942936 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:52.942910    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-55137c-5bb8h"]
Jul 27 21:30:53.028887 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:30:53.028856    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1524bec9-5417-4ae5-ab41-e069553ba029" path="/var/lib/kubelet/pods/1524bec9-5417-4ae5-ab41-e069553ba029/volumes"
Jul 27 21:31:04.285224 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285185    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"]
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285548    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3198a853-41c5-4016-83da-dce3efd3bec4" containerName="payload-processing"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285574    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3198a853-41c5-4016-83da-dce3efd3bec4" containerName="payload-processing"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285583    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f57772c-54e8-479e-a48c-2bb4399787bf" containerName="maas-api"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285588    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f57772c-54e8-479e-a48c-2bb4399787bf" containerName="maas-api"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285595    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1524bec9-5417-4ae5-ab41-e069553ba029" containerName="revoke-keys"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285601    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1524bec9-5417-4ae5-ab41-e069553ba029" containerName="revoke-keys"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285617    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6661f758-0299-4bb8-b41f-5c6420ef9c23" containerName="payload-pre-processing"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285622    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6661f758-0299-4bb8-b41f-5c6420ef9c23" containerName="payload-pre-processing"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285680    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1524bec9-5417-4ae5-ab41-e069553ba029" containerName="revoke-keys"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285689    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6661f758-0299-4bb8-b41f-5c6420ef9c23" containerName="payload-pre-processing"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285697    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f57772c-54e8-479e-a48c-2bb4399787bf" containerName="maas-api"
Jul 27 21:31:04.285767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.285704    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3198a853-41c5-4016-83da-dce3efd3bec4" containerName="payload-processing"
Jul 27 21:31:04.290330 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.290305    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.292471 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.292443    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-6dd721\""
Jul 27 21:31:04.292639 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.292487    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-6dd721-dockercfg-h78q6\""
Jul 27 21:31:04.302452 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.302422    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"]
Jul 27 21:31:04.346717 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.346685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kcgp\" (UniqueName: \"kubernetes.io/projected/ce47a33b-f751-4c61-86bd-c19f504f53ad-kube-api-access-8kcgp\") pod \"payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.346933 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.346749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce47a33b-f751-4c61-86bd-c19f504f53ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.447573 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.447531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce47a33b-f751-4c61-86bd-c19f504f53ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.447753 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.447689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kcgp\" (UniqueName: \"kubernetes.io/projected/ce47a33b-f751-4c61-86bd-c19f504f53ad-kube-api-access-8kcgp\") pod \"payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.448275 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.448256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce47a33b-f751-4c61-86bd-c19f504f53ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.456283 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.456264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kcgp\" (UniqueName: \"kubernetes.io/projected/ce47a33b-f751-4c61-86bd-c19f504f53ad-kube-api-access-8kcgp\") pod \"payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.602515 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.602412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:04.759896 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:04.759869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"]
Jul 27 21:31:04.762183 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:31:04.762148    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce47a33b_f751_4c61_86bd_c19f504f53ad.slice/crio-704c3682af18e809913381f9c12f090929d5cbe4a1daf6892ce6757a08336602 WatchSource:0}: Error finding container 704c3682af18e809913381f9c12f090929d5cbe4a1daf6892ce6757a08336602: Status 404 returned error can't find the container with id 704c3682af18e809913381f9c12f090929d5cbe4a1daf6892ce6757a08336602
Jul 27 21:31:05.054411 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:05.054373    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg" event={"ID":"ce47a33b-f751-4c61-86bd-c19f504f53ad","Type":"ContainerStarted","Data":"832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f"}
Jul 27 21:31:05.054656 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:05.054436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg" event={"ID":"ce47a33b-f751-4c61-86bd-c19f504f53ad","Type":"ContainerStarted","Data":"704c3682af18e809913381f9c12f090929d5cbe4a1daf6892ce6757a08336602"}
Jul 27 21:31:05.054656 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:05.054593    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:05.071618 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:05.071542    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg" podStartSLOduration=1.071525601 podStartE2EDuration="1.071525601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:05.070075003 +0000 UTC m=+2396.433311297" watchObservedRunningTime="2026-07-27 21:31:05.071525601 +0000 UTC m=+2396.434761893"
Jul 27 21:31:12.475502 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.475470    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"]
Jul 27 21:31:12.480497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.480478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.482415 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.482394    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-5f50cb-dockercfg-zkc7f\""
Jul 27 21:31:12.482530 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.482396    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-5f50cb\""
Jul 27 21:31:12.487257 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.487232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"]
Jul 27 21:31:12.522685 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.522648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.522858 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.522731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mznsc\" (UniqueName: \"kubernetes.io/projected/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-kube-api-access-mznsc\") pod \"payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.624126 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.624095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznsc\" (UniqueName: \"kubernetes.io/projected/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-kube-api-access-mznsc\") pod \"payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.624293 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.624172    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.624938 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.624920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.632202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.632171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mznsc\" (UniqueName: \"kubernetes.io/projected/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-kube-api-access-mznsc\") pod \"payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.793286 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.793244    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:12.935150 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:12.935105    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"]
Jul 27 21:31:12.941986 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:31:12.941938    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb349f7fd_8ef6_4274_95e4_9cfe96fe32dc.slice/crio-6b61fb7fa5baf90da3885b2e41068e40ec83bb9e830805ee87bfd8a7e1f94d45 WatchSource:0}: Error finding container 6b61fb7fa5baf90da3885b2e41068e40ec83bb9e830805ee87bfd8a7e1f94d45: Status 404 returned error can't find the container with id 6b61fb7fa5baf90da3885b2e41068e40ec83bb9e830805ee87bfd8a7e1f94d45
Jul 27 21:31:13.108508 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:13.108404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr" event={"ID":"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc","Type":"ContainerStarted","Data":"c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d"}
Jul 27 21:31:13.108508 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:13.108471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr" event={"ID":"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc","Type":"ContainerStarted","Data":"6b61fb7fa5baf90da3885b2e41068e40ec83bb9e830805ee87bfd8a7e1f94d45"}
Jul 27 21:31:13.108508 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:13.108497    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:31:13.125926 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:13.125875    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr" podStartSLOduration=1.125859594 podStartE2EDuration="1.125859594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:13.122778844 +0000 UTC m=+2404.486015134" watchObservedRunningTime="2026-07-27 21:31:13.125859594 +0000 UTC m=+2404.489095886"
Jul 27 21:31:16.064328 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:16.064294    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:31:24.116999 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:31:24.116966    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:32:09.387506 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:32:09.387471    2567 scope.go:117] "RemoveContainer" containerID="c350c6fe26c6457943a90a47f50a8378ce36fee7e6f37bf969a98e2827d617ea"
Jul 27 21:35:09.428649 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:35:09.428614    2567 scope.go:117] "RemoveContainer" containerID="367af0b7c65d9cb5f97aae164fa0858aca1abb594534e2b743f71aeec4f39726"
Jul 27 21:36:09.452362 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:36:09.452271    2567 scope.go:117] "RemoveContainer" containerID="50a0a25cc82dafe055bd94afd33e0b3a69582e42b4d641bf86d5c799ebcf1dd8"
Jul 27 21:36:09.461718 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:36:09.461694    2567 scope.go:117] "RemoveContainer" containerID="d205b045e55dbabbf5feb72cd5af591989848ecbe7a62dcdf9f81a3715004a27"
Jul 27 21:37:09.488305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:37:09.488269    2567 scope.go:117] "RemoveContainer" containerID="0591b1f05855e874ba83d77c4c8b38d09e0a9ac4d6c1df04ed676f7cee76b082"
Jul 27 21:40:00.704380 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.704347    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7663-140001803528368"]
Jul 27 21:40:00.707933 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.707916    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:00.709946 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.709921    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7gdc7\""
Jul 27 21:40:00.711702 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.711681    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803528368"]
Jul 27 21:40:00.784866 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.784832    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnqwp\" (UniqueName: \"kubernetes.io/projected/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0-kube-api-access-hnqwp\") pod \"test-curl-7663-140001803528368\" (UID: \"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0\") " pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:00.885745 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.885709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnqwp\" (UniqueName: \"kubernetes.io/projected/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0-kube-api-access-hnqwp\") pod \"test-curl-7663-140001803528368\" (UID: \"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0\") " pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:00.894778 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:00.894752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnqwp\" (UniqueName: \"kubernetes.io/projected/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0-kube-api-access-hnqwp\") pod \"test-curl-7663-140001803528368\" (UID: \"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0\") " pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:01.018929 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:01.018895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:01.163811 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:01.163783    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803528368"]
Jul 27 21:40:01.165677 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:01.165650    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cead3fd_6bd4_4498_80ae_c830fe6f4ce0.slice/crio-394d967bde6dfe311c019f60ca0ed60ab2a1d4bd3584838e948ad827f3b7dd45 WatchSource:0}: Error finding container 394d967bde6dfe311c019f60ca0ed60ab2a1d4bd3584838e948ad827f3b7dd45: Status 404 returned error can't find the container with id 394d967bde6dfe311c019f60ca0ed60ab2a1d4bd3584838e948ad827f3b7dd45
Jul 27 21:40:01.167100 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:01.167081    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:40:02.111581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:02.111474    2567 generic.go:356] "Generic (PLEG): container finished" podID="4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" containerID="fcbbfdcf8341645fbb1c1d82ccd2a9365952f9dab1f844b21225a140944367a6" exitCode=0
Jul 27 21:40:02.111581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:02.111529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803528368" event={"ID":"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0","Type":"ContainerDied","Data":"fcbbfdcf8341645fbb1c1d82ccd2a9365952f9dab1f844b21225a140944367a6"}
Jul 27 21:40:02.111581 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:02.111582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803528368" event={"ID":"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0","Type":"ContainerStarted","Data":"394d967bde6dfe311c019f60ca0ed60ab2a1d4bd3584838e948ad827f3b7dd45"}
Jul 27 21:40:03.257679 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.257653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:03.293798 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.293742    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7663-140001803528368_4cead3fd-6bd4-4498-80ae-c830fe6f4ce0/test-curl-7663-140001803528368/0.log"
Jul 27 21:40:03.307030 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.307003    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnqwp\" (UniqueName: \"kubernetes.io/projected/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0-kube-api-access-hnqwp\") pod \"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0\" (UID: \"4cead3fd-6bd4-4498-80ae-c830fe6f4ce0\") "
Jul 27 21:40:03.309328 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.309298    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0-kube-api-access-hnqwp" (OuterVolumeSpecName: "kube-api-access-hnqwp") pod "4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" (UID: "4cead3fd-6bd4-4498-80ae-c830fe6f4ce0"). InnerVolumeSpecName "kube-api-access-hnqwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:03.320802 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.320777    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7663-140001803528368"]
Jul 27 21:40:03.324271 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.324249    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7663-140001803528368"]
Jul 27 21:40:03.407990 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.407903    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnqwp\" (UniqueName: \"kubernetes.io/projected/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0-kube-api-access-hnqwp\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:40:03.461442 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.461408    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7663-140001803526576"]
Jul 27 21:40:03.462046 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.462026    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" containerName="test-curl-7663-140001803528368"
Jul 27 21:40:03.462097 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.462052    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" containerName="test-curl-7663-140001803528368"
Jul 27 21:40:03.462146 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.462136    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" containerName="test-curl-7663-140001803528368"
Jul 27 21:40:03.465202 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.465186    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:03.470955 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.470929    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803526576"]
Jul 27 21:40:03.508703 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.508663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmxf\" (UniqueName: \"kubernetes.io/projected/720b308c-f9c9-47d2-9c05-9728589723a1-kube-api-access-qzmxf\") pod \"test-curl-7663-140001803526576\" (UID: \"720b308c-f9c9-47d2-9c05-9728589723a1\") " pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:03.609235 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.609200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmxf\" (UniqueName: \"kubernetes.io/projected/720b308c-f9c9-47d2-9c05-9728589723a1-kube-api-access-qzmxf\") pod \"test-curl-7663-140001803526576\" (UID: \"720b308c-f9c9-47d2-9c05-9728589723a1\") " pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:03.617309 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.617271    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmxf\" (UniqueName: \"kubernetes.io/projected/720b308c-f9c9-47d2-9c05-9728589723a1-kube-api-access-qzmxf\") pod \"test-curl-7663-140001803526576\" (UID: \"720b308c-f9c9-47d2-9c05-9728589723a1\") " pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:03.776992 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.776953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:03.918417 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:03.918390    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803526576"]
Jul 27 21:40:03.920265 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:03.920239    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod720b308c_f9c9_47d2_9c05_9728589723a1.slice/crio-952f1f5ed134414dc4375806ddd89c3e5948592a6b4dfdd7cd60e6d8c4fb50ba WatchSource:0}: Error finding container 952f1f5ed134414dc4375806ddd89c3e5948592a6b4dfdd7cd60e6d8c4fb50ba: Status 404 returned error can't find the container with id 952f1f5ed134414dc4375806ddd89c3e5948592a6b4dfdd7cd60e6d8c4fb50ba
Jul 27 21:40:04.124255 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:04.124217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803526576" event={"ID":"720b308c-f9c9-47d2-9c05-9728589723a1","Type":"ContainerStarted","Data":"952f1f5ed134414dc4375806ddd89c3e5948592a6b4dfdd7cd60e6d8c4fb50ba"}
Jul 27 21:40:04.125583 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:04.125544    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:04.125700 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:04.125583    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="394d967bde6dfe311c019f60ca0ed60ab2a1d4bd3584838e948ad827f3b7dd45"
Jul 27 21:40:04.136801 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:40:04.136764    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7663-140001803528368\" is forbidden: User \"system:node:ip-10-0-131-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-91.ec2.internal' and this object" podUID="4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" pod="opendatahub/test-curl-7663-140001803528368"
Jul 27 21:40:05.028490 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:05.028448    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cead3fd-6bd4-4498-80ae-c830fe6f4ce0" path="/var/lib/kubelet/pods/4cead3fd-6bd4-4498-80ae-c830fe6f4ce0/volumes"
Jul 27 21:40:05.132577 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:05.132516    2567 generic.go:356] "Generic (PLEG): container finished" podID="720b308c-f9c9-47d2-9c05-9728589723a1" containerID="236c0938a22b4bd2ffdfaeeb1d54976e3641d33329c4e1e9bdb506ff0c5d3319" exitCode=0
Jul 27 21:40:05.132756 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:05.132595    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803526576" event={"ID":"720b308c-f9c9-47d2-9c05-9728589723a1","Type":"ContainerDied","Data":"236c0938a22b4bd2ffdfaeeb1d54976e3641d33329c4e1e9bdb506ff0c5d3319"}
Jul 27 21:40:06.272338 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.272311    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:06.292507 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.292475    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7663-140001803526576_720b308c-f9c9-47d2-9c05-9728589723a1/test-curl-7663-140001803526576/0.log"
Jul 27 21:40:06.318111 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.318081    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7663-140001803526576"]
Jul 27 21:40:06.321194 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.321173    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7663-140001803526576"]
Jul 27 21:40:06.334480 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.334450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzmxf\" (UniqueName: \"kubernetes.io/projected/720b308c-f9c9-47d2-9c05-9728589723a1-kube-api-access-qzmxf\") pod \"720b308c-f9c9-47d2-9c05-9728589723a1\" (UID: \"720b308c-f9c9-47d2-9c05-9728589723a1\") "
Jul 27 21:40:06.336717 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.336683    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/720b308c-f9c9-47d2-9c05-9728589723a1-kube-api-access-qzmxf" (OuterVolumeSpecName: "kube-api-access-qzmxf") pod "720b308c-f9c9-47d2-9c05-9728589723a1" (UID: "720b308c-f9c9-47d2-9c05-9728589723a1"). InnerVolumeSpecName "kube-api-access-qzmxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:06.435629 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.435507    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzmxf\" (UniqueName: \"kubernetes.io/projected/720b308c-f9c9-47d2-9c05-9728589723a1-kube-api-access-qzmxf\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:40:06.499742 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.499707    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:06.500108 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.500096    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720b308c-f9c9-47d2-9c05-9728589723a1" containerName="test-curl-7663-140001803526576"
Jul 27 21:40:06.500171 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.500111    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="720b308c-f9c9-47d2-9c05-9728589723a1" containerName="test-curl-7663-140001803526576"
Jul 27 21:40:06.500212 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.500193    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="720b308c-f9c9-47d2-9c05-9728589723a1" containerName="test-curl-7663-140001803526576"
Jul 27 21:40:06.503127 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.503110    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:06.507296 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.507263    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:06.637975 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.637945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltgs\" (UniqueName: \"kubernetes.io/projected/1d0b970a-48fb-4aec-a0a1-9f806939dbe1-kube-api-access-dltgs\") pod \"test-curl-7663-140001797052288\" (UID: \"1d0b970a-48fb-4aec-a0a1-9f806939dbe1\") " pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:06.739225 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.739117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dltgs\" (UniqueName: \"kubernetes.io/projected/1d0b970a-48fb-4aec-a0a1-9f806939dbe1-kube-api-access-dltgs\") pod \"test-curl-7663-140001797052288\" (UID: \"1d0b970a-48fb-4aec-a0a1-9f806939dbe1\") " pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:06.749809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.749775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltgs\" (UniqueName: \"kubernetes.io/projected/1d0b970a-48fb-4aec-a0a1-9f806939dbe1-kube-api-access-dltgs\") pod \"test-curl-7663-140001797052288\" (UID: \"1d0b970a-48fb-4aec-a0a1-9f806939dbe1\") " pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:06.814166 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.814122    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:06.955513 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:06.955487    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:06.957513 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:06.957482    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d0b970a_48fb_4aec_a0a1_9f806939dbe1.slice/crio-f438252374ba135057fd5b4df2d3b6a027cb2de3028eb1d9c102f397187a134c WatchSource:0}: Error finding container f438252374ba135057fd5b4df2d3b6a027cb2de3028eb1d9c102f397187a134c: Status 404 returned error can't find the container with id f438252374ba135057fd5b4df2d3b6a027cb2de3028eb1d9c102f397187a134c
Jul 27 21:40:07.029547 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:07.029512    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720b308c-f9c9-47d2-9c05-9728589723a1" path="/var/lib/kubelet/pods/720b308c-f9c9-47d2-9c05-9728589723a1/volumes"
Jul 27 21:40:07.145958 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:07.145925    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803526576"
Jul 27 21:40:07.146152 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:07.145984    2567 scope.go:117] "RemoveContainer" containerID="236c0938a22b4bd2ffdfaeeb1d54976e3641d33329c4e1e9bdb506ff0c5d3319"
Jul 27 21:40:07.147389 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:07.147360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001797052288" event={"ID":"1d0b970a-48fb-4aec-a0a1-9f806939dbe1","Type":"ContainerStarted","Data":"f438252374ba135057fd5b4df2d3b6a027cb2de3028eb1d9c102f397187a134c"}
Jul 27 21:40:08.155483 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:08.155441    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d0b970a-48fb-4aec-a0a1-9f806939dbe1" containerID="46bf9c7ed4adfb9b110ee2eed2467c78ed6adef2aa1d81254265a155075ffbc1" exitCode=0
Jul 27 21:40:08.155893 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:08.155531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001797052288" event={"ID":"1d0b970a-48fb-4aec-a0a1-9f806939dbe1","Type":"ContainerDied","Data":"46bf9c7ed4adfb9b110ee2eed2467c78ed6adef2aa1d81254265a155075ffbc1"}
Jul 27 21:40:09.301219 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.301182    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:09.320016 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.319986    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7663-140001797052288_1d0b970a-48fb-4aec-a0a1-9f806939dbe1/test-curl-7663-140001797052288/0.log"
Jul 27 21:40:09.344585 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.344524    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:09.347855 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.347809    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:09.361976 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.361944    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dltgs\" (UniqueName: \"kubernetes.io/projected/1d0b970a-48fb-4aec-a0a1-9f806939dbe1-kube-api-access-dltgs\") pod \"1d0b970a-48fb-4aec-a0a1-9f806939dbe1\" (UID: \"1d0b970a-48fb-4aec-a0a1-9f806939dbe1\") "
Jul 27 21:40:09.364173 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.364137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0b970a-48fb-4aec-a0a1-9f806939dbe1-kube-api-access-dltgs" (OuterVolumeSpecName: "kube-api-access-dltgs") pod "1d0b970a-48fb-4aec-a0a1-9f806939dbe1" (UID: "1d0b970a-48fb-4aec-a0a1-9f806939dbe1"). InnerVolumeSpecName "kube-api-access-dltgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:09.463466 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.463295    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dltgs\" (UniqueName: \"kubernetes.io/projected/1d0b970a-48fb-4aec-a0a1-9f806939dbe1-kube-api-access-dltgs\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:40:09.482897 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.474943    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:09.482897 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.475324    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0b970a-48fb-4aec-a0a1-9f806939dbe1" containerName="test-curl-7663-140001797052288"
Jul 27 21:40:09.482897 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.475337    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0b970a-48fb-4aec-a0a1-9f806939dbe1" containerName="test-curl-7663-140001797052288"
Jul 27 21:40:09.482897 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.475415    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0b970a-48fb-4aec-a0a1-9f806939dbe1" containerName="test-curl-7663-140001797052288"
Jul 27 21:40:09.482897 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.478670    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:09.484450 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.484425    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:09.564623 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.564546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqf7x\" (UniqueName: \"kubernetes.io/projected/a0a1ac78-26d9-492b-9d76-985b644e08c1-kube-api-access-dqf7x\") pod \"test-curl-7663-140001797052288\" (UID: \"a0a1ac78-26d9-492b-9d76-985b644e08c1\") " pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:09.665972 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.665927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqf7x\" (UniqueName: \"kubernetes.io/projected/a0a1ac78-26d9-492b-9d76-985b644e08c1-kube-api-access-dqf7x\") pod \"test-curl-7663-140001797052288\" (UID: \"a0a1ac78-26d9-492b-9d76-985b644e08c1\") " pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:09.675636 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.675594    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqf7x\" (UniqueName: \"kubernetes.io/projected/a0a1ac78-26d9-492b-9d76-985b644e08c1-kube-api-access-dqf7x\") pod \"test-curl-7663-140001797052288\" (UID: \"a0a1ac78-26d9-492b-9d76-985b644e08c1\") " pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:09.789954 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.789918    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:09.942177 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:09.942142    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:09.946285 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:09.946258    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0a1ac78_26d9_492b_9d76_985b644e08c1.slice/crio-83a767d1fbf9bf096a3c9126d806649c8400331cbac652c7adc00f4938502a5a WatchSource:0}: Error finding container 83a767d1fbf9bf096a3c9126d806649c8400331cbac652c7adc00f4938502a5a: Status 404 returned error can't find the container with id 83a767d1fbf9bf096a3c9126d806649c8400331cbac652c7adc00f4938502a5a
Jul 27 21:40:10.167984 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:10.167893    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:10.167984 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:10.167896    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f438252374ba135057fd5b4df2d3b6a027cb2de3028eb1d9c102f397187a134c"
Jul 27 21:40:10.169212 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:10.169187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001797052288" event={"ID":"a0a1ac78-26d9-492b-9d76-985b644e08c1","Type":"ContainerStarted","Data":"83a767d1fbf9bf096a3c9126d806649c8400331cbac652c7adc00f4938502a5a"}
Jul 27 21:40:10.179936 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:10.179890    2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7663-140001797052288" oldPodUID="1d0b970a-48fb-4aec-a0a1-9f806939dbe1" podUID="a0a1ac78-26d9-492b-9d76-985b644e08c1"
Jul 27 21:40:11.028753 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:11.028717    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d0b970a-48fb-4aec-a0a1-9f806939dbe1" path="/var/lib/kubelet/pods/1d0b970a-48fb-4aec-a0a1-9f806939dbe1/volumes"
Jul 27 21:40:11.177309 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:11.177269    2567 generic.go:356] "Generic (PLEG): container finished" podID="a0a1ac78-26d9-492b-9d76-985b644e08c1" containerID="2f315243bfd2b9ed715927365feae69b2dda7f8f90a7552613d5b94ed9a6a586" exitCode=0
Jul 27 21:40:11.177494 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:11.177317    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001797052288" event={"ID":"a0a1ac78-26d9-492b-9d76-985b644e08c1","Type":"ContainerDied","Data":"2f315243bfd2b9ed715927365feae69b2dda7f8f90a7552613d5b94ed9a6a586"}
Jul 27 21:40:12.321499 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.321473    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:12.340744 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.340702    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7663-140001797052288_a0a1ac78-26d9-492b-9d76-985b644e08c1/test-curl-7663-140001797052288/0.log"
Jul 27 21:40:12.366984 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.366951    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:12.370423 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.370393    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7663-140001797052288"]
Jul 27 21:40:12.393162 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.393134    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqf7x\" (UniqueName: \"kubernetes.io/projected/a0a1ac78-26d9-492b-9d76-985b644e08c1-kube-api-access-dqf7x\") pod \"a0a1ac78-26d9-492b-9d76-985b644e08c1\" (UID: \"a0a1ac78-26d9-492b-9d76-985b644e08c1\") "
Jul 27 21:40:12.395374 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.395341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a1ac78-26d9-492b-9d76-985b644e08c1-kube-api-access-dqf7x" (OuterVolumeSpecName: "kube-api-access-dqf7x") pod "a0a1ac78-26d9-492b-9d76-985b644e08c1" (UID: "a0a1ac78-26d9-492b-9d76-985b644e08c1"). InnerVolumeSpecName "kube-api-access-dqf7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:12.494328 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.494236    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqf7x\" (UniqueName: \"kubernetes.io/projected/a0a1ac78-26d9-492b-9d76-985b644e08c1-kube-api-access-dqf7x\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:40:12.501894 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.501864    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:12.502245 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.502233    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a1ac78-26d9-492b-9d76-985b644e08c1" containerName="test-curl-7663-140001797052288"
Jul 27 21:40:12.502294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.502247    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a1ac78-26d9-492b-9d76-985b644e08c1" containerName="test-curl-7663-140001797052288"
Jul 27 21:40:12.502330 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.502324    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a1ac78-26d9-492b-9d76-985b644e08c1" containerName="test-curl-7663-140001797052288"
Jul 27 21:40:12.505369 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.505353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:12.510464 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.510439    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:12.595363 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.595325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x699c\" (UniqueName: \"kubernetes.io/projected/8732ba25-fef2-4bd4-ad25-09a687914f64-kube-api-access-x699c\") pod \"test-curl-7663-140001803503200\" (UID: \"8732ba25-fef2-4bd4-ad25-09a687914f64\") " pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:12.695989 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.695944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x699c\" (UniqueName: \"kubernetes.io/projected/8732ba25-fef2-4bd4-ad25-09a687914f64-kube-api-access-x699c\") pod \"test-curl-7663-140001803503200\" (UID: \"8732ba25-fef2-4bd4-ad25-09a687914f64\") " pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:12.704216 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.704187    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x699c\" (UniqueName: \"kubernetes.io/projected/8732ba25-fef2-4bd4-ad25-09a687914f64-kube-api-access-x699c\") pod \"test-curl-7663-140001803503200\" (UID: \"8732ba25-fef2-4bd4-ad25-09a687914f64\") " pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:12.815408 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.815371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:12.956991 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:12.956961    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:12.958489 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:12.958464    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8732ba25_fef2_4bd4_ad25_09a687914f64.slice/crio-da5f671718a4ea0474450088c30ceed6b2b26f9f83664f82c8a20e9970c6bd79 WatchSource:0}: Error finding container da5f671718a4ea0474450088c30ceed6b2b26f9f83664f82c8a20e9970c6bd79: Status 404 returned error can't find the container with id da5f671718a4ea0474450088c30ceed6b2b26f9f83664f82c8a20e9970c6bd79
Jul 27 21:40:13.030076 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:13.030042    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a1ac78-26d9-492b-9d76-985b644e08c1" path="/var/lib/kubelet/pods/a0a1ac78-26d9-492b-9d76-985b644e08c1/volumes"
Jul 27 21:40:13.189374 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:13.189266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803503200" event={"ID":"8732ba25-fef2-4bd4-ad25-09a687914f64","Type":"ContainerStarted","Data":"da5f671718a4ea0474450088c30ceed6b2b26f9f83664f82c8a20e9970c6bd79"}
Jul 27 21:40:13.190453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:13.190434    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001797052288"
Jul 27 21:40:13.190545 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:13.190433    2567 scope.go:117] "RemoveContainer" containerID="2f315243bfd2b9ed715927365feae69b2dda7f8f90a7552613d5b94ed9a6a586"
Jul 27 21:40:14.197956 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:14.197921    2567 generic.go:356] "Generic (PLEG): container finished" podID="8732ba25-fef2-4bd4-ad25-09a687914f64" containerID="988eb6516be2c815a1fab40313134a528afd85dd9b9bbd76e8571d5550420f20" exitCode=0
Jul 27 21:40:14.198402 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:14.198007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803503200" event={"ID":"8732ba25-fef2-4bd4-ad25-09a687914f64","Type":"ContainerDied","Data":"988eb6516be2c815a1fab40313134a528afd85dd9b9bbd76e8571d5550420f20"}
Jul 27 21:40:15.349589 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.349540    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:15.368064 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.368028    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7663-140001803503200_8732ba25-fef2-4bd4-ad25-09a687914f64/test-curl-7663-140001803503200/0.log"
Jul 27 21:40:15.391140 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.391107    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:15.397027 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.396999    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:15.422683 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.422639    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x699c\" (UniqueName: \"kubernetes.io/projected/8732ba25-fef2-4bd4-ad25-09a687914f64-kube-api-access-x699c\") pod \"8732ba25-fef2-4bd4-ad25-09a687914f64\" (UID: \"8732ba25-fef2-4bd4-ad25-09a687914f64\") "
Jul 27 21:40:15.424950 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.424915    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8732ba25-fef2-4bd4-ad25-09a687914f64-kube-api-access-x699c" (OuterVolumeSpecName: "kube-api-access-x699c") pod "8732ba25-fef2-4bd4-ad25-09a687914f64" (UID: "8732ba25-fef2-4bd4-ad25-09a687914f64"). InnerVolumeSpecName "kube-api-access-x699c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:15.524376 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.524338    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x699c\" (UniqueName: \"kubernetes.io/projected/8732ba25-fef2-4bd4-ad25-09a687914f64-kube-api-access-x699c\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:40:15.525503 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.525481    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:15.525961 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.525945    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8732ba25-fef2-4bd4-ad25-09a687914f64" containerName="test-curl-7663-140001803503200"
Jul 27 21:40:15.526007 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.525964    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8732ba25-fef2-4bd4-ad25-09a687914f64" containerName="test-curl-7663-140001803503200"
Jul 27 21:40:15.526046 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.526028    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8732ba25-fef2-4bd4-ad25-09a687914f64" containerName="test-curl-7663-140001803503200"
Jul 27 21:40:15.529230 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.529212    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:15.535829 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.535803    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:15.625885 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.625843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmrr6\" (UniqueName: \"kubernetes.io/projected/2cc6c37a-349e-4002-84ef-91e32ad1fbd0-kube-api-access-lmrr6\") pod \"test-curl-7663-140001803503200\" (UID: \"2cc6c37a-349e-4002-84ef-91e32ad1fbd0\") " pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:15.726689 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.726652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmrr6\" (UniqueName: \"kubernetes.io/projected/2cc6c37a-349e-4002-84ef-91e32ad1fbd0-kube-api-access-lmrr6\") pod \"test-curl-7663-140001803503200\" (UID: \"2cc6c37a-349e-4002-84ef-91e32ad1fbd0\") " pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:15.735389 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.735366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmrr6\" (UniqueName: \"kubernetes.io/projected/2cc6c37a-349e-4002-84ef-91e32ad1fbd0-kube-api-access-lmrr6\") pod \"test-curl-7663-140001803503200\" (UID: \"2cc6c37a-349e-4002-84ef-91e32ad1fbd0\") " pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:15.841460 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.841374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:15.978073 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:15.978047    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:15.979729 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:15.979704    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cc6c37a_349e_4002_84ef_91e32ad1fbd0.slice/crio-c0e97bbb64b715f4b7393cfe153b5444d2b56264dae0f98208e01f473e40bdeb WatchSource:0}: Error finding container c0e97bbb64b715f4b7393cfe153b5444d2b56264dae0f98208e01f473e40bdeb: Status 404 returned error can't find the container with id c0e97bbb64b715f4b7393cfe153b5444d2b56264dae0f98208e01f473e40bdeb
Jul 27 21:40:16.213454 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:16.213364    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803503200" event={"ID":"2cc6c37a-349e-4002-84ef-91e32ad1fbd0","Type":"ContainerStarted","Data":"c0e97bbb64b715f4b7393cfe153b5444d2b56264dae0f98208e01f473e40bdeb"}
Jul 27 21:40:16.214760 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:16.214738    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:16.214877 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:16.214744    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da5f671718a4ea0474450088c30ceed6b2b26f9f83664f82c8a20e9970c6bd79"
Jul 27 21:40:16.226434 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:16.226408    2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7663-140001803503200" oldPodUID="8732ba25-fef2-4bd4-ad25-09a687914f64" podUID="2cc6c37a-349e-4002-84ef-91e32ad1fbd0"
Jul 27 21:40:17.029946 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:17.029910    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8732ba25-fef2-4bd4-ad25-09a687914f64" path="/var/lib/kubelet/pods/8732ba25-fef2-4bd4-ad25-09a687914f64/volumes"
Jul 27 21:40:17.221963 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:17.221923    2567 generic.go:356] "Generic (PLEG): container finished" podID="2cc6c37a-349e-4002-84ef-91e32ad1fbd0" containerID="fd44cfd9e06e7518416d6925c65a414dc375ad152fb3ea2a7e1864507976533f" exitCode=0
Jul 27 21:40:17.222127 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:17.221971    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7663-140001803503200" event={"ID":"2cc6c37a-349e-4002-84ef-91e32ad1fbd0","Type":"ContainerDied","Data":"fd44cfd9e06e7518416d6925c65a414dc375ad152fb3ea2a7e1864507976533f"}
Jul 27 21:40:18.365042 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.365016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:18.385497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.385468    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7663-140001803503200_2cc6c37a-349e-4002-84ef-91e32ad1fbd0/test-curl-7663-140001803503200/0.log"
Jul 27 21:40:18.411733 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.411693    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:18.416264 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.416240    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7663-140001803503200"]
Jul 27 21:40:18.450436 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.450404    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmrr6\" (UniqueName: \"kubernetes.io/projected/2cc6c37a-349e-4002-84ef-91e32ad1fbd0-kube-api-access-lmrr6\") pod \"2cc6c37a-349e-4002-84ef-91e32ad1fbd0\" (UID: \"2cc6c37a-349e-4002-84ef-91e32ad1fbd0\") "
Jul 27 21:40:18.452723 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.452693    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc6c37a-349e-4002-84ef-91e32ad1fbd0-kube-api-access-lmrr6" (OuterVolumeSpecName: "kube-api-access-lmrr6") pod "2cc6c37a-349e-4002-84ef-91e32ad1fbd0" (UID: "2cc6c37a-349e-4002-84ef-91e32ad1fbd0"). InnerVolumeSpecName "kube-api-access-lmrr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:18.551703 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:18.551662    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmrr6\" (UniqueName: \"kubernetes.io/projected/2cc6c37a-349e-4002-84ef-91e32ad1fbd0-kube-api-access-lmrr6\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:40:19.029274 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:19.029239    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc6c37a-349e-4002-84ef-91e32ad1fbd0" path="/var/lib/kubelet/pods/2cc6c37a-349e-4002-84ef-91e32ad1fbd0/volumes"
Jul 27 21:40:19.235871 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:19.235834    2567 scope.go:117] "RemoveContainer" containerID="fd44cfd9e06e7518416d6925c65a414dc375ad152fb3ea2a7e1864507976533f"
Jul 27 21:40:19.235871 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:19.235869    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7663-140001803503200"
Jul 27 21:40:22.600120 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.600087    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"]
Jul 27 21:40:22.600516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.600502    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc6c37a-349e-4002-84ef-91e32ad1fbd0" containerName="test-curl-7663-140001803503200"
Jul 27 21:40:22.600594 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.600518    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc6c37a-349e-4002-84ef-91e32ad1fbd0" containerName="test-curl-7663-140001803503200"
Jul 27 21:40:22.600635 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.600601    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc6c37a-349e-4002-84ef-91e32ad1fbd0" containerName="test-curl-7663-140001803503200"
Jul 27 21:40:22.604517 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.604500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.606527 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.606495    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b4bf5c-serving-cert\""
Jul 27 21:40:22.606527 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.606508    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jc7bw\""
Jul 27 21:40:22.606764 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.606529    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:40:22.606922 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.606905    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:40:22.618234 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.618208    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"]
Jul 27 21:40:22.692832 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.692792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.692986 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.692950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qsrj\" (UniqueName: \"kubernetes.io/projected/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-kube-api-access-9qsrj\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.693048 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.692983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.793932 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.793897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qsrj\" (UniqueName: \"kubernetes.io/projected/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-kube-api-access-9qsrj\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.793932 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.793934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.794183 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.793958    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.794673 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.794649    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.796533 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.796515    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.813276 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.813245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qsrj\" (UniqueName: \"kubernetes.io/projected/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-kube-api-access-9qsrj\") pod \"maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:22.915331 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:22.915244    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:23.072366 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.072340    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"]
Jul 27 21:40:23.073375 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:23.073351    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbee2586_6983_466e_a4a8_cbb2bbcfbbee.slice/crio-d2a670987433efdb70b1dccf149280757138fde5acb3b3fec74dd5c4878b2b15 WatchSource:0}: Error finding container d2a670987433efdb70b1dccf149280757138fde5acb3b3fec74dd5c4878b2b15: Status 404 returned error can't find the container with id d2a670987433efdb70b1dccf149280757138fde5acb3b3fec74dd5c4878b2b15
Jul 27 21:40:23.263232 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.263199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc" event={"ID":"bbee2586-6983-466e-a4a8-cbb2bbcfbbee","Type":"ContainerStarted","Data":"d2a670987433efdb70b1dccf149280757138fde5acb3b3fec74dd5c4878b2b15"}
Jul 27 21:40:23.470056 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.470018    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"]
Jul 27 21:40:23.474888 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.474868    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.477140 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.477118    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b4bf5c\""
Jul 27 21:40:23.477259 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.477138    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b4bf5c-dockercfg-mh75g\""
Jul 27 21:40:23.485793 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.485758    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"]
Jul 27 21:40:23.602795 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.602709    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0ae6a2-9798-4071-bf66-b89429ea87a1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.603151 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.602822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgw9n\" (UniqueName: \"kubernetes.io/projected/8e0ae6a2-9798-4071-bf66-b89429ea87a1-kube-api-access-fgw9n\") pod \"payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.704039 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.704003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgw9n\" (UniqueName: \"kubernetes.io/projected/8e0ae6a2-9798-4071-bf66-b89429ea87a1-kube-api-access-fgw9n\") pod \"payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.704214 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.704080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0ae6a2-9798-4071-bf66-b89429ea87a1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.704813 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.704794    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0ae6a2-9798-4071-bf66-b89429ea87a1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.712596 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.712572    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgw9n\" (UniqueName: \"kubernetes.io/projected/8e0ae6a2-9798-4071-bf66-b89429ea87a1-kube-api-access-fgw9n\") pod \"payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.786887 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.786864    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:23.929628 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:23.929594    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"]
Jul 27 21:40:23.931078 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:23.931053    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0ae6a2_9798_4071_bf66_b89429ea87a1.slice/crio-d93b248faa90af9de76a360de92181503092813cbdfa9bd8b6a459b09f42f438 WatchSource:0}: Error finding container d93b248faa90af9de76a360de92181503092813cbdfa9bd8b6a459b09f42f438: Status 404 returned error can't find the container with id d93b248faa90af9de76a360de92181503092813cbdfa9bd8b6a459b09f42f438
Jul 27 21:40:24.269994 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.269959    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc" event={"ID":"bbee2586-6983-466e-a4a8-cbb2bbcfbbee","Type":"ContainerStarted","Data":"fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e"}
Jul 27 21:40:24.270182 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.270037    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:24.271691 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.271670    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl" event={"ID":"8e0ae6a2-9798-4071-bf66-b89429ea87a1","Type":"ContainerStarted","Data":"613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4"}
Jul 27 21:40:24.271789 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.271716    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:24.271789 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.271733    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl" event={"ID":"8e0ae6a2-9798-4071-bf66-b89429ea87a1","Type":"ContainerStarted","Data":"d93b248faa90af9de76a360de92181503092813cbdfa9bd8b6a459b09f42f438"}
Jul 27 21:40:24.290537 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.290200    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc" podStartSLOduration=1.590248124 podStartE2EDuration="2.290181678s" totalImagesPullingTime="699.933554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:24.287358904 +0000 UTC m=+2955.650595198" watchObservedRunningTime="2026-07-27 21:40:24.290181678 +0000 UTC m=+2955.653417974"
Jul 27 21:40:24.312122 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:24.312073    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl" podStartSLOduration=1.312060262 podStartE2EDuration="1.312060262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:24.309971638 +0000 UTC m=+2955.673207931" watchObservedRunningTime="2026-07-27 21:40:24.312060262 +0000 UTC m=+2955.675296555"
Jul 27 21:40:30.283272 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:30.283193    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:40:35.279700 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:35.279668    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:40:42.243360 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.243322    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"]
Jul 27 21:40:42.248261 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.248242    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.251227 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.251200    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9e51a0\""
Jul 27 21:40:42.251334 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.251208    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9e51a0-dockercfg-ks5dq\""
Jul 27 21:40:42.259344 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.259319    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"]
Jul 27 21:40:42.277625 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.277591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbnc9\" (UniqueName: \"kubernetes.io/projected/b804be7a-53cd-4179-985c-be356d9e7986-kube-api-access-pbnc9\") pod \"payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.277782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.277743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b804be7a-53cd-4179-985c-be356d9e7986-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.379523 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.379389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b804be7a-53cd-4179-985c-be356d9e7986-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.379523 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.379488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbnc9\" (UniqueName: \"kubernetes.io/projected/b804be7a-53cd-4179-985c-be356d9e7986-kube-api-access-pbnc9\") pod \"payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.380758 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.380726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b804be7a-53cd-4179-985c-be356d9e7986-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.388535 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.388504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbnc9\" (UniqueName: \"kubernetes.io/projected/b804be7a-53cd-4179-985c-be356d9e7986-kube-api-access-pbnc9\") pod \"payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.559841 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.559799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:42.702969 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:42.702944    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"]
Jul 27 21:40:42.704438 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:40:42.704409    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb804be7a_53cd_4179_985c_be356d9e7986.slice/crio-51f8ac81bca011c40571cf06cb28cc205e6f3d978cb22bea0dbd919dfee078b1 WatchSource:0}: Error finding container 51f8ac81bca011c40571cf06cb28cc205e6f3d978cb22bea0dbd919dfee078b1: Status 404 returned error can't find the container with id 51f8ac81bca011c40571cf06cb28cc205e6f3d978cb22bea0dbd919dfee078b1
Jul 27 21:40:43.383274 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:43.383238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq" event={"ID":"b804be7a-53cd-4179-985c-be356d9e7986","Type":"ContainerStarted","Data":"c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c"}
Jul 27 21:40:43.383822 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:43.383288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq" event={"ID":"b804be7a-53cd-4179-985c-be356d9e7986","Type":"ContainerStarted","Data":"51f8ac81bca011c40571cf06cb28cc205e6f3d978cb22bea0dbd919dfee078b1"}
Jul 27 21:40:43.383822 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:43.383374    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:40:43.399480 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:43.399419    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq" podStartSLOduration=1.399400661 podStartE2EDuration="1.399400661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:43.398411408 +0000 UTC m=+2974.761647702" watchObservedRunningTime="2026-07-27 21:40:43.399400661 +0000 UTC m=+2974.762636955"
Jul 27 21:40:54.391732 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:40:54.391699    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:41:56.083059 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:56.083027    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl_8e0ae6a2-9798-4071-bf66-b89429ea87a1/payload-processing/0.log"
Jul 27 21:41:56.977622 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:56.977589    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"]
Jul 27 21:41:56.981826 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:56.981808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:56.984416 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:56.984397    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-400a5b-openshift-default-dockercfg-rrtgd\""
Jul 27 21:41:56.992327 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:56.992301    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"]
Jul 27 21:41:57.078418 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-podinfo\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078610 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-socket\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078610 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078588    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istiod-ca-cert\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078700 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-token\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078742 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-credential-socket\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078781 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078741    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-envoy\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078816 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078780    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-data\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078878 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-certs\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.078918 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.078906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d96m4\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-kube-api-access-d96m4\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.179871 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.179836    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-podinfo\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.179871 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.179869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-socket\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.179904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istiod-ca-cert\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.179928    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-token\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.179967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-credential-socket\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.179989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-envoy\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180019    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-data\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-certs\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d96m4\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-kube-api-access-d96m4\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.180379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-socket\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.181001 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180509    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-certs\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.181001 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180637    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-credential-socket\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.181001 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180684    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-data\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.181001 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.180737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istiod-ca-cert\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.182528 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.182501    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-envoy\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.183054 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.183036    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-podinfo\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.188432 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.188405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-token\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.188514 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.188472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d96m4\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-kube-api-access-d96m4\") pod \"e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") " pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.293571 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.293529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:57.439034 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.439001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"]
Jul 27 21:41:57.443238 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:41:57.443209    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ec8a5e_28bb_4e24_9411_4bc85cdbe082.slice/crio-b460f0ec705573f7af508bfb787eb2e96e6c7b017822e21a9027da913ab47260 WatchSource:0}: Error finding container b460f0ec705573f7af508bfb787eb2e96e6c7b017822e21a9027da913ab47260: Status 404 returned error can't find the container with id b460f0ec705573f7af508bfb787eb2e96e6c7b017822e21a9027da913ab47260
Jul 27 21:41:57.446333 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.446294    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:57.446419 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.446377    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:57.446419 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.446414    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:41:57.813528 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.813492    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" event={"ID":"09ec8a5e-28bb-4e24-9411-4bc85cdbe082","Type":"ContainerStarted","Data":"7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"}
Jul 27 21:41:57.813753 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.813583    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" event={"ID":"09ec8a5e-28bb-4e24-9411-4bc85cdbe082","Type":"ContainerStarted","Data":"b460f0ec705573f7af508bfb787eb2e96e6c7b017822e21a9027da913ab47260"}
Jul 27 21:41:57.834815 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:57.834765    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podStartSLOduration=1.834750148 podStartE2EDuration="1.834750148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:57.833395179 +0000 UTC m=+3049.196631474" watchObservedRunningTime="2026-07-27 21:41:57.834750148 +0000 UTC m=+3049.197986442"
Jul 27 21:41:58.294305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:58.294270    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:58.299423 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:58.299398    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:58.820066 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:58.820034    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:41:58.820937 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:41:58.820917    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:00.795512 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.795431    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"]
Jul 27 21:42:00.799064 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.799047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:00.803888 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.803869    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-400a5b\""
Jul 27 21:42:00.804260 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.804246    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-400a5b-dockercfg-4t2dr\""
Jul 27 21:42:00.818150 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.818129    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"]
Jul 27 21:42:00.829527 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.829499    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"]
Jul 27 21:42:00.834700 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.834676    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:00.849453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.849429    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"]
Jul 27 21:42:00.917058 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.917019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:00.917240 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.917074    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trbn\" (UniqueName: \"kubernetes.io/projected/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-kube-api-access-9trbn\") pod \"payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:00.917240 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.917198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a556c9-0e0e-41b4-994e-1d9822c8da57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:00.917240 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:00.917237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsc7h\" (UniqueName: \"kubernetes.io/projected/14a556c9-0e0e-41b4-994e-1d9822c8da57-kube-api-access-rsc7h\") pod \"payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.017873 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.017839    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:01.017873 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.017886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trbn\" (UniqueName: \"kubernetes.io/projected/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-kube-api-access-9trbn\") pod \"payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:01.018155 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.017926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a556c9-0e0e-41b4-994e-1d9822c8da57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.018155 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.017952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsc7h\" (UniqueName: \"kubernetes.io/projected/14a556c9-0e0e-41b4-994e-1d9822c8da57-kube-api-access-rsc7h\") pod \"payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.018734 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.018711    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a556c9-0e0e-41b4-994e-1d9822c8da57-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.018832 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.018737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:01.025985 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.025965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsc7h\" (UniqueName: \"kubernetes.io/projected/14a556c9-0e0e-41b4-994e-1d9822c8da57-kube-api-access-rsc7h\") pod \"payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.026102 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.026036    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trbn\" (UniqueName: \"kubernetes.io/projected/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-kube-api-access-9trbn\") pod \"payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:01.110071 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.109981    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:01.146346 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.146309    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.264606 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.264505    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"]
Jul 27 21:42:01.266482 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:42:01.266430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf292e1a_3373_4bf3_a973_9cd3e0dc3ee9.slice/crio-9046153d31022a5d76f063039de9f3dc94905eb8cef259d1df13eb3207e271b9 WatchSource:0}: Error finding container 9046153d31022a5d76f063039de9f3dc94905eb8cef259d1df13eb3207e271b9: Status 404 returned error can't find the container with id 9046153d31022a5d76f063039de9f3dc94905eb8cef259d1df13eb3207e271b9
Jul 27 21:42:01.322098 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.322070    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"]
Jul 27 21:42:01.323496 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:42:01.323462    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a556c9_0e0e_41b4_994e_1d9822c8da57.slice/crio-82900e0c2ee5fc7f34683605663c22f322ff768eb0e0051ad30e3c8263a0cc7e WatchSource:0}: Error finding container 82900e0c2ee5fc7f34683605663c22f322ff768eb0e0051ad30e3c8263a0cc7e: Status 404 returned error can't find the container with id 82900e0c2ee5fc7f34683605663c22f322ff768eb0e0051ad30e3c8263a0cc7e
Jul 27 21:42:01.842977 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.842936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn" event={"ID":"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9","Type":"ContainerStarted","Data":"9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183"}
Jul 27 21:42:01.843494 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.843037    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:01.843494 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.843084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn" event={"ID":"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9","Type":"ContainerStarted","Data":"9046153d31022a5d76f063039de9f3dc94905eb8cef259d1df13eb3207e271b9"}
Jul 27 21:42:01.844616 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.844584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s" event={"ID":"14a556c9-0e0e-41b4-994e-1d9822c8da57","Type":"ContainerStarted","Data":"cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d"}
Jul 27 21:42:01.844741 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.844632    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s" event={"ID":"14a556c9-0e0e-41b4-994e-1d9822c8da57","Type":"ContainerStarted","Data":"82900e0c2ee5fc7f34683605663c22f322ff768eb0e0051ad30e3c8263a0cc7e"}
Jul 27 21:42:01.844741 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.844692    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:01.861358 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.861311    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn" podStartSLOduration=1.8612981290000001 podStartE2EDuration="1.861298129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:01.858445231 +0000 UTC m=+3053.221681526" watchObservedRunningTime="2026-07-27 21:42:01.861298129 +0000 UTC m=+3053.224534422"
Jul 27 21:42:01.881000 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:01.880954    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s" podStartSLOduration=1.8809393829999999 podStartE2EDuration="1.880939383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:01.877387148 +0000 UTC m=+3053.240623441" watchObservedRunningTime="2026-07-27 21:42:01.880939383 +0000 UTC m=+3053.244175711"
Jul 27 21:42:12.854629 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:12.854597    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:12.855016 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:12.854684    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:14.568692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.567469    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": read tcp 10.132.0.2:59952->10.132.0.81:15021: read: connection reset by peer" start-of-body=
Jul 27 21:42:14.568692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.567536    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": read tcp 10.132.0.2:59952->10.132.0.81:15021: read: connection reset by peer"
Jul 27 21:42:14.935039 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.934942    2567 generic.go:356] "Generic (PLEG): container finished" podID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerID="7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159" exitCode=0
Jul 27 21:42:14.935039 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.935022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" event={"ID":"09ec8a5e-28bb-4e24-9411-4bc85cdbe082","Type":"ContainerDied","Data":"7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"}
Jul 27 21:42:14.935497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.935467    2567 scope.go:117] "RemoveContainer" containerID="7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"
Jul 27 21:42:14.936667 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.936642    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:42:14.936729 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.936708    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:42:14.936766 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:14.936740    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 21:42:15.947220 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:15.947167    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" event={"ID":"09ec8a5e-28bb-4e24-9411-4bc85cdbe082","Type":"ContainerStarted","Data":"64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa"}
Jul 27 21:42:16.294141 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:16.294103    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:16.294331 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:16.294301    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:42:16.294377 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:16.294361    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:42:17.294632 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:17.294594    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:42:17.295116 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:17.294666    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:42:18.294159 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:18.294120    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:42:18.294355 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:18.294175    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:42:19.294594 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:19.294540    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 21:42:19.294991 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:19.294618    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 21:42:20.298123 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:20.298086    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:20.298519 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:20.298354    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:20.299164 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:20.299149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:26.041572 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.041523    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"]
Jul 27 21:42:26.042054 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.041817    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn" podUID="df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" containerName="payload-processing" containerID="cri-o://9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183" gracePeriod=30
Jul 27 21:42:26.054307 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.054268    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"]
Jul 27 21:42:26.054684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.054653    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s" podUID="14a556c9-0e0e-41b4-994e-1d9822c8da57" containerName="payload-pre-processing" containerID="cri-o://cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d" gracePeriod=30
Jul 27 21:42:26.332794 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.332767    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:26.374380 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.374346    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:26.474984 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.474954    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsc7h\" (UniqueName: \"kubernetes.io/projected/14a556c9-0e0e-41b4-994e-1d9822c8da57-kube-api-access-rsc7h\") pod \"14a556c9-0e0e-41b4-994e-1d9822c8da57\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") "
Jul 27 21:42:26.475187 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.474997    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a556c9-0e0e-41b4-994e-1d9822c8da57-plugins-config-volume\") pod \"14a556c9-0e0e-41b4-994e-1d9822c8da57\" (UID: \"14a556c9-0e0e-41b4-994e-1d9822c8da57\") "
Jul 27 21:42:26.475187 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.475026    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9trbn\" (UniqueName: \"kubernetes.io/projected/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-kube-api-access-9trbn\") pod \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") "
Jul 27 21:42:26.475187 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.475072    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-plugins-config-volume\") pod \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\" (UID: \"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9\") "
Jul 27 21:42:26.475443 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.475417    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a556c9-0e0e-41b4-994e-1d9822c8da57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14a556c9-0e0e-41b4-994e-1d9822c8da57" (UID: "14a556c9-0e0e-41b4-994e-1d9822c8da57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:26.475529 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.475459    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" (UID: "df292e1a-3373-4bf3-a973-9cd3e0dc3ee9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:26.477293 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.477267    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a556c9-0e0e-41b4-994e-1d9822c8da57-kube-api-access-rsc7h" (OuterVolumeSpecName: "kube-api-access-rsc7h") pod "14a556c9-0e0e-41b4-994e-1d9822c8da57" (UID: "14a556c9-0e0e-41b4-994e-1d9822c8da57"). InnerVolumeSpecName "kube-api-access-rsc7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:26.477389 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.477307    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-kube-api-access-9trbn" (OuterVolumeSpecName: "kube-api-access-9trbn") pod "df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" (UID: "df292e1a-3373-4bf3-a973-9cd3e0dc3ee9"). InnerVolumeSpecName "kube-api-access-9trbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:26.576533 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.576461    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsc7h\" (UniqueName: \"kubernetes.io/projected/14a556c9-0e0e-41b4-994e-1d9822c8da57-kube-api-access-rsc7h\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:26.576533 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.576488    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14a556c9-0e0e-41b4-994e-1d9822c8da57-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:26.576533 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.576497    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9trbn\" (UniqueName: \"kubernetes.io/projected/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-kube-api-access-9trbn\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:26.576533 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:26.576505    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:27.016371 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.016331    2567 generic.go:356] "Generic (PLEG): container finished" podID="14a556c9-0e0e-41b4-994e-1d9822c8da57" containerID="cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d" exitCode=0
Jul 27 21:42:27.016731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.016382    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"
Jul 27 21:42:27.016731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.016418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s" event={"ID":"14a556c9-0e0e-41b4-994e-1d9822c8da57","Type":"ContainerDied","Data":"cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d"}
Jul 27 21:42:27.016731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.016484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s" event={"ID":"14a556c9-0e0e-41b4-994e-1d9822c8da57","Type":"ContainerDied","Data":"82900e0c2ee5fc7f34683605663c22f322ff768eb0e0051ad30e3c8263a0cc7e"}
Jul 27 21:42:27.016731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.016518    2567 scope.go:117] "RemoveContainer" containerID="cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d"
Jul 27 21:42:27.018133 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.018102    2567 generic.go:356] "Generic (PLEG): container finished" podID="df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" containerID="9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183" exitCode=0
Jul 27 21:42:27.018235 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.018154    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"
Jul 27 21:42:27.018235 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.018156    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn" event={"ID":"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9","Type":"ContainerDied","Data":"9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183"}
Jul 27 21:42:27.018235 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.018193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn" event={"ID":"df292e1a-3373-4bf3-a973-9cd3e0dc3ee9","Type":"ContainerDied","Data":"9046153d31022a5d76f063039de9f3dc94905eb8cef259d1df13eb3207e271b9"}
Jul 27 21:42:27.030779 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.030758    2567 scope.go:117] "RemoveContainer" containerID="cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d"
Jul 27 21:42:27.031080 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:42:27.031060    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d\": container with ID starting with cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d not found: ID does not exist" containerID="cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d"
Jul 27 21:42:27.031161 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.031090    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d"} err="failed to get container status \"cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d\": rpc error: code = NotFound desc = could not find container \"cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d\": container with ID starting with cae0998ca670cb77d150ad17d2a94fc58824048ad3707b5ca3a1df91c7c1e74d not found: ID does not exist"
Jul 27 21:42:27.031161 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.031109    2567 scope.go:117] "RemoveContainer" containerID="9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183"
Jul 27 21:42:27.041312 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.041296    2567 scope.go:117] "RemoveContainer" containerID="9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183"
Jul 27 21:42:27.041631 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:42:27.041546    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183\": container with ID starting with 9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183 not found: ID does not exist" containerID="9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183"
Jul 27 21:42:27.041896 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.041641    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183"} err="failed to get container status \"9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183\": rpc error: code = NotFound desc = could not find container \"9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183\": container with ID starting with 9e0a9bb377a792d6904ba0506a33deb9d2939b4229c60216e16802732eb55183 not found: ID does not exist"
Jul 27 21:42:27.046671 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.046638    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"]
Jul 27 21:42:27.050709 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.050691    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-400a5b-547bbdc6b4-v7wvn"]
Jul 27 21:42:27.060398 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.060374    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"]
Jul 27 21:42:27.064402 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:27.064383    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-400a5b-75db9f5fd4-mf69s"]
Jul 27 21:42:29.030516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:29.030483    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a556c9-0e0e-41b4-994e-1d9822c8da57" path="/var/lib/kubelet/pods/14a556c9-0e0e-41b4-994e-1d9822c8da57/volumes"
Jul 27 21:42:29.030991 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:29.030941    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" path="/var/lib/kubelet/pods/df292e1a-3373-4bf3-a973-9cd3e0dc3ee9/volumes"
Jul 27 21:42:37.522017 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:37.521979    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"]
Jul 27 21:42:37.522509 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:37.522188    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy" containerID="cri-o://64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa" gracePeriod=30
Jul 27 21:42:41.676769 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.676731    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"]
Jul 27 21:42:41.677164 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.677149    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" containerName="payload-processing"
Jul 27 21:42:41.677208 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.677168    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" containerName="payload-processing"
Jul 27 21:42:41.677208 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.677190    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a556c9-0e0e-41b4-994e-1d9822c8da57" containerName="payload-pre-processing"
Jul 27 21:42:41.677208 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.677196    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a556c9-0e0e-41b4-994e-1d9822c8da57" containerName="payload-pre-processing"
Jul 27 21:42:41.677305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.677281    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a556c9-0e0e-41b4-994e-1d9822c8da57" containerName="payload-pre-processing"
Jul 27 21:42:41.677305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.677291    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="df292e1a-3373-4bf3-a973-9cd3e0dc3ee9" containerName="payload-processing"
Jul 27 21:42:41.681970 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.681952    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:41.684686 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.684660    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:42:41.687652 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.687628    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"]
Jul 27 21:42:41.718579 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.718535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb\" (UID: \"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:41.819593 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.819506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb\" (UID: \"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:41.820101 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:41.820079    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb\" (UID: \"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:42.007540 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.007503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:42.149364 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.149334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"]
Jul 27 21:42:42.151622 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:42:42.151590    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8cfc6c_5ab2_4fd1_85f7_a336276791ff.slice/crio-d43478a7097809e6685e338bc41bb29e3fa6dd9d01a2fd1db3aee953cd206870 WatchSource:0}: Error finding container d43478a7097809e6685e338bc41bb29e3fa6dd9d01a2fd1db3aee953cd206870: Status 404 returned error can't find the container with id d43478a7097809e6685e338bc41bb29e3fa6dd9d01a2fd1db3aee953cd206870
Jul 27 21:42:42.764944 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.764922    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:42.830141 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830110    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-certs\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830152    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-socket\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830181    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-data\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830202    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d96m4\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-kube-api-access-d96m4\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830231    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-token\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830256    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-credential-socket\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830314    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-podinfo\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-envoy\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830370    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:42:42.830692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830410    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istiod-ca-cert\") pod \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\" (UID: \"09ec8a5e-28bb-4e24-9411-4bc85cdbe082\") "
Jul 27 21:42:42.830692 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830507    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:42:42.830889 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:42:42.830889 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830797    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-certs\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.830889 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830811    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-workload-socket\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.830889 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.830820    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-credential-socket\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.831077 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.831001    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:42.831173 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.831151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-data" (OuterVolumeSpecName: "istio-data") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:42:42.833188 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.833161    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:42:42.833188 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.833185    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-kube-api-access-d96m4" (OuterVolumeSpecName: "kube-api-access-d96m4") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "kube-api-access-d96m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:42.833803 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.833247    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-token" (OuterVolumeSpecName: "istio-token") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:42.833803 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.833270    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09ec8a5e-28bb-4e24-9411-4bc85cdbe082" (UID: "09ec8a5e-28bb-4e24-9411-4bc85cdbe082"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:42:42.932035 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.931957    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-envoy\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.932035 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.931983    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istiod-ca-cert\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.932035 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.931991    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-data\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.932035 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.931999    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d96m4\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-kube-api-access-d96m4\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.932035 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.932007    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-token\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:42.932035 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:42.932015    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ec8a5e-28bb-4e24-9411-4bc85cdbe082-istio-podinfo\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:43.115643 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.115611    2567 generic.go:356] "Generic (PLEG): container finished" podID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerID="64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa" exitCode=0
Jul 27 21:42:43.115809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.115656    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"
Jul 27 21:42:43.115809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.115697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" event={"ID":"09ec8a5e-28bb-4e24-9411-4bc85cdbe082","Type":"ContainerDied","Data":"64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa"}
Jul 27 21:42:43.115809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.115753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf" event={"ID":"09ec8a5e-28bb-4e24-9411-4bc85cdbe082","Type":"ContainerDied","Data":"b460f0ec705573f7af508bfb787eb2e96e6c7b017822e21a9027da913ab47260"}
Jul 27 21:42:43.115809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.115787    2567 scope.go:117] "RemoveContainer" containerID="64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa"
Jul 27 21:42:43.117347 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.117325    2567 generic.go:356] "Generic (PLEG): container finished" podID="8a8cfc6c-5ab2-4fd1-85f7-a336276791ff" containerID="b203a618418d4f9d12e383c9d3b040a80cc13d7c9dbcba002443aac6f2ab44e9" exitCode=0
Jul 27 21:42:43.117453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.117360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb" event={"ID":"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff","Type":"ContainerDied","Data":"b203a618418d4f9d12e383c9d3b040a80cc13d7c9dbcba002443aac6f2ab44e9"}
Jul 27 21:42:43.117453 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.117397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb" event={"ID":"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff","Type":"ContainerStarted","Data":"d43478a7097809e6685e338bc41bb29e3fa6dd9d01a2fd1db3aee953cd206870"}
Jul 27 21:42:43.125978 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.125962    2567 scope.go:117] "RemoveContainer" containerID="7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"
Jul 27 21:42:43.134417 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.134355    2567 scope.go:117] "RemoveContainer" containerID="64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa"
Jul 27 21:42:43.134656 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:42:43.134637    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa\": container with ID starting with 64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa not found: ID does not exist" containerID="64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa"
Jul 27 21:42:43.134718 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.134666    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa"} err="failed to get container status \"64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa\": rpc error: code = NotFound desc = could not find container \"64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa\": container with ID starting with 64bd6f3baba6941f704b239f921b216407f22cb5cd277f06ee7affe47d6bc5fa not found: ID does not exist"
Jul 27 21:42:43.134718 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.134683    2567 scope.go:117] "RemoveContainer" containerID="7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"
Jul 27 21:42:43.134924 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:42:43.134906    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159\": container with ID starting with 7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159 not found: ID does not exist" containerID="7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"
Jul 27 21:42:43.134972 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.134930    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159"} err="failed to get container status \"7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159\": rpc error: code = NotFound desc = could not find container \"7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159\": container with ID starting with 7cd9864038f33370c3a97efef66dd19c46a3e4b13ce58fafc05f5c7ee6773159 not found: ID does not exist"
Jul 27 21:42:43.153353 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.153325    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"]
Jul 27 21:42:43.157484 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:43.157461    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-400a5b-openshift-default-59898b5984-fnwmf"]
Jul 27 21:42:44.264479 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:44.264455    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:44.346130 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:44.346090    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff-maas-api-service-ca\") pod \"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff\" (UID: \"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff\") "
Jul 27 21:42:44.346425 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:44.346405    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a8cfc6c-5ab2-4fd1-85f7-a336276791ff" (UID: "8a8cfc6c-5ab2-4fd1-85f7-a336276791ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:44.447663 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:44.447553    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:45.030852 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:45.030816    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" path="/var/lib/kubelet/pods/09ec8a5e-28bb-4e24-9411-4bc85cdbe082/volumes"
Jul 27 21:42:45.132042 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:45.132013    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"
Jul 27 21:42:45.132206 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:45.132015    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb" event={"ID":"8a8cfc6c-5ab2-4fd1-85f7-a336276791ff","Type":"ContainerDied","Data":"d43478a7097809e6685e338bc41bb29e3fa6dd9d01a2fd1db3aee953cd206870"}
Jul 27 21:42:45.132206 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:45.132138    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d43478a7097809e6685e338bc41bb29e3fa6dd9d01a2fd1db3aee953cd206870"
Jul 27 21:42:57.096767 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.096734    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"]
Jul 27 21:42:57.097339 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.096939    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc" podUID="bbee2586-6983-466e-a4a8-cbb2bbcfbbee" containerName="maas-api" containerID="cri-o://fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e" gracePeriod=30
Jul 27 21:42:57.229299 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.229271    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"]
Jul 27 21:42:57.229538 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.229491    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl" podUID="8e0ae6a2-9798-4071-bf66-b89429ea87a1" containerName="payload-processing" containerID="cri-o://613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4" gracePeriod=30
Jul 27 21:42:57.369610 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.369582    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:42:57.465571 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.465529    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-maas-api-tls\") pod \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") "
Jul 27 21:42:57.465774 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.465661    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qsrj\" (UniqueName: \"kubernetes.io/projected/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-kube-api-access-9qsrj\") pod \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") "
Jul 27 21:42:57.465774 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.465687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-openshift-service-ca\") pod \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\" (UID: \"bbee2586-6983-466e-a4a8-cbb2bbcfbbee\") "
Jul 27 21:42:57.466119 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.466091    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bbee2586-6983-466e-a4a8-cbb2bbcfbbee" (UID: "bbee2586-6983-466e-a4a8-cbb2bbcfbbee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:57.468812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.468787    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bbee2586-6983-466e-a4a8-cbb2bbcfbbee" (UID: "bbee2586-6983-466e-a4a8-cbb2bbcfbbee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:42:57.469045 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.468910    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-kube-api-access-9qsrj" (OuterVolumeSpecName: "kube-api-access-9qsrj") pod "bbee2586-6983-466e-a4a8-cbb2bbcfbbee" (UID: "bbee2586-6983-466e-a4a8-cbb2bbcfbbee"). InnerVolumeSpecName "kube-api-access-9qsrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:57.490417 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.490393    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:42:57.566990 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.566952    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgw9n\" (UniqueName: \"kubernetes.io/projected/8e0ae6a2-9798-4071-bf66-b89429ea87a1-kube-api-access-fgw9n\") pod \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") "
Jul 27 21:42:57.567166 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.567017    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0ae6a2-9798-4071-bf66-b89429ea87a1-plugins-config-volume\") pod \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\" (UID: \"8e0ae6a2-9798-4071-bf66-b89429ea87a1\") "
Jul 27 21:42:57.567346 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.567329    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-maas-api-tls\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:57.567384 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.567354    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qsrj\" (UniqueName: \"kubernetes.io/projected/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-kube-api-access-9qsrj\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:57.567384 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.567367    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbee2586-6983-466e-a4a8-cbb2bbcfbbee-openshift-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:57.567384 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.567368    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e0ae6a2-9798-4071-bf66-b89429ea87a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e0ae6a2-9798-4071-bf66-b89429ea87a1" (UID: "8e0ae6a2-9798-4071-bf66-b89429ea87a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:57.569217 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.569198    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0ae6a2-9798-4071-bf66-b89429ea87a1-kube-api-access-fgw9n" (OuterVolumeSpecName: "kube-api-access-fgw9n") pod "8e0ae6a2-9798-4071-bf66-b89429ea87a1" (UID: "8e0ae6a2-9798-4071-bf66-b89429ea87a1"). InnerVolumeSpecName "kube-api-access-fgw9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:57.667944 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.667854    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgw9n\" (UniqueName: \"kubernetes.io/projected/8e0ae6a2-9798-4071-bf66-b89429ea87a1-kube-api-access-fgw9n\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:57.667944 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:57.667884    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0ae6a2-9798-4071-bf66-b89429ea87a1-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:42:58.211592 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.211542    2567 generic.go:356] "Generic (PLEG): container finished" podID="8e0ae6a2-9798-4071-bf66-b89429ea87a1" containerID="613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4" exitCode=0
Jul 27 21:42:58.212068 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.211611    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"
Jul 27 21:42:58.212068 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.211639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl" event={"ID":"8e0ae6a2-9798-4071-bf66-b89429ea87a1","Type":"ContainerDied","Data":"613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4"}
Jul 27 21:42:58.212068 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.211697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl" event={"ID":"8e0ae6a2-9798-4071-bf66-b89429ea87a1","Type":"ContainerDied","Data":"d93b248faa90af9de76a360de92181503092813cbdfa9bd8b6a459b09f42f438"}
Jul 27 21:42:58.212068 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.211725    2567 scope.go:117] "RemoveContainer" containerID="613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4"
Jul 27 21:42:58.213679 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.213458    2567 generic.go:356] "Generic (PLEG): container finished" podID="bbee2586-6983-466e-a4a8-cbb2bbcfbbee" containerID="fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e" exitCode=0
Jul 27 21:42:58.213679 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.213492    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc" event={"ID":"bbee2586-6983-466e-a4a8-cbb2bbcfbbee","Type":"ContainerDied","Data":"fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e"}
Jul 27 21:42:58.213679 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.213548    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc" event={"ID":"bbee2586-6983-466e-a4a8-cbb2bbcfbbee","Type":"ContainerDied","Data":"d2a670987433efdb70b1dccf149280757138fde5acb3b3fec74dd5c4878b2b15"}
Jul 27 21:42:58.213679 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.213503    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"
Jul 27 21:42:58.233530 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.233491    2567 scope.go:117] "RemoveContainer" containerID="613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4"
Jul 27 21:42:58.233866 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:42:58.233846    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4\": container with ID starting with 613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4 not found: ID does not exist" containerID="613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4"
Jul 27 21:42:58.233926 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.233874    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4"} err="failed to get container status \"613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4\": rpc error: code = NotFound desc = could not find container \"613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4\": container with ID starting with 613c12d16d7a52460da4bd3563dc30be2eb2bcb9c4d44b96e5aad1147df902b4 not found: ID does not exist"
Jul 27 21:42:58.233926 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.233891    2567 scope.go:117] "RemoveContainer" containerID="fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e"
Jul 27 21:42:58.244067 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.244047    2567 scope.go:117] "RemoveContainer" containerID="fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e"
Jul 27 21:42:58.244357 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:42:58.244333    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e\": container with ID starting with fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e not found: ID does not exist" containerID="fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e"
Jul 27 21:42:58.244450 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.244367    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e"} err="failed to get container status \"fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e\": rpc error: code = NotFound desc = could not find container \"fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e\": container with ID starting with fee838f8a743afbfa68bbd2c8a65c0d3a43b4468bd1c0edfb0718bf9e565d07e not found: ID does not exist"
Jul 27 21:42:58.246195 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.246171    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"]
Jul 27 21:42:58.249235 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.249212    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4bf5c-cc7bdbb8f-kfdzc"]
Jul 27 21:42:58.260331 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.260306    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"]
Jul 27 21:42:58.262529 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:58.262507    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4bf5c-54fbb66f5d-zdvkl"]
Jul 27 21:42:59.029688 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:59.029657    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0ae6a2-9798-4071-bf66-b89429ea87a1" path="/var/lib/kubelet/pods/8e0ae6a2-9798-4071-bf66-b89429ea87a1/volumes"
Jul 27 21:42:59.030061 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:42:59.030047    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbee2586-6983-466e-a4a8-cbb2bbcfbbee" path="/var/lib/kubelet/pods/bbee2586-6983-466e-a4a8-cbb2bbcfbbee/volumes"
Jul 27 21:43:01.744899 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:01.744867    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"]
Jul 27 21:43:01.747802 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:01.747774    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4bf5c-wxszb"]
Jul 27 21:43:03.029203 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:03.029165    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a8cfc6c-5ab2-4fd1-85f7-a336276791ff" path="/var/lib/kubelet/pods/8a8cfc6c-5ab2-4fd1-85f7-a336276791ff/volumes"
Jul 27 21:43:50.492188 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492150    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"]
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492537    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbee2586-6983-466e-a4a8-cbb2bbcfbbee" containerName="maas-api"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492548    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbee2586-6983-466e-a4a8-cbb2bbcfbbee" containerName="maas-api"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492575    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492581    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492594    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0ae6a2-9798-4071-bf66-b89429ea87a1" containerName="payload-processing"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492601    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0ae6a2-9798-4071-bf66-b89429ea87a1" containerName="payload-processing"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492609    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8cfc6c-5ab2-4fd1-85f7-a336276791ff" containerName="revoke-keys"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492614    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8cfc6c-5ab2-4fd1-85f7-a336276791ff" containerName="revoke-keys"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492677    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8cfc6c-5ab2-4fd1-85f7-a336276791ff" containerName="revoke-keys"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492687    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e0ae6a2-9798-4071-bf66-b89429ea87a1" containerName="payload-processing"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492695    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy"
Jul 27 21:43:50.492725 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.492703    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbee2586-6983-466e-a4a8-cbb2bbcfbbee" containerName="maas-api"
Jul 27 21:43:50.495773 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.495755    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:50.497986 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.497963    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:43:50.498062 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.498035    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:43:50.503054 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.503022    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"]
Jul 27 21:43:50.575766 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.575726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756a022-54a3-40d0-aaed-4101d6f8083a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck\" (UID: \"f756a022-54a3-40d0-aaed-4101d6f8083a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:50.677159 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.677119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756a022-54a3-40d0-aaed-4101d6f8083a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck\" (UID: \"f756a022-54a3-40d0-aaed-4101d6f8083a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:50.677797 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.677767    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756a022-54a3-40d0-aaed-4101d6f8083a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck\" (UID: \"f756a022-54a3-40d0-aaed-4101d6f8083a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:50.807831 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.807796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:50.980601 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:50.980547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"]
Jul 27 21:43:50.983620 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:43:50.983585    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf756a022_54a3_40d0_aaed_4101d6f8083a.slice/crio-44103a640c3eb525dc9666b7dd18faaf0da2023d32d7b7f0263c92111014d258 WatchSource:0}: Error finding container 44103a640c3eb525dc9666b7dd18faaf0da2023d32d7b7f0263c92111014d258: Status 404 returned error can't find the container with id 44103a640c3eb525dc9666b7dd18faaf0da2023d32d7b7f0263c92111014d258
Jul 27 21:43:51.530379 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:51.530335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck" event={"ID":"f756a022-54a3-40d0-aaed-4101d6f8083a","Type":"ContainerStarted","Data":"12bca8aca7c7bae91706baabd41be03142cdc6bf1e15ee6312f7b5b77a43a678"}
Jul 27 21:43:51.530809 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:51.530405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck" event={"ID":"f756a022-54a3-40d0-aaed-4101d6f8083a","Type":"ContainerStarted","Data":"44103a640c3eb525dc9666b7dd18faaf0da2023d32d7b7f0263c92111014d258"}
Jul 27 21:43:51.547607 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:51.547531    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck" podStartSLOduration=1.5475135770000001 podStartE2EDuration="1.547513577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:43:51.544694129 +0000 UTC m=+3162.907930424" watchObservedRunningTime="2026-07-27 21:43:51.547513577 +0000 UTC m=+3162.910749871"
Jul 27 21:43:52.538529 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:52.538493    2567 generic.go:356] "Generic (PLEG): container finished" podID="f756a022-54a3-40d0-aaed-4101d6f8083a" containerID="12bca8aca7c7bae91706baabd41be03142cdc6bf1e15ee6312f7b5b77a43a678" exitCode=0
Jul 27 21:43:52.539062 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:52.538582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck" event={"ID":"f756a022-54a3-40d0-aaed-4101d6f8083a","Type":"ContainerDied","Data":"12bca8aca7c7bae91706baabd41be03142cdc6bf1e15ee6312f7b5b77a43a678"}
Jul 27 21:43:53.680399 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:53.680374    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:53.809122 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:53.809025    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756a022-54a3-40d0-aaed-4101d6f8083a-maas-api-service-ca\") pod \"f756a022-54a3-40d0-aaed-4101d6f8083a\" (UID: \"f756a022-54a3-40d0-aaed-4101d6f8083a\") "
Jul 27 21:43:53.809404 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:53.809381    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f756a022-54a3-40d0-aaed-4101d6f8083a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f756a022-54a3-40d0-aaed-4101d6f8083a" (UID: "f756a022-54a3-40d0-aaed-4101d6f8083a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:43:53.910020 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:53.909969    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f756a022-54a3-40d0-aaed-4101d6f8083a-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:43:54.552294 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:54.552266    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"
Jul 27 21:43:54.552472 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:54.552305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck" event={"ID":"f756a022-54a3-40d0-aaed-4101d6f8083a","Type":"ContainerDied","Data":"44103a640c3eb525dc9666b7dd18faaf0da2023d32d7b7f0263c92111014d258"}
Jul 27 21:43:54.552472 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:43:54.552354    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44103a640c3eb525dc9666b7dd18faaf0da2023d32d7b7f0263c92111014d258"
Jul 27 21:44:01.190724 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.190688    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"]
Jul 27 21:44:01.191325 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.190988    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq" podUID="b804be7a-53cd-4179-985c-be356d9e7986" containerName="payload-pre-processing" containerID="cri-o://c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c" gracePeriod=30
Jul 27 21:44:01.461783 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.461745    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:44:01.480483 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.480448    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b804be7a-53cd-4179-985c-be356d9e7986-plugins-config-volume\") pod \"b804be7a-53cd-4179-985c-be356d9e7986\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") "
Jul 27 21:44:01.480684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.480552    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbnc9\" (UniqueName: \"kubernetes.io/projected/b804be7a-53cd-4179-985c-be356d9e7986-kube-api-access-pbnc9\") pod \"b804be7a-53cd-4179-985c-be356d9e7986\" (UID: \"b804be7a-53cd-4179-985c-be356d9e7986\") "
Jul 27 21:44:01.480960 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.480929    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b804be7a-53cd-4179-985c-be356d9e7986-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b804be7a-53cd-4179-985c-be356d9e7986" (UID: "b804be7a-53cd-4179-985c-be356d9e7986"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:01.483296 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.483270    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b804be7a-53cd-4179-985c-be356d9e7986-kube-api-access-pbnc9" (OuterVolumeSpecName: "kube-api-access-pbnc9") pod "b804be7a-53cd-4179-985c-be356d9e7986" (UID: "b804be7a-53cd-4179-985c-be356d9e7986"). InnerVolumeSpecName "kube-api-access-pbnc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:44:01.582431 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.582391    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b804be7a-53cd-4179-985c-be356d9e7986-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:01.582431 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.582422    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbnc9\" (UniqueName: \"kubernetes.io/projected/b804be7a-53cd-4179-985c-be356d9e7986-kube-api-access-pbnc9\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:01.594237 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.594200    2567 generic.go:356] "Generic (PLEG): container finished" podID="b804be7a-53cd-4179-985c-be356d9e7986" containerID="c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c" exitCode=0
Jul 27 21:44:01.594404 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.594250    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"
Jul 27 21:44:01.594404 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.594278    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq" event={"ID":"b804be7a-53cd-4179-985c-be356d9e7986","Type":"ContainerDied","Data":"c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c"}
Jul 27 21:44:01.594404 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.594337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq" event={"ID":"b804be7a-53cd-4179-985c-be356d9e7986","Type":"ContainerDied","Data":"51f8ac81bca011c40571cf06cb28cc205e6f3d978cb22bea0dbd919dfee078b1"}
Jul 27 21:44:01.594404 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.594360    2567 scope.go:117] "RemoveContainer" containerID="c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c"
Jul 27 21:44:01.604799 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.604776    2567 scope.go:117] "RemoveContainer" containerID="c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c"
Jul 27 21:44:01.605145 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:44:01.605118    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c\": container with ID starting with c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c not found: ID does not exist" containerID="c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c"
Jul 27 21:44:01.605205 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.605150    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c"} err="failed to get container status \"c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c\": rpc error: code = NotFound desc = could not find container \"c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c\": container with ID starting with c59efc3e3b78641cdf75ff8e799b7030467b25ca7203abe9e40665e97fb5280c not found: ID does not exist"
Jul 27 21:44:01.637841 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.637805    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"]
Jul 27 21:44:01.643705 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:01.643674    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-9e51a0-868bf8b5f6-pwlpq"]
Jul 27 21:44:02.078439 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078401    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n6sj"]
Jul 27 21:44:02.078900 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078840    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy"
Jul 27 21:44:02.078978 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078904    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy"
Jul 27 21:44:02.078978 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078919    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b804be7a-53cd-4179-985c-be356d9e7986" containerName="payload-pre-processing"
Jul 27 21:44:02.078978 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078927    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b804be7a-53cd-4179-985c-be356d9e7986" containerName="payload-pre-processing"
Jul 27 21:44:02.078978 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078941    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f756a022-54a3-40d0-aaed-4101d6f8083a" containerName="revoke-keys"
Jul 27 21:44:02.078978 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.078947    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f756a022-54a3-40d0-aaed-4101d6f8083a" containerName="revoke-keys"
Jul 27 21:44:02.079134 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.079034    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f756a022-54a3-40d0-aaed-4101d6f8083a" containerName="revoke-keys"
Jul 27 21:44:02.079134 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.079046    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ec8a5e-28bb-4e24-9411-4bc85cdbe082" containerName="istio-proxy"
Jul 27 21:44:02.079134 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.079053    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b804be7a-53cd-4179-985c-be356d9e7986" containerName="payload-pre-processing"
Jul 27 21:44:02.083684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.083662    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:02.105071 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.105039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n6sj"]
Jul 27 21:44:02.186945 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.186906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcrf8\" (UniqueName: \"kubernetes.io/projected/63ec7fe8-8402-463a-8726-987c00cd21b8-kube-api-access-lcrf8\") pod \"kuadrant-operator-catalog-7n6sj\" (UID: \"63ec7fe8-8402-463a-8726-987c00cd21b8\") " pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:02.288177 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.288141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcrf8\" (UniqueName: \"kubernetes.io/projected/63ec7fe8-8402-463a-8726-987c00cd21b8-kube-api-access-lcrf8\") pod \"kuadrant-operator-catalog-7n6sj\" (UID: \"63ec7fe8-8402-463a-8726-987c00cd21b8\") " pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:02.296588 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.296543    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcrf8\" (UniqueName: \"kubernetes.io/projected/63ec7fe8-8402-463a-8726-987c00cd21b8-kube-api-access-lcrf8\") pod \"kuadrant-operator-catalog-7n6sj\" (UID: \"63ec7fe8-8402-463a-8726-987c00cd21b8\") " pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:02.394151 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.394044    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:02.548532 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.548503    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n6sj"]
Jul 27 21:44:02.550868 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:44:02.550837    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ec7fe8_8402_463a_8726_987c00cd21b8.slice/crio-f6cf6e9b89987651ac1394f66d35c453f31626edb77e2ed67110e3e07e1adff9 WatchSource:0}: Error finding container f6cf6e9b89987651ac1394f66d35c453f31626edb77e2ed67110e3e07e1adff9: Status 404 returned error can't find the container with id f6cf6e9b89987651ac1394f66d35c453f31626edb77e2ed67110e3e07e1adff9
Jul 27 21:44:02.603517 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:02.603480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj" event={"ID":"63ec7fe8-8402-463a-8726-987c00cd21b8","Type":"ContainerStarted","Data":"f6cf6e9b89987651ac1394f66d35c453f31626edb77e2ed67110e3e07e1adff9"}
Jul 27 21:44:03.029022 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:03.028979    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b804be7a-53cd-4179-985c-be356d9e7986" path="/var/lib/kubelet/pods/b804be7a-53cd-4179-985c-be356d9e7986/volumes"
Jul 27 21:44:03.611279 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:03.611239    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj" event={"ID":"63ec7fe8-8402-463a-8726-987c00cd21b8","Type":"ContainerStarted","Data":"8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9"}
Jul 27 21:44:03.629252 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:03.629190    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj" podStartSLOduration=1.078931005 podStartE2EDuration="1.629172903s" totalImagesPullingTime="550.241898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:44:03.626882774 +0000 UTC m=+3174.990119069" watchObservedRunningTime="2026-07-27 21:44:03.629172903 +0000 UTC m=+3174.992409196"
Jul 27 21:44:05.575786 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:05.575744    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"]
Jul 27 21:44:05.580444 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:05.580417    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9e51a0-ngpck"]
Jul 27 21:44:07.029234 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:07.029204    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f756a022-54a3-40d0-aaed-4101d6f8083a" path="/var/lib/kubelet/pods/f756a022-54a3-40d0-aaed-4101d6f8083a/volumes"
Jul 27 21:44:12.394712 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.394674    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:12.395189 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.394736    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:12.416357 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.416323    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:12.569844 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.569813    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"]
Jul 27 21:44:12.574450 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.574432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:12.577195 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.577038    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:44:12.577374 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.577270    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:44:12.583097 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.583073    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"]
Jul 27 21:44:12.684751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.684681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:12.686222 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.686202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg\" (UID: \"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:12.743140 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.743101    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n6sj"]
Jul 27 21:44:12.786914 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.786881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg\" (UID: \"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:12.787499 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.787477    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg\" (UID: \"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:12.892385 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:12.892354    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:13.239331 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:13.239306    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"]
Jul 27 21:44:13.670605 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:13.670546    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg" event={"ID":"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2","Type":"ContainerStarted","Data":"58dccef0d653bdf0800884e535310f5d4e0bcb6b83c96e64bb9cc0299626a509"}
Jul 27 21:44:13.671097 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:13.670630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg" event={"ID":"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2","Type":"ContainerStarted","Data":"dcb46492f2b57907dd83b0b2d61d0176c0d6dc4ed9188b5ef3faccd711660836"}
Jul 27 21:44:13.729098 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:13.729040    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg" podStartSLOduration=1.729021576 podStartE2EDuration="1.729021576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:44:13.712471399 +0000 UTC m=+3185.075707693" watchObservedRunningTime="2026-07-27 21:44:13.729021576 +0000 UTC m=+3185.092257870"
Jul 27 21:44:14.677467 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:14.677429    2567 generic.go:356] "Generic (PLEG): container finished" podID="26b9ebc9-5503-4a2b-9617-8d98f2cfdda2" containerID="58dccef0d653bdf0800884e535310f5d4e0bcb6b83c96e64bb9cc0299626a509" exitCode=0
Jul 27 21:44:14.677912 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:14.677521    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg" event={"ID":"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2","Type":"ContainerDied","Data":"58dccef0d653bdf0800884e535310f5d4e0bcb6b83c96e64bb9cc0299626a509"}
Jul 27 21:44:14.677912 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:14.677685    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj" podUID="63ec7fe8-8402-463a-8726-987c00cd21b8" containerName="registry-server" containerID="cri-o://8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9" gracePeriod=2
Jul 27 21:44:14.940092 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:14.940022    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:15.009973 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.009929    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcrf8\" (UniqueName: \"kubernetes.io/projected/63ec7fe8-8402-463a-8726-987c00cd21b8-kube-api-access-lcrf8\") pod \"63ec7fe8-8402-463a-8726-987c00cd21b8\" (UID: \"63ec7fe8-8402-463a-8726-987c00cd21b8\") "
Jul 27 21:44:15.012249 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.012217    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ec7fe8-8402-463a-8726-987c00cd21b8-kube-api-access-lcrf8" (OuterVolumeSpecName: "kube-api-access-lcrf8") pod "63ec7fe8-8402-463a-8726-987c00cd21b8" (UID: "63ec7fe8-8402-463a-8726-987c00cd21b8"). InnerVolumeSpecName "kube-api-access-lcrf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:44:15.111609 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.111543    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcrf8\" (UniqueName: \"kubernetes.io/projected/63ec7fe8-8402-463a-8726-987c00cd21b8-kube-api-access-lcrf8\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:15.684643 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.684610    2567 generic.go:356] "Generic (PLEG): container finished" podID="63ec7fe8-8402-463a-8726-987c00cd21b8" containerID="8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9" exitCode=0
Jul 27 21:44:15.685082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.684652    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj"
Jul 27 21:44:15.685082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.684692    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj" event={"ID":"63ec7fe8-8402-463a-8726-987c00cd21b8","Type":"ContainerDied","Data":"8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9"}
Jul 27 21:44:15.685082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.684744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7n6sj" event={"ID":"63ec7fe8-8402-463a-8726-987c00cd21b8","Type":"ContainerDied","Data":"f6cf6e9b89987651ac1394f66d35c453f31626edb77e2ed67110e3e07e1adff9"}
Jul 27 21:44:15.685082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.684767    2567 scope.go:117] "RemoveContainer" containerID="8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9"
Jul 27 21:44:15.696334 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.696309    2567 scope.go:117] "RemoveContainer" containerID="8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9"
Jul 27 21:44:15.696689 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:44:15.696667    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9\": container with ID starting with 8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9 not found: ID does not exist" containerID="8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9"
Jul 27 21:44:15.696768 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.696695    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9"} err="failed to get container status \"8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9\": rpc error: code = NotFound desc = could not find container \"8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9\": container with ID starting with 8778c064721fafa7e7f3f86c2a22ffa47a82ddf752f5363d3a11ef31fd15a2f9 not found: ID does not exist"
Jul 27 21:44:15.702073 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.702043    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n6sj"]
Jul 27 21:44:15.706859 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.706832    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7n6sj"]
Jul 27 21:44:15.829775 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.829750    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:15.918526 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.918487    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2-maas-api-service-ca\") pod \"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2\" (UID: \"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2\") "
Jul 27 21:44:15.918886 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:15.918862    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26b9ebc9-5503-4a2b-9617-8d98f2cfdda2" (UID: "26b9ebc9-5503-4a2b-9617-8d98f2cfdda2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:16.019642 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:16.019614    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:16.692870 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:16.692837    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"
Jul 27 21:44:16.692870 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:16.692856    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg" event={"ID":"26b9ebc9-5503-4a2b-9617-8d98f2cfdda2","Type":"ContainerDied","Data":"dcb46492f2b57907dd83b0b2d61d0176c0d6dc4ed9188b5ef3faccd711660836"}
Jul 27 21:44:16.693338 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:16.692905    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcb46492f2b57907dd83b0b2d61d0176c0d6dc4ed9188b5ef3faccd711660836"
Jul 27 21:44:17.030254 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:17.030225    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ec7fe8-8402-463a-8726-987c00cd21b8" path="/var/lib/kubelet/pods/63ec7fe8-8402-463a-8726-987c00cd21b8/volumes"
Jul 27 21:44:23.049658 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.049622    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"]
Jul 27 21:44:23.050172 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.049852    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg" podUID="ce47a33b-f751-4c61-86bd-c19f504f53ad" containerName="payload-processing" containerID="cri-o://832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f" gracePeriod=30
Jul 27 21:44:23.316746 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.316717    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:44:23.395141 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.395106    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce47a33b-f751-4c61-86bd-c19f504f53ad-plugins-config-volume\") pod \"ce47a33b-f751-4c61-86bd-c19f504f53ad\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") "
Jul 27 21:44:23.395305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.395162    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kcgp\" (UniqueName: \"kubernetes.io/projected/ce47a33b-f751-4c61-86bd-c19f504f53ad-kube-api-access-8kcgp\") pod \"ce47a33b-f751-4c61-86bd-c19f504f53ad\" (UID: \"ce47a33b-f751-4c61-86bd-c19f504f53ad\") "
Jul 27 21:44:23.395601 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.395551    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce47a33b-f751-4c61-86bd-c19f504f53ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce47a33b-f751-4c61-86bd-c19f504f53ad" (UID: "ce47a33b-f751-4c61-86bd-c19f504f53ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:23.397529 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.397496    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce47a33b-f751-4c61-86bd-c19f504f53ad-kube-api-access-8kcgp" (OuterVolumeSpecName: "kube-api-access-8kcgp") pod "ce47a33b-f751-4c61-86bd-c19f504f53ad" (UID: "ce47a33b-f751-4c61-86bd-c19f504f53ad"). InnerVolumeSpecName "kube-api-access-8kcgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:44:23.496641 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.496598    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce47a33b-f751-4c61-86bd-c19f504f53ad-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:23.496641 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.496635    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kcgp\" (UniqueName: \"kubernetes.io/projected/ce47a33b-f751-4c61-86bd-c19f504f53ad-kube-api-access-8kcgp\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:23.738529 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.738435    2567 generic.go:356] "Generic (PLEG): container finished" podID="ce47a33b-f751-4c61-86bd-c19f504f53ad" containerID="832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f" exitCode=0
Jul 27 21:44:23.738529 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.738503    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"
Jul 27 21:44:23.738751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.738532    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg" event={"ID":"ce47a33b-f751-4c61-86bd-c19f504f53ad","Type":"ContainerDied","Data":"832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f"}
Jul 27 21:44:23.738751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.738630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg" event={"ID":"ce47a33b-f751-4c61-86bd-c19f504f53ad","Type":"ContainerDied","Data":"704c3682af18e809913381f9c12f090929d5cbe4a1daf6892ce6757a08336602"}
Jul 27 21:44:23.738751 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.738653    2567 scope.go:117] "RemoveContainer" containerID="832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f"
Jul 27 21:44:23.750880 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.750853    2567 scope.go:117] "RemoveContainer" containerID="832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f"
Jul 27 21:44:23.751254 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:44:23.751233    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f\": container with ID starting with 832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f not found: ID does not exist" containerID="832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f"
Jul 27 21:44:23.751321 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.751264    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f"} err="failed to get container status \"832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f\": rpc error: code = NotFound desc = could not find container \"832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f\": container with ID starting with 832b7f4f184bcac9430639347528ad1159bf45505d89bb6b040bb58d7495119f not found: ID does not exist"
Jul 27 21:44:23.766219 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.766188    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"]
Jul 27 21:44:23.772688 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:23.772661    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6dd721-6754c8bb6-9h8wg"]
Jul 27 21:44:25.029052 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:25.029021    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce47a33b-f751-4c61-86bd-c19f504f53ad" path="/var/lib/kubelet/pods/ce47a33b-f751-4c61-86bd-c19f504f53ad/volumes"
Jul 27 21:44:27.638866 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:27.638521    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"]
Jul 27 21:44:27.641098 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:27.641071    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6dd721-mszkg"]
Jul 27 21:44:29.029452 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:29.029415    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b9ebc9-5503-4a2b-9617-8d98f2cfdda2" path="/var/lib/kubelet/pods/26b9ebc9-5503-4a2b-9617-8d98f2cfdda2/volumes"
Jul 27 21:44:34.555260 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555222    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"]
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555612    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ec7fe8-8402-463a-8726-987c00cd21b8" containerName="registry-server"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555624    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ec7fe8-8402-463a-8726-987c00cd21b8" containerName="registry-server"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555635    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce47a33b-f751-4c61-86bd-c19f504f53ad" containerName="payload-processing"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555641    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce47a33b-f751-4c61-86bd-c19f504f53ad" containerName="payload-processing"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555649    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b9ebc9-5503-4a2b-9617-8d98f2cfdda2" containerName="revoke-keys"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555656    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b9ebc9-5503-4a2b-9617-8d98f2cfdda2" containerName="revoke-keys"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555720    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ec7fe8-8402-463a-8726-987c00cd21b8" containerName="registry-server"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555729    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce47a33b-f751-4c61-86bd-c19f504f53ad" containerName="payload-processing"
Jul 27 21:44:34.555812 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.555735    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b9ebc9-5503-4a2b-9617-8d98f2cfdda2" containerName="revoke-keys"
Jul 27 21:44:34.559707 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.559688    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:34.561908 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.561885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:44:34.562030 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.561889    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:44:34.566625 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.566601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"]
Jul 27 21:44:34.705012 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.704975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea30ac1-4289-4242-9d45-ab724033d8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm\" (UID: \"fea30ac1-4289-4242-9d45-ab724033d8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:34.806803 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.806655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea30ac1-4289-4242-9d45-ab724033d8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm\" (UID: \"fea30ac1-4289-4242-9d45-ab724033d8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:34.808120 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.808089    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea30ac1-4289-4242-9d45-ab724033d8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm\" (UID: \"fea30ac1-4289-4242-9d45-ab724033d8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:34.872928 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:34.872878    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:35.016343 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:35.016312    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"]
Jul 27 21:44:35.018524 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:44:35.018497    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea30ac1_4289_4242_9d45_ab724033d8e2.slice/crio-f72b7e2355c107798afcea181afb81a330133876ecd5cdace2d6c7d037addbdd WatchSource:0}: Error finding container f72b7e2355c107798afcea181afb81a330133876ecd5cdace2d6c7d037addbdd: Status 404 returned error can't find the container with id f72b7e2355c107798afcea181afb81a330133876ecd5cdace2d6c7d037addbdd
Jul 27 21:44:35.815328 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:35.815295    2567 generic.go:356] "Generic (PLEG): container finished" podID="fea30ac1-4289-4242-9d45-ab724033d8e2" containerID="51ccbb1f29d96dce77aa2b0225f23d092917feee68195055a130b768cce14aa6" exitCode=0
Jul 27 21:44:35.815726 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:35.815358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm" event={"ID":"fea30ac1-4289-4242-9d45-ab724033d8e2","Type":"ContainerDied","Data":"51ccbb1f29d96dce77aa2b0225f23d092917feee68195055a130b768cce14aa6"}
Jul 27 21:44:35.815726 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:35.815396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm" event={"ID":"fea30ac1-4289-4242-9d45-ab724033d8e2","Type":"ContainerStarted","Data":"f72b7e2355c107798afcea181afb81a330133876ecd5cdace2d6c7d037addbdd"}
Jul 27 21:44:36.962238 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:36.962214    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:37.025241 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:37.025209    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea30ac1-4289-4242-9d45-ab724033d8e2-maas-api-service-ca\") pod \"fea30ac1-4289-4242-9d45-ab724033d8e2\" (UID: \"fea30ac1-4289-4242-9d45-ab724033d8e2\") "
Jul 27 21:44:37.025525 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:37.025506    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fea30ac1-4289-4242-9d45-ab724033d8e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fea30ac1-4289-4242-9d45-ab724033d8e2" (UID: "fea30ac1-4289-4242-9d45-ab724033d8e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:37.025642 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:37.025629    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea30ac1-4289-4242-9d45-ab724033d8e2-maas-api-service-ca\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:37.827683 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:37.827650    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"
Jul 27 21:44:37.827683 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:37.827679    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm" event={"ID":"fea30ac1-4289-4242-9d45-ab724033d8e2","Type":"ContainerDied","Data":"f72b7e2355c107798afcea181afb81a330133876ecd5cdace2d6c7d037addbdd"}
Jul 27 21:44:37.827907 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:37.827728    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f72b7e2355c107798afcea181afb81a330133876ecd5cdace2d6c7d037addbdd"
Jul 27 21:44:44.986665 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:44.986622    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"]
Jul 27 21:44:44.987131 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:44.986864    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr" podUID="b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" containerName="payload-pre-processing" containerID="cri-o://c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d" gracePeriod=30
Jul 27 21:44:45.256049 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.256024    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:44:45.295483 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.295450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-plugins-config-volume\") pod \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") "
Jul 27 21:44:45.295689 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.295497    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mznsc\" (UniqueName: \"kubernetes.io/projected/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-kube-api-access-mznsc\") pod \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\" (UID: \"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc\") "
Jul 27 21:44:45.295837 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.295814    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" (UID: "b349f7fd-8ef6-4274-95e4-9cfe96fe32dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:45.297746 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.297713    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-kube-api-access-mznsc" (OuterVolumeSpecName: "kube-api-access-mznsc") pod "b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" (UID: "b349f7fd-8ef6-4274-95e4-9cfe96fe32dc"). InnerVolumeSpecName "kube-api-access-mznsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:44:45.396300 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.396268    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-plugins-config-volume\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:45.396300 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.396296    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mznsc\" (UniqueName: \"kubernetes.io/projected/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc-kube-api-access-mznsc\") on node \"ip-10-0-131-91.ec2.internal\" DevicePath \"\""
Jul 27 21:44:45.875305 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.875262    2567 generic.go:356] "Generic (PLEG): container finished" podID="b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" containerID="c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d" exitCode=0
Jul 27 21:44:45.875516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.875308    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"
Jul 27 21:44:45.875516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.875322    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr" event={"ID":"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc","Type":"ContainerDied","Data":"c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d"}
Jul 27 21:44:45.875516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.875388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr" event={"ID":"b349f7fd-8ef6-4274-95e4-9cfe96fe32dc","Type":"ContainerDied","Data":"6b61fb7fa5baf90da3885b2e41068e40ec83bb9e830805ee87bfd8a7e1f94d45"}
Jul 27 21:44:45.875516 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.875419    2567 scope.go:117] "RemoveContainer" containerID="c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d"
Jul 27 21:44:45.885268 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.885250    2567 scope.go:117] "RemoveContainer" containerID="c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d"
Jul 27 21:44:45.885543 ip-10-0-131-91 kubenswrapper[2567]: E0727 21:44:45.885521    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d\": container with ID starting with c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d not found: ID does not exist" containerID="c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d"
Jul 27 21:44:45.885651 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.885571    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d"} err="failed to get container status \"c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d\": rpc error: code = NotFound desc = could not find container \"c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d\": container with ID starting with c2232eb69898a681cf908a5b16c19b3eddae65c08ebf46b0fc746b6e8518319d not found: ID does not exist"
Jul 27 21:44:45.896935 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.896903    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"]
Jul 27 21:44:45.899054 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:45.899030    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5f50cb-6bbd6cd764-fnrdr"]
Jul 27 21:44:47.029938 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:47.029898    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" path="/var/lib/kubelet/pods/b349f7fd-8ef6-4274-95e4-9cfe96fe32dc/volumes"
Jul 27 21:44:49.627539 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:49.627502    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"]
Jul 27 21:44:49.629684 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:49.629659    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-5f50cb-4kmgm"]
Jul 27 21:44:51.028848 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:51.028817    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fea30ac1-4289-4242-9d45-ab724033d8e2" path="/var/lib/kubelet/pods/fea30ac1-4289-4242-9d45-ab724033d8e2/volumes"
Jul 27 21:44:56.922422 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:44:56.922391    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56ff65b466-d75db_b6950fab-31b5-4f97-9634-bd805f92d20d/authorino/0.log"
Jul 27 21:45:00.144205 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144124    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"]
Jul 27 21:45:00.144622 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144487    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea30ac1-4289-4242-9d45-ab724033d8e2" containerName="revoke-keys"
Jul 27 21:45:00.144622 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144500    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea30ac1-4289-4242-9d45-ab724033d8e2" containerName="revoke-keys"
Jul 27 21:45:00.144622 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144519    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" containerName="payload-pre-processing"
Jul 27 21:45:00.144622 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144525    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" containerName="payload-pre-processing"
Jul 27 21:45:00.144622 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144615    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b349f7fd-8ef6-4274-95e4-9cfe96fe32dc" containerName="payload-pre-processing"
Jul 27 21:45:00.144800 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.144632    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fea30ac1-4289-4242-9d45-ab724033d8e2" containerName="revoke-keys"
Jul 27 21:45:00.147823 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.147805    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"
Jul 27 21:45:00.149847 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.149820    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5rjm\""
Jul 27 21:45:00.155722 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.155694    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"]
Jul 27 21:45:00.160917 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.160895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"
Jul 27 21:45:00.301731 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.301696    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"]
Jul 27 21:45:00.302636 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:45:00.302613    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892666ef_eb12_4944_953e_7ca7b829faf2.slice/crio-1ccba65c22cbe837b31d0c34b2805ddd6cb20d32eade0e4ecd8d196f9b083d3c WatchSource:0}: Error finding container 1ccba65c22cbe837b31d0c34b2805ddd6cb20d32eade0e4ecd8d196f9b083d3c: Status 404 returned error can't find the container with id 1ccba65c22cbe837b31d0c34b2805ddd6cb20d32eade0e4ecd8d196f9b083d3c
Jul 27 21:45:00.962531 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.962437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd" event={"ID":"892666ef-eb12-4944-953e-7ca7b829faf2","Type":"ContainerStarted","Data":"e31281767aae0bd354641e667ba9165ed1dfb30a6f7331ce72d34fcf8e0c5ba1"}
Jul 27 21:45:00.962531 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:00.962496    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd" event={"ID":"892666ef-eb12-4944-953e-7ca7b829faf2","Type":"ContainerStarted","Data":"1ccba65c22cbe837b31d0c34b2805ddd6cb20d32eade0e4ecd8d196f9b083d3c"}
Jul 27 21:45:01.969196 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:01.969159    2567 generic.go:356] "Generic (PLEG): container finished" podID="892666ef-eb12-4944-953e-7ca7b829faf2" containerID="e31281767aae0bd354641e667ba9165ed1dfb30a6f7331ce72d34fcf8e0c5ba1" exitCode=0
Jul 27 21:45:01.969628 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:01.969246    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd" event={"ID":"892666ef-eb12-4944-953e-7ca7b829faf2","Type":"ContainerDied","Data":"e31281767aae0bd354641e667ba9165ed1dfb30a6f7331ce72d34fcf8e0c5ba1"}
Jul 27 21:45:03.110045 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.110022    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"
Jul 27 21:45:03.264757 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.264735    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7c2jb_8d4389e3-0f61-43e0-8ffd-23ad99d609f9/server/0.log"
Jul 27 21:45:03.829899 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.829874    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6d5848fb-wwgcn_b283a11a-87dd-4d0a-9931-3b9f8373343e/copy-manifests/0.log"
Jul 27 21:45:03.841281 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.841218    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6d5848fb-wwgcn_b283a11a-87dd-4d0a-9931-3b9f8373343e/manager/0.log"
Jul 27 21:45:03.982438 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.982409    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd"
Jul 27 21:45:03.982637 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.982452    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753145-kghqd" event={"ID":"892666ef-eb12-4944-953e-7ca7b829faf2","Type":"ContainerDied","Data":"1ccba65c22cbe837b31d0c34b2805ddd6cb20d32eade0e4ecd8d196f9b083d3c"}
Jul 27 21:45:03.982637 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:03.982496    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ccba65c22cbe837b31d0c34b2805ddd6cb20d32eade0e4ecd8d196f9b083d3c"
Jul 27 21:45:04.593471 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:04.593444    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753145-kghqd_892666ef-eb12-4944-953e-7ca7b829faf2/cleanup/0.log"
Jul 27 21:45:05.570850 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.570820    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb_d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba/util/0.log"
Jul 27 21:45:05.577983 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.577962    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb_d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba/pull/0.log"
Jul 27 21:45:05.585158 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.585137    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb_d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba/extract/0.log"
Jul 27 21:45:05.716637 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.716608    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7_d90bac72-7bd5-44e3-a009-51bb6d83f568/util/0.log"
Jul 27 21:45:05.725133 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.725113    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7_d90bac72-7bd5-44e3-a009-51bb6d83f568/pull/0.log"
Jul 27 21:45:05.737057 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.737035    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7_d90bac72-7bd5-44e3-a009-51bb6d83f568/extract/0.log"
Jul 27 21:45:05.868623 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.868536    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75_cd52ec70-0c85-4aa9-846d-5c81dab41851/pull/0.log"
Jul 27 21:45:05.876326 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.876286    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75_cd52ec70-0c85-4aa9-846d-5c81dab41851/extract/0.log"
Jul 27 21:45:05.884065 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:05.884040    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75_cd52ec70-0c85-4aa9-846d-5c81dab41851/util/0.log"
Jul 27 21:45:06.004067 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.004029    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97_509f72ec-3a82-465d-ab80-fc023a67fdcc/util/0.log"
Jul 27 21:45:06.011577 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.011542    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97_509f72ec-3a82-465d-ab80-fc023a67fdcc/pull/0.log"
Jul 27 21:45:06.018427 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.018379    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97_509f72ec-3a82-465d-ab80-fc023a67fdcc/extract/0.log"
Jul 27 21:45:06.146228 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.146141    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56ff65b466-d75db_b6950fab-31b5-4f97-9634-bd805f92d20d/authorino/0.log"
Jul 27 21:45:06.268894 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.268861    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vsd4t_8c3c2650-877d-4630-8926-d5c40cbb3d81/manager/0.log"
Jul 27 21:45:06.513832 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.513797    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zglqb_13a43250-07a6-4102-9fa1-3ac5d399b32c/kuadrant-console-plugin/0.log"
Jul 27 21:45:06.637082 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.637051    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vpq2x_644d0ccd-3371-413b-9c17-668cd5157049/registry-server/0.log"
Jul 27 21:45:06.774771 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:06.774670    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lxzq6_8443de16-5570-46db-bed1-2c73d4d1f578/manager/0.log"
Jul 27 21:45:07.409234 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:07.409199    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5_882534e1-5db6-4877-a6ee-220d7435e74f/istio-proxy/0.log"
Jul 27 21:45:07.911542 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:07.911510    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/1.log"
Jul 27 21:45:09.062212 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:09.062165    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpj8qd_05f8c74f-7b6e-4296-a5c2-704516f45d40/main/0.log"
Jul 27 21:45:15.424414 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.424351    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wd6n7/must-gather-qjb4p"]
Jul 27 21:45:15.424858 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.424819    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892666ef-eb12-4944-953e-7ca7b829faf2" containerName="cleanup"
Jul 27 21:45:15.424858 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.424833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="892666ef-eb12-4944-953e-7ca7b829faf2" containerName="cleanup"
Jul 27 21:45:15.424948 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.424909    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="892666ef-eb12-4944-953e-7ca7b829faf2" containerName="cleanup"
Jul 27 21:45:15.429696 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.429678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.434018 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.433996    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wd6n7\"/\"default-dockercfg-pmb4h\""
Jul 27 21:45:15.434534 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.434516    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wd6n7\"/\"openshift-service-ca.crt\""
Jul 27 21:45:15.435022 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.435007    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wd6n7\"/\"kube-root-ca.crt\""
Jul 27 21:45:15.443732 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.443711    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wd6n7/must-gather-qjb4p"]
Jul 27 21:45:15.586111 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.586066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f75685-2c16-46fc-9ad0-ce410e45d84d-must-gather-output\") pod \"must-gather-qjb4p\" (UID: \"10f75685-2c16-46fc-9ad0-ce410e45d84d\") " pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.586328 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.586178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlww2\" (UniqueName: \"kubernetes.io/projected/10f75685-2c16-46fc-9ad0-ce410e45d84d-kube-api-access-dlww2\") pod \"must-gather-qjb4p\" (UID: \"10f75685-2c16-46fc-9ad0-ce410e45d84d\") " pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.687586 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.687451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f75685-2c16-46fc-9ad0-ce410e45d84d-must-gather-output\") pod \"must-gather-qjb4p\" (UID: \"10f75685-2c16-46fc-9ad0-ce410e45d84d\") " pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.687586 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.687518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlww2\" (UniqueName: \"kubernetes.io/projected/10f75685-2c16-46fc-9ad0-ce410e45d84d-kube-api-access-dlww2\") pod \"must-gather-qjb4p\" (UID: \"10f75685-2c16-46fc-9ad0-ce410e45d84d\") " pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.687903 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.687880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f75685-2c16-46fc-9ad0-ce410e45d84d-must-gather-output\") pod \"must-gather-qjb4p\" (UID: \"10f75685-2c16-46fc-9ad0-ce410e45d84d\") " pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.703595 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.703548    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlww2\" (UniqueName: \"kubernetes.io/projected/10f75685-2c16-46fc-9ad0-ce410e45d84d-kube-api-access-dlww2\") pod \"must-gather-qjb4p\" (UID: \"10f75685-2c16-46fc-9ad0-ce410e45d84d\") " pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.739250 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.739216    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wd6n7/must-gather-qjb4p"
Jul 27 21:45:15.886204 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.886173    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wd6n7/must-gather-qjb4p"]
Jul 27 21:45:15.887027 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:45:15.886998    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10f75685_2c16_46fc_9ad0_ce410e45d84d.slice/crio-06adc02ae26cda302d6cd98fd8cf51a24c58ff6de81731867528c73911e38b93 WatchSource:0}: Error finding container 06adc02ae26cda302d6cd98fd8cf51a24c58ff6de81731867528c73911e38b93: Status 404 returned error can't find the container with id 06adc02ae26cda302d6cd98fd8cf51a24c58ff6de81731867528c73911e38b93
Jul 27 21:45:15.888975 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:15.888955    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:45:16.050627 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:16.050588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wd6n7/must-gather-qjb4p" event={"ID":"10f75685-2c16-46fc-9ad0-ce410e45d84d","Type":"ContainerStarted","Data":"06adc02ae26cda302d6cd98fd8cf51a24c58ff6de81731867528c73911e38b93"}
Jul 27 21:45:17.058762 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:17.058727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wd6n7/must-gather-qjb4p" event={"ID":"10f75685-2c16-46fc-9ad0-ce410e45d84d","Type":"ContainerStarted","Data":"61115ab79a3d7887b2a4b91aa5c15c1cef796d9a4e1ac7ea8c0c2e9c8f0b16d9"}
Jul 27 21:45:17.059152 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:17.058777    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wd6n7/must-gather-qjb4p" event={"ID":"10f75685-2c16-46fc-9ad0-ce410e45d84d","Type":"ContainerStarted","Data":"29006a1145e91e9ebf0c88312ee579f868d0e6eca36961f9e9a5c1f7112c3bb6"}
Jul 27 21:45:17.081394 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:17.081335    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wd6n7/must-gather-qjb4p" podStartSLOduration=1.408190822 podStartE2EDuration="2.081313021s" totalImagesPullingTime="673.122199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:45:17.078257156 +0000 UTC m=+3248.441493450" watchObservedRunningTime="2026-07-27 21:45:17.081313021 +0000 UTC m=+3248.444549313"
Jul 27 21:45:18.198493 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:18.198361    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dlvss_e77adafa-2a18-4718-9eb7-7fa46d6c1192/global-pull-secret-syncer/0.log"
Jul 27 21:45:18.442008 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:18.441978    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j4cv2_274bcbd6-ef93-4686-98a0-18286f84e849/konnectivity-agent/0.log"
Jul 27 21:45:18.525904 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:18.525866    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-91.ec2.internal_ed929be85ebfd2f1b71d7e50ffae918d/haproxy/0.log"
Jul 27 21:45:23.187913 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.187887    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb_d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba/extract/0.log"
Jul 27 21:45:23.223605 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.223540    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb_d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba/util/0.log"
Jul 27 21:45:23.251734 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.251708    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zgcqb_d3c1b607-41b0-4d4b-a63e-20cd0fdc4dba/pull/0.log"
Jul 27 21:45:23.285315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.285232    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7_d90bac72-7bd5-44e3-a009-51bb6d83f568/extract/0.log"
Jul 27 21:45:23.310619 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.310550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7_d90bac72-7bd5-44e3-a009-51bb6d83f568/util/0.log"
Jul 27 21:45:23.334497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.334460    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e088xb7_d90bac72-7bd5-44e3-a009-51bb6d83f568/pull/0.log"
Jul 27 21:45:23.377590 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.377534    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75_cd52ec70-0c85-4aa9-846d-5c81dab41851/extract/0.log"
Jul 27 21:45:23.400329 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.400302    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75_cd52ec70-0c85-4aa9-846d-5c81dab41851/util/0.log"
Jul 27 21:45:23.433953 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.433909    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xqp75_cd52ec70-0c85-4aa9-846d-5c81dab41851/pull/0.log"
Jul 27 21:45:23.480394 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.480314    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97_509f72ec-3a82-465d-ab80-fc023a67fdcc/extract/0.log"
Jul 27 21:45:23.508408 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.508376    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97_509f72ec-3a82-465d-ab80-fc023a67fdcc/util/0.log"
Jul 27 21:45:23.531436 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:23.531404    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1njx97_509f72ec-3a82-465d-ab80-fc023a67fdcc/pull/0.log"
Jul 27 21:45:24.068834 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:24.068806    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56ff65b466-d75db_b6950fab-31b5-4f97-9634-bd805f92d20d/authorino/0.log"
Jul 27 21:45:24.105981 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:24.105928    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vsd4t_8c3c2650-877d-4630-8926-d5c40cbb3d81/manager/0.log"
Jul 27 21:45:24.157685 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:24.157657    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zglqb_13a43250-07a6-4102-9fa1-3ac5d399b32c/kuadrant-console-plugin/0.log"
Jul 27 21:45:24.219207 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:24.219180    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vpq2x_644d0ccd-3371-413b-9c17-668cd5157049/registry-server/0.log"
Jul 27 21:45:24.393735 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:24.393549    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lxzq6_8443de16-5570-46db-bed1-2c73d4d1f578/manager/0.log"
Jul 27 21:45:26.050251 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.050213    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/alertmanager/0.log"
Jul 27 21:45:26.074047 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.074018    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/config-reloader/0.log"
Jul 27 21:45:26.104412 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.104384    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/kube-rbac-proxy-web/0.log"
Jul 27 21:45:26.127314 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.127274    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/kube-rbac-proxy/0.log"
Jul 27 21:45:26.153576 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.153531    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/kube-rbac-proxy-metric/0.log"
Jul 27 21:45:26.180121 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.180094    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/prom-label-proxy/0.log"
Jul 27 21:45:26.203936 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.203906    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_27e2f724-8df4-4489-b9ce-f5752b8e3c9f/init-config-reloader/0.log"
Jul 27 21:45:26.254145 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.254061    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-m2zs4_9288184e-b907-4c15-9a3c-c9225641f949/cluster-monitoring-operator/0.log"
Jul 27 21:45:26.293136 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.293103    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-p27ct_b2013103-0b26-4cb0-8a9f-9775c4647525/kube-state-metrics/0.log"
Jul 27 21:45:26.312930 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.312839    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-p27ct_b2013103-0b26-4cb0-8a9f-9775c4647525/kube-rbac-proxy-main/0.log"
Jul 27 21:45:26.335497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.335424    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-p27ct_b2013103-0b26-4cb0-8a9f-9775c4647525/kube-rbac-proxy-self/0.log"
Jul 27 21:45:26.366106 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.366078    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fc47786f9-dgbbk_ebd84a8b-1971-460c-aab5-f539042449b0/metrics-server/0.log"
Jul 27 21:45:26.504497 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.504471    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bmmr_b92ebdc6-8df5-4729-8410-077e4d30bf87/node-exporter/0.log"
Jul 27 21:45:26.525381 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.525347    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bmmr_b92ebdc6-8df5-4729-8410-077e4d30bf87/kube-rbac-proxy/0.log"
Jul 27 21:45:26.548536 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:26.548508    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6bmmr_b92ebdc6-8df5-4729-8410-077e4d30bf87/init-textfile/0.log"
Jul 27 21:45:27.001769 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:27.001679    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-787b5fd694-99trj_c2a44616-1a3d-448d-bed6-a6d5023cb3fe/telemeter-client/0.log"
Jul 27 21:45:27.022989 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:27.022940    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-787b5fd694-99trj_c2a44616-1a3d-448d-bed6-a6d5023cb3fe/reload/0.log"
Jul 27 21:45:27.046675 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:27.046643    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-787b5fd694-99trj_c2a44616-1a3d-448d-bed6-a6d5023cb3fe/kube-rbac-proxy/0.log"
Jul 27 21:45:27.987519 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:27.987485    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"]
Jul 27 21:45:27.994604 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:27.994578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:27.997199 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:27.997165    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"]
Jul 27 21:45:28.025943 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.025891    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-lib-modules\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.026163 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.025977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-proc\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.026163 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.026019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-podres\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.026163 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.026090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-sys\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.026353 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.026206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz6bk\" (UniqueName: \"kubernetes.io/projected/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-kube-api-access-rz6bk\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127002 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.126964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-sys\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127383 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz6bk\" (UniqueName: \"kubernetes.io/projected/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-kube-api-access-rz6bk\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127383 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-lib-modules\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127605 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-proc\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127605 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127458    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-podres\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127743 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-sys\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127743 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-podres\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127743 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-proc\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.127910 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.127748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-lib-modules\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.136229 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.136201    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz6bk\" (UniqueName: \"kubernetes.io/projected/7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9-kube-api-access-rz6bk\") pod \"perf-node-gather-daemonset-x9bvq\" (UID: \"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9\") " pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.312062 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.312028    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:28.374398 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.374369    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-gwx9c_2ddacfee-9e8f-4c36-8c01-e4f334abe684/networking-console-plugin/0.log"
Jul 27 21:45:28.512443 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:28.509978    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"]
Jul 27 21:45:28.513301 ip-10-0-131-91 kubenswrapper[2567]: W0727 21:45:28.513256    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7edf1f47_c5ff_47e4_a9a8_9fea9999c0a9.slice/crio-23405052ec19b9e2757e19df9ad53c78eb6692869a7c4f59cdee723527d545b7 WatchSource:0}: Error finding container 23405052ec19b9e2757e19df9ad53c78eb6692869a7c4f59cdee723527d545b7: Status 404 returned error can't find the container with id 23405052ec19b9e2757e19df9ad53c78eb6692869a7c4f59cdee723527d545b7
Jul 27 21:45:29.167289 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:29.167244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq" event={"ID":"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9","Type":"ContainerStarted","Data":"ef0b55ef12509c43d8108c4142b96145afdd177e138d55baab657633282975c0"}
Jul 27 21:45:29.167796 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:29.167316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq" event={"ID":"7edf1f47-c5ff-47e4-a9a8-9fea9999c0a9","Type":"ContainerStarted","Data":"23405052ec19b9e2757e19df9ad53c78eb6692869a7c4f59cdee723527d545b7"}
Jul 27 21:45:29.168198 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:29.168169    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:31.205925 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:31.205899    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wt9c_4dc17931-747e-4a9c-9e2c-7bbe085ed090/dns/0.log"
Jul 27 21:45:31.226527 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:31.226504    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wt9c_4dc17931-747e-4a9c-9e2c-7bbe085ed090/kube-rbac-proxy/0.log"
Jul 27 21:45:31.355266 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:31.355241    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4kldw_32952a5d-cf34-405d-b269-53a351f82d9a/dns-node-resolver/0.log"
Jul 27 21:45:32.012926 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:32.012899    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kz7c6_dc844e47-3a37-488e-8b43-45d669c7a184/node-ca/0.log"
Jul 27 21:45:32.936607 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:32.936577    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5_882534e1-5db6-4877-a6ee-220d7435e74f/istio-proxy/0.log"
Jul 27 21:45:33.157721 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:33.157688    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/0.log"
Jul 27 21:45:33.194928 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:33.194823    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/1.log"
Jul 27 21:45:34.123408 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:34.123382    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmx7s_c1df2aed-dc55-4a60-8bd4-26984cc5c324/serve-healthcheck-canary/0.log"
Jul 27 21:45:34.629909 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:34.629873    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-mvhgs_40ad3ed6-5a32-4b1b-b42d-134ba41022e8/insights-operator/0.log"
Jul 27 21:45:34.630618 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:34.630596    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-mvhgs_40ad3ed6-5a32-4b1b-b42d-134ba41022e8/insights-operator/1.log"
Jul 27 21:45:34.736190 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:34.736151    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cr6p4_c2e340e0-0aac-4d30-8895-d8c337d95374/kube-rbac-proxy/0.log"
Jul 27 21:45:34.758417 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:34.758392    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cr6p4_c2e340e0-0aac-4d30-8895-d8c337d95374/exporter/0.log"
Jul 27 21:45:34.779651 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:34.779583    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cr6p4_c2e340e0-0aac-4d30-8895-d8c337d95374/extractor/0.log"
Jul 27 21:45:36.199768 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:36.199740    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq"
Jul 27 21:45:36.217784 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:36.217721    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wd6n7/perf-node-gather-daemonset-x9bvq" podStartSLOduration=9.217701887 podStartE2EDuration="9.217701887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:45:29.184640659 +0000 UTC m=+3260.547876953" watchObservedRunningTime="2026-07-27 21:45:36.217701887 +0000 UTC m=+3267.580938182"
Jul 27 21:45:37.359827 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:37.359793    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7c2jb_8d4389e3-0f61-43e0-8ffd-23ad99d609f9/server/0.log"
Jul 27 21:45:37.619267 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:37.619143    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6d5848fb-wwgcn_b283a11a-87dd-4d0a-9931-3b9f8373343e/manager/0.log"
Jul 27 21:45:37.644624 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:37.644489    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6d5848fb-wwgcn_b283a11a-87dd-4d0a-9931-3b9f8373343e/copy-manifests/0.log"
Jul 27 21:45:38.742301 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:38.742190    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5_882534e1-5db6-4877-a6ee-220d7435e74f/istio-proxy/0.log"
Jul 27 21:45:38.946076 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:38.946049    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/0.log"
Jul 27 21:45:38.988315 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:38.988279    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/1.log"
Jul 27 21:45:39.031191 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:39.031161    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f9595876c-lghz2_edac62c3-83aa-4d93-8d00-7f5dd822948e/manager/0.log"
Jul 27 21:45:39.090442 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:39.090414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ghdgb_4151fec5-91d8-4a5a-a414-7aff07be96fb/openshift-lws-operator/0.log"
Jul 27 21:45:40.421102 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:40.421070    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-mjhl5_882534e1-5db6-4877-a6ee-220d7435e74f/istio-proxy/0.log"
Jul 27 21:45:40.618605 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:40.618577    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/0.log"
Jul 27 21:45:40.659964 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:40.659933    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8tm2q_5284e6c3-64e0-45cd-b542-c34cce2aa7cf/istio-proxy/1.log"
Jul 27 21:45:45.941548 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:45.941517    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/kube-multus-additional-cni-plugins/0.log"
Jul 27 21:45:45.962847 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:45.962818    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/egress-router-binary-copy/0.log"
Jul 27 21:45:45.982766 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:45.982744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/cni-plugins/0.log"
Jul 27 21:45:46.003300 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.003275    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/bond-cni-plugin/0.log"
Jul 27 21:45:46.026999 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.026972    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/routeoverride-cni/0.log"
Jul 27 21:45:46.046984 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.046960    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/whereabouts-cni-bincopy/0.log"
Jul 27 21:45:46.067761 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.067736    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r2x2s_73b12703-91cd-4468-95fc-bed4fb1859ec/whereabouts-cni/0.log"
Jul 27 21:45:46.108042 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.108020    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hvn6j_f6aa9272-7292-4f9f-96da-d31d327d5ba8/kube-multus/0.log"
Jul 27 21:45:46.294782 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.294752    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xvhwj_d0fcda60-bf81-4305-83d7-080f46f96326/network-metrics-daemon/0.log"
Jul 27 21:45:46.315851 ip-10-0-131-91 kubenswrapper[2567]: I0727 21:45:46.315825    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xvhwj_d0fcda60-bf81-4305-83d7-080f46f96326/kube-rbac-proxy/0.log"