Jul 07 19:01:14.713902 ip-10-0-133-243 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 19:01:15.203732 ip-10-0-133-243 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 19:01:15.203732 ip-10-0-133-243 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 19:01:15.203732 ip-10-0-133-243 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 19:01:15.203732 ip-10-0-133-243 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 19:01:15.203732 ip-10-0-133-243 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 19:01:15.207106 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.206980    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 19:01:15.211780 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211764    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:01:15.211780 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211780    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211784    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211787    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211790    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211793    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211796    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211798    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211801    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211804    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211807    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211811    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211814    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211816    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211819    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211822    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211825    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211827    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211831    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211834    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211837    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:01:15.211858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211839    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211842    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211845    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211848    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211850    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211853    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211856    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211859    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211862    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211865    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211869    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211871    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211874    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211877    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211880    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211883    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211885    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211888    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211891    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211894    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:01:15.212359 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211897    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211900    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211903    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211905    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211910    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211915    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211918    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211920    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211923    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211926    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211929    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211931    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211934    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211937    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211942    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211946    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211949    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211952    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211954    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:01:15.212894 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211957    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211960    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211963    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211966    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211969    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211972    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211975    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211978    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211980    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211983    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211986    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211989    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211992    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.211995    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212000    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212003    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212006    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212009    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212012    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212015    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:01:15.213373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212017    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212020    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212023    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212026    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212028    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212031    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212034    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212037    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212040    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212043    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212046    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212048    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212051    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212054    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212058    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212062    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212066    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212069    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:01:15.213883 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212073    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212957    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212966    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212972    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212976    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212980    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212985    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212988    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212991    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212994    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.212997    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213000    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213003    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213005    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213008    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213011    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213014    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213017    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213020    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:01:15.214340 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213023    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213026    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213029    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213032    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213035    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213038    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213041    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213044    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213046    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213049    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213052    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213055    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213057    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213060    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213063    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213066    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213069    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213072    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213075    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:01:15.214861 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213077    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213081    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213083    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213087    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213090    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213092    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213095    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213098    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213101    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213103    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213106    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213108    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213111    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213114    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213117    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213121    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213125    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213128    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213132    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213135    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:01:15.215373 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213138    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213141    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213143    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213146    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213149    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213151    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213154    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213157    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213162    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213165    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213168    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213171    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213174    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213177    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213180    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213184    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213187    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213190    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213192    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:01:15.215911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213195    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213198    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213201    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213204    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213207    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213209    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213212    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213215    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213219    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213222    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213224    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213227    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213230    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213232    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213235    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213238    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213240    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213243    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213245    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213248    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:01:15.216411 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213251    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213254    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213256    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213770    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213777    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213780    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213783    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213793    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213796    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213799    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213802    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213804    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213808    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213811    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213816    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213819    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213823    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213826    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213829    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:01:15.216977 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213832    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213834    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213837    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213840    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213843    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213846    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213849    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213852    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213855    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213857    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213860    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213863    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213865    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213868    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213871    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213873    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213876    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213882    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213885    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213888    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:01:15.217469 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213891    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213900    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213903    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213906    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213909    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213912    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213914    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213917    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213919    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213922    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213925    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213928    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213930    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213933    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213936    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213939    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213942    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213944    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213948    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213951    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:01:15.218015 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213954    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213957    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213959    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213962    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213965    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213967    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213971    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213976    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213979    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213984    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213987    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213991    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213993    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.213996    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214005    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214008    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214011    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214014    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214018    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:01:15.218567 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214021    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214024    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214027    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214030    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214033    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214035    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214038    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214041    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214044    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214046    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214049    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214052    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214054    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214057    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214060    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214062    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214065    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214068    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214071    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214073    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:01:15.219099 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214076    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214079    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214084    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214087    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214168    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214176    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214191    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214196    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214209    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214213    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214217    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214222    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214225    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214228    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214232    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214236    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214239    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214242    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214246    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214249    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214252    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214255    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214262    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214265    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 19:01:15.219644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214268    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214272    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214275    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214279    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214289    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214293    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214296    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214299    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214302    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214306    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214312    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214315    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214319    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214322    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214325    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214328    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214332    2569 flags.go:64] FLAG: --enable-server="true"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214341    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214350    2569 flags.go:64] FLAG: --event-burst="100"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214353    2569 flags.go:64] FLAG: --event-qps="50"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214356    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214360    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214363    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214367    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 19:01:15.220253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214370    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214374    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214377    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214380    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214383    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214386    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214389    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214392    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214395    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214398    2569 flags.go:64] FLAG: --feature-gates=""
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214402    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214405    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214408    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214412    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214415    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214418    2569 flags.go:64] FLAG: --help="false"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214421    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214425    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214430    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214433    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214437    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214441    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214443    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 19:01:15.220887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214446    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214449    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214452    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214462    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214465    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214468    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214471    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214474    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214477    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214480    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214483    2569 flags.go:64] FLAG: --lock-file=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214486    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214489    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214492    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214498    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214501    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214504    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214507    2569 flags.go:64] FLAG: --logging-format="text"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214510    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214514    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214517    2569 flags.go:64] FLAG: --manifest-url=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214520    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214524    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214527    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214532    2569 flags.go:64] FLAG: --max-pods="110"
Jul 07 19:01:15.221946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214535    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214538    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214543    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214546    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214549    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214553    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214556    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214563    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214567    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214570    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214573    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214597    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214604    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214608    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214611    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214614    2569 flags.go:64] FLAG: --port="10250"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214618    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214621    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e91d061eb32758ed"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214624    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214628    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214631    2569 flags.go:64] FLAG: --register-node="true"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214634    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214638    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214641    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 07 19:01:15.223149 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214644    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214647    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214651    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214654    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214657    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214660    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214663    2569 flags.go:64] FLAG: --runonce="false"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214666    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214670    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214673    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214678    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214681    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214684    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214688    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214691    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214694    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214697    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214700    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214703    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214706    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214716    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214719    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214724    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214727    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214730    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 19:01:15.224286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214737    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214740    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214743    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214746    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214749    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214752    2569 flags.go:64] FLAG: --v="2"
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214756    2569 flags.go:64] FLAG: --version="false"
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214760    2569 flags.go:64] FLAG: --vmodule=""
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214765    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.214768    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214941    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214945    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214948    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214951    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214954    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214957    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214959    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214964    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214967    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214969    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214972    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214976    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:01:15.225357 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214978    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214981    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214984    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214986    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214990    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.214992    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215001    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215004    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215007    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215009    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215012    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215015    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215018    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215021    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215024    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215026    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215031    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215034    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215036    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:01:15.226091 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215039    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215042    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215045    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215048    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215050    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215053    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215056    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215058    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215062    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215065    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215068    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215071    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215073    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215076    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215079    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215081    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215084    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215087    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215089    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215092    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:01:15.226825 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215101    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215104    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215106    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215109    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215112    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215114    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215117    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215120    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215123    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215127    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215130    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215133    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215135    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215138    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215141    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215144    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215146    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215150    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215154    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:01:15.227462 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215157    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215163    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215167    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215170    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215173    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215177    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215180    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215183    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215187    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215190    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215193    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215197    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215200    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215203    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215208    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215211    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215214    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215217    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215220    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:01:15.228033 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215223    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215226    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215228    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215232    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215235    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215238    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215241    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215243    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215246    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.215249    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.215256    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.223463    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.223489    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.223518    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.223533    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 19:01:15.228535 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223646    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223655    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223664    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223671    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223677    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223683    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223688    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223693    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223698    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223703    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223707    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223712    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223717    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223722    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223726    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223731    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223736    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223740    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223745    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:01:15.229068 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223750    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223754    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223759    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223764    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223768    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223773    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223778    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223783    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223787    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223792    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223798    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223803    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223807    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223813    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223817    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223822    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223826    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223831    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223835    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223840    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:01:15.229916 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223844    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223848    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223853    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223858    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223862    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223867    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223871    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223876    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223880    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223885    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223890    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223894    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223899    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223903    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223908    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223913    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223917    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223922    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223927    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223932    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:01:15.230815 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223937    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223942    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223947    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223952    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223956    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223961    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223965    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223970    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223977    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223983    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223988    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223993    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.223998    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224003    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224007    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224011    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224016    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224020    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224025    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224029    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:01:15.231555 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224034    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224038    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224043    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224047    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224051    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224056    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224061    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224065    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224070    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224075    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224080    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224085    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224091    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224098    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224104    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224108    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224114    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224119    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224123    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:01:15.232298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224128    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.224137    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224360    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224370    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224375    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224381    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224386    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224391    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224397    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224401    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224406    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224410    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224416    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224420    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224425    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:01:15.232893 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224430    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224435    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224440    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224444    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224449    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224454    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224458    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224463    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224468    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224473    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224478    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224482    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224487    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224491    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224496    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224502    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224506    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224511    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224515    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224520    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:01:15.233285 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224525    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224529    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224534    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224538    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224543    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224550    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224557    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224562    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224568    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224573    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224578    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224601    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224606    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224610    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224616    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224620    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224624    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224629    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224633    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:01:15.233843 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224638    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224643    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224648    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224652    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224659    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224665    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224670    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224675    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224680    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224686    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224690    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224695    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224700    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224704    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224709    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224713    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224718    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224723    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224727    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224732    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:01:15.234329 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224736    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224741    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224745    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224750    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224755    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224760    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224764    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224769    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224773    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224778    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224784    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224790    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224797    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224802    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224807    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224811    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224816    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224821    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224825    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224830    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:01:15.234878 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224834    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224839    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224845    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224850    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224854    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224859    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:15.224863    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.224872    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.225060    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.231859    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.233783    2569 server.go:1019] "Starting client certificate rotation"
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.233892    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 19:01:15.235408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.233928    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 19:01:15.236632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.236617    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 19:01:15.237850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.237832    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 19:01:15.253921 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.253899    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 07 19:01:15.255961 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.255945    2569 log.go:25] "Validated CRI v1 image API"
Jul 07 19:01:15.256715 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.256697    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 19:01:15.260211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.260190    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bc9c407b-ad76-4a01-a8a9-ed069a98125f:/dev/nvme0n1p4 c64fe18a-0c60-45d4-b615-e16eb84eaa01:/dev/nvme0n1p3]
Jul 07 19:01:15.260280 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.260209    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 19:01:15.264093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.264074    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 19:01:15.265653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.265498    2569 manager.go:216] Machine: {Timestamp:2026-07-07 19:01:15.264995549 +0000 UTC m=+0.405369723 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109166 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2806c59fbfb9054ef7fcf9db159d05 SystemUUID:ec2806c5-9fbf-b905-4ef7-fcf9db159d05 BootID:aebdce75-61c4-4a6a-bd0d-e87204ed589d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:04:9e:75:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:04:9e:75:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:cc:9a:c4:c8:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 19:01:15.265653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.265645    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 19:01:15.265787 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.265726    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 19:01:15.268941 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.268912    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 19:01:15.269103 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.268943    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 19:01:15.269664 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.269653    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 19:01:15.269698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.269666    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 19:01:15.269698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.269675    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 19:01:15.270549 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.270536    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 19:01:15.271830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.271819    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 19:01:15.276550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276535    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 19:01:15.276714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276703    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 19:01:15.276766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276743    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 19:01:15.276766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276760    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 19:01:15.276825 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276778    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 19:01:15.276825 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276805    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 07 19:01:15.276825 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.276816    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 19:01:15.277430 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.277408    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 19:01:15.277503 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.277447    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 19:01:15.279906 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.279889    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 19:01:15.283822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.283801    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 19:01:15.283898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.283837    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 19:01:15.285046 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285033    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 19:01:15.285093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285052    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 19:01:15.285093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285058    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 19:01:15.285093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285064    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 19:01:15.285093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285078    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 19:01:15.285093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285087    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285098    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285104    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285112    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285118    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285127    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285133    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285157    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 19:01:15.285262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.285163    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 19:01:15.288805 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.288789    2569 server.go:1268] "Started kubelet"
Jul 07 19:01:15.288978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.288901    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 19:01:15.289061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.288929    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 19:01:15.289409 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.289071    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 19:01:15.289807 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.289770    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 19:01:15.289915 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.289804    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 19:01:15.289915 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.289837    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 19:01:15.289806 ip-10-0-133-243 systemd[1]: Started Kubernetes Kubelet.
Jul 07 19:01:15.291084 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.291065    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 19:01:15.291914 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.291892    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 19:01:15.293320 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.293284    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 19:01:15.296687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.296672    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 19:01:15.296738 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.296721    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 19:01:15.296772 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.295621    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-243.ec2.internal.18c0171f37f21e46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-243.ec2.internal,UID:ip-10-0-133-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-243.ec2.internal,},FirstTimestamp:2026-07-07 19:01:15.288755782 +0000 UTC m=+0.429129955,LastTimestamp:2026-07-07 19:01:15.288755782 +0000 UTC m=+0.429129955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-243.ec2.internal,}"
Jul 07 19:01:15.296930 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.296910    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.297368 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.297324    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 19:01:15.297368 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.297330    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 19:01:15.297368 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.297347    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 19:01:15.297653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.297635    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 19:01:15.297653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.297648    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 19:01:15.298080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298063    2569 factory.go:153] Registering CRI-O factory
Jul 07 19:01:15.298151 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298101    2569 factory.go:223] Registration of the crio container factory successfully
Jul 07 19:01:15.298191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298160    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 19:01:15.298191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298171    2569 factory.go:55] Registering systemd factory
Jul 07 19:01:15.298191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298180    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 07 19:01:15.298281 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298203    2569 factory.go:103] Registering Raw factory
Jul 07 19:01:15.298281 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.298219    2569 manager.go:1196] Started watching for new ooms in manager
Jul 07 19:01:15.299271 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.299253    2569 manager.go:349] Starting recovery of all containers
Jul 07 19:01:15.305950 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.305920    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 19:01:15.306036 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.305972    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 19:01:15.312073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.311981    2569 manager.go:354] Recovery completed
Jul 07 19:01:15.318115 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.318091    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.320373 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320338    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.320465 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320385    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.320465 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320396    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.320944 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320928    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 19:01:15.321007 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320944    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 19:01:15.321007 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320965    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 19:01:15.321007 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.320979    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.321253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.321238    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wxjvg"
Jul 07 19:01:15.321705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.321690    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.321753 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.321720    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.321753 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.321731    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.323040 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.322938    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-243.ec2.internal.18c0171f39d47fcd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-243.ec2.internal,UID:ip-10-0-133-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-243.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-243.ec2.internal,},FirstTimestamp:2026-07-07 19:01:15.320369101 +0000 UTC m=+0.460743278,LastTimestamp:2026-07-07 19:01:15.320369101 +0000 UTC m=+0.460743278,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-243.ec2.internal,}"
Jul 07 19:01:15.323441 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.323428    2569 policy_none.go:49] "None policy: Start"
Jul 07 19:01:15.323500 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.323448    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 19:01:15.323500 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.323463    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 19:01:15.325669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.325656    2569 policy_none.go:47] "Start"
Jul 07 19:01:15.327811 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.327793    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wxjvg"
Jul 07 19:01:15.331872 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.331793    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-243.ec2.internal.18c0171f39d4d406  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-243.ec2.internal,UID:ip-10-0-133-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-243.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-243.ec2.internal,},FirstTimestamp:2026-07-07 19:01:15.320390662 +0000 UTC m=+0.460764836,LastTimestamp:2026-07-07 19:01:15.320390662 +0000 UTC m=+0.460764836,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-243.ec2.internal,}"
Jul 07 19:01:15.358386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358202    2569 manager.go:337] "Starting Device Plugin manager"
Jul 07 19:01:15.358491 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.358372    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 19:01:15.358491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358398    2569 server.go:87] "Starting device plugin registration server"
Jul 07 19:01:15.358639 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358628    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 19:01:15.358676 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358641    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 19:01:15.358898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358743    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 19:01:15.358898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358834    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 19:01:15.358898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.358844    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 19:01:15.359411 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.359391    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 19:01:15.359497 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.359444    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.459850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.459799    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.461900 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.460860    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.461900 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.460894    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.461900 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.460911    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.461900 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.460947    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.469885 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.469870    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.469939 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.469893    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-243.ec2.internal\": node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.483288 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.483250    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 19:01:15.484619 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.484580    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 19:01:15.484687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.484650    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 19:01:15.484687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.484677    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 19:01:15.484795 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.484721    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 19:01:15.486971 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.486949    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:01:15.490796 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.490778    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.589887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.589841    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"]
Jul 07 19:01:15.590029 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.589955    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.590901 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.590872    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.591051 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.591037    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.591110 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.591069    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.591110 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.591082    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.593379 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.593367    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.593491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.593475    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.593556 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.593510    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.594144 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.594126    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.594219 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.594155    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.594219 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.594170    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.594219 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.594213    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.594332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.594235    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.594332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.594250    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.596347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.596333    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.596415 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.596365    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:15.597162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.597144    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:15.597162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.597176    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:15.597320 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.597187    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:15.599246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.599226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2920e7188ac4fd41ed939f0071dd168c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal\" (UID: \"2920e7188ac4fd41ed939f0071dd168c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.599390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.599251    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2920e7188ac4fd41ed939f0071dd168c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal\" (UID: \"2920e7188ac4fd41ed939f0071dd168c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.599390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.599270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea6aa2ed699049cefc1e795a074e4c66-config\") pod \"kube-apiserver-proxy-ip-10-0-133-243.ec2.internal\" (UID: \"ea6aa2ed699049cefc1e795a074e4c66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.623435 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.623384    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-243.ec2.internal\" not found" node="ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.628160 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.628140    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-243.ec2.internal\" not found" node="ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.691286 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.691260    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.700167 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.700148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2920e7188ac4fd41ed939f0071dd168c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal\" (UID: \"2920e7188ac4fd41ed939f0071dd168c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.700250 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.700175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2920e7188ac4fd41ed939f0071dd168c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal\" (UID: \"2920e7188ac4fd41ed939f0071dd168c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.700250 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.700196    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea6aa2ed699049cefc1e795a074e4c66-config\") pod \"kube-apiserver-proxy-ip-10-0-133-243.ec2.internal\" (UID: \"ea6aa2ed699049cefc1e795a074e4c66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.700250 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.700224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea6aa2ed699049cefc1e795a074e4c66-config\") pod \"kube-apiserver-proxy-ip-10-0-133-243.ec2.internal\" (UID: \"ea6aa2ed699049cefc1e795a074e4c66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.700382 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.700257    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2920e7188ac4fd41ed939f0071dd168c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal\" (UID: \"2920e7188ac4fd41ed939f0071dd168c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.700382 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.700258    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2920e7188ac4fd41ed939f0071dd168c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal\" (UID: \"2920e7188ac4fd41ed939f0071dd168c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.791952 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.791915    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.899673 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.899585    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:15.928048 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.928022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.931298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:15.931272    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:15.999856 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:15.999806    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.104021 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:16.103986    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.204142 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:16.204054    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.233643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.233612    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 19:01:16.233841 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.233815    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 19:01:16.304736 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:16.304705    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.331725 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.331684    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:56:15 +0000 UTC" deadline="2027-12-29 10:53:52.852824033 +0000 UTC"
Jul 07 19:01:16.331725 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.331716    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12951h52m36.521112414s"
Jul 07 19:01:16.378117 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.378074    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:01:16.381352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.381329    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:01:16.381458 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.381365    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:01:16.381458 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.381376    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:01:16.405826 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:16.405803    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.506986 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:16.506921    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.511329 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.511306    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:01:16.539396 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:16.539352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2920e7188ac4fd41ed939f0071dd168c.slice/crio-38226ce41201699bd60a33f5335d754c1acc18dc40119d078e0baefa86e97c3f WatchSource:0}: Error finding container 38226ce41201699bd60a33f5335d754c1acc18dc40119d078e0baefa86e97c3f: Status 404 returned error can't find the container with id 38226ce41201699bd60a33f5335d754c1acc18dc40119d078e0baefa86e97c3f
Jul 07 19:01:16.539771 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:16.539749    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6aa2ed699049cefc1e795a074e4c66.slice/crio-a8eee6626f2eaa793ee8422689d54b0b927265fcb64f1978a7d32f6007aba775 WatchSource:0}: Error finding container a8eee6626f2eaa793ee8422689d54b0b927265fcb64f1978a7d32f6007aba775: Status 404 returned error can't find the container with id a8eee6626f2eaa793ee8422689d54b0b927265fcb64f1978a7d32f6007aba775
Jul 07 19:01:16.544831 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.544341    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:01:16.608109 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:16.608066    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-243.ec2.internal\" not found"
Jul 07 19:01:16.640030 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.640005    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:01:16.700839 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.700802    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:16.714052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.714026    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 19:01:16.715220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.715206    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal"
Jul 07 19:01:16.720801 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.720787    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:01:16.723103 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:16.723086    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 19:01:17.237567 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.237471    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:01:17.278568 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.278528    2569 apiserver.go:52] "Watching apiserver"
Jul 07 19:01:17.288462 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.288432    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 19:01:17.288968 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.288933    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wm5f9","kube-system/konnectivity-agent-zwv5z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal","openshift-multus/multus-kj7tr","openshift-network-operator/iptables-alerter-fsp5j","openshift-ovn-kubernetes/ovnkube-node-6lqh2","kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr","openshift-cluster-node-tuning-operator/tuned-xj6wh","openshift-dns/node-resolver-jtqj7","openshift-image-registry/node-ca-7dbh4","openshift-multus/multus-additional-cni-plugins-dctsw","openshift-multus/network-metrics-daemon-fnlx2","openshift-network-diagnostics/network-check-target-vclgj"]
Jul 07 19:01:17.291395 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.291374    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.294563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.294222    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.294563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.294282    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d9skn\""
Jul 07 19:01:17.294563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.294291    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.294563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.294464    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.294563 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.294534    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:17.296776 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.296706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:17.296882 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.296775    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:17.297804 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.297432    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 19:01:17.299243 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.299220    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.301789 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.301647    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 19:01:17.302036 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.301892    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.302573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.302087    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.302573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.302136    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clw46\""
Jul 07 19:01:17.302573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.302330    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.302573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.302372    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 19:01:17.304354 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.304334    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.304450 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.304408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.304802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.304781    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 19:01:17.305190 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.305170    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jkfsv\""
Jul 07 19:01:17.305280 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.305214    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.306686 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.306667    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 19:01:17.307205 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.307181    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9kr9d\""
Jul 07 19:01:17.307413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.307391    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 19:01:17.307557 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.307459    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.307557 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.307502    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 19:01:17.307836 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.307728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.308452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.308121    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 19:01:17.308452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.308190    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.308452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.308405    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 19:01:17.310237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.310020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.311446 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.311382    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.311679 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.311655    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6tc45\""
Jul 07 19:01:17.312140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.311786    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.312140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-cni-multus\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.312140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-etc-kubernetes\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312103    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblhh\" (UniqueName: \"kubernetes.io/projected/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-kube-api-access-bblhh\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312658    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-netns\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-conf-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-multus-certs\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.312995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-tmp-dir\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.313047    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.313085    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fckn4\" (UniqueName: \"kubernetes.io/projected/20a29a0a-c624-45b8-a4d4-c047a976eff4-kube-api-access-fckn4\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.313127    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-system-cni-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.313212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.313162    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.313790 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.313429    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 19:01:17.314537 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.314513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfwbb\""
Jul 07 19:01:17.314953 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.314935    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.315531 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.315509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-cni-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.315644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.315613    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.315644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.315564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-os-release\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.316009 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.315983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-k8s-cni-cncf-io\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.316104 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316076    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-cnibin\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.316173 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6aa0edf-ebca-4806-93ad-3ded61f49395-cni-binary-copy\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.316173 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-socket-dir-parent\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.316276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316182    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-kubelet\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.316276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-hostroot\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.317794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-daemon-config\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.317794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssjc\" (UniqueName: \"kubernetes.io/projected/b6aa0edf-ebca-4806-93ad-3ded61f49395-kube-api-access-mssjc\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.317794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-hosts-file\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.317794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.316413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-cni-bin\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.317794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.317622    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.317794 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.317723    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:17.318340 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.318293    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 19:01:17.318579 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.318437    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 19:01:17.319050 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.319030    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gsnct\""
Jul 07 19:01:17.322076 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.321705    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.324318 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.324107    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 19:01:17.324318 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.324161    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 19:01:17.324487 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.324350    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.324662 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.324641    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-52v5m\""
Jul 07 19:01:17.324849 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.324828    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 19:01:17.326610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.326585    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 19:01:17.326855 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.326835    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 19:01:17.326855 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.326850    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w5khf\""
Jul 07 19:01:17.339636 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.339618    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-99kt6"
Jul 07 19:01:17.348130 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.348104    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-99kt6"
Jul 07 19:01:17.399153 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.399119    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 19:01:17.417302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417267    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-netns\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.417506 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-multus-certs\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.417506 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417397    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-multus-certs\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.417506 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417407    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-netns\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.417506 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f557f0ef-50b9-4fd4-9ad3-ff4b62128088-konnectivity-ca\") pod \"konnectivity-agent-zwv5z\" (UID: \"f557f0ef-50b9-4fd4-9ad3-ff4b62128088\") " pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.417506 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-system-cni-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.417506 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417497    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-systemd\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.417817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-node-log\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.417817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-env-overrides\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.417817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4sm\" (UniqueName: \"kubernetes.io/projected/bba98273-b094-40da-b060-9eed2b1ad8df-kube-api-access-8x4sm\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.417817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417595    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-system-cni-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.417817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.417817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblhh\" (UniqueName: \"kubernetes.io/projected/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-kube-api-access-bblhh\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417820    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-ovnkube-script-lib\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-kubernetes\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-run\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-lib-modules\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.417957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-var-lib-kubelet\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-cni-bin\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.418073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418040    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-cni-bin\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bba98273-b094-40da-b060-9eed2b1ad8df-ovn-node-metrics-cert\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb7rv\" (UniqueName: \"kubernetes.io/projected/3e19bc52-090c-42b5-bf39-7842ebf31323-kube-api-access-lb7rv\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-conf-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418222    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-device-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysctl-conf\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-system-cni-dir\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-os-release\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418307    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-conf-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418331    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fckn4\" (UniqueName: \"kubernetes.io/projected/20a29a0a-c624-45b8-a4d4-c047a976eff4-kube-api-access-fckn4\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssjc\" (UniqueName: \"kubernetes.io/projected/b6aa0edf-ebca-4806-93ad-3ded61f49395-kube-api-access-mssjc\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.418419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418409    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-socket-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-cni-bin\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-tuned\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfq9l\" (UniqueName: \"kubernetes.io/projected/34a45bc1-7f60-4007-aa44-f80840ff206f-kube-api-access-nfq9l\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-ovnkube-config\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418594    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7bca08d-c51d-40c4-ba26-3ade146718b3-iptables-alerter-script\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-cnibin\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-socket-dir-parent\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-daemon-config\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-hosts-file\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwdr\" (UniqueName: \"kubernetes.io/projected/d7bca08d-c51d-40c4-ba26-3ade146718b3-kube-api-access-mgwdr\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-systemd-units\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-cni-multus\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7bca08d-c51d-40c4-ba26-3ade146718b3-host-slash\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.418679    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:17.419176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-var-lib-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-sys\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.418930    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a03e1d90-67f3-4f8a-a185-0f542e623f54-kubelet-config\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.418965    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:17.918925162 +0000 UTC m=+3.059299342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419011    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-hosts-file\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419052    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-cnibin\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419112    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-cni-multus\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419204    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-socket-dir-parent\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419213    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-slash\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-etc-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-run-ovn-kubernetes\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysctl-d\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-systemd\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8zwj\" (UniqueName: \"kubernetes.io/projected/5b692e26-8a80-4791-8e20-6e567d0b4fc7-kube-api-access-j8zwj\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-cnibin\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.420075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419497    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-kubelet\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-hostroot\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f557f0ef-50b9-4fd4-9ad3-ff4b62128088-agent-certs\") pod \"konnectivity-agent-zwv5z\" (UID: \"f557f0ef-50b9-4fd4-9ad3-ff4b62128088\") " pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419566    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-var-lib-kubelet\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-kubelet\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419625    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-hostroot\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419640    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6aa0edf-ebca-4806-93ad-3ded61f49395-cni-binary-copy\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-registration-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-run-netns\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419754    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-ovn\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419778    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-log-socket\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419842    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-sys-fs\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gz49\" (UniqueName: \"kubernetes.io/projected/2e074ca6-0b82-4000-8aef-f33a8686ff0b-kube-api-access-9gz49\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419872    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-daemon-config\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-cni-netd\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419932    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-modprobe-d\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.420917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc52-090c-42b5-bf39-7842ebf31323-tmp\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.419994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420035    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-tmp-dir\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b692e26-8a80-4791-8e20-6e567d0b4fc7-serviceca\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-cni-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6aa0edf-ebca-4806-93ad-3ded61f49395-cni-binary-copy\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-os-release\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420307    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-os-release\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-k8s-cni-cncf-io\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420328    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-tmp-dir\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420344    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-host-run-k8s-cni-cncf-io\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b692e26-8a80-4791-8e20-6e567d0b4fc7-host\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420367    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-multus-cni-dir\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a03e1d90-67f3-4f8a-a185-0f542e623f54-dbus\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.421796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420445    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-etc-kubernetes\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.422671 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420492    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysconfig\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.422671 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-host\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.422671 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.420562    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6aa0edf-ebca-4806-93ad-3ded61f49395-etc-kubernetes\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.424133 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.424104    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 19:01:17.425706 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.425567    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:17.425706 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.425593    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:17.425706 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.425608    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:17.425706 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.425678    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:17.925658588 +0000 UTC m=+3.066032749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:17.430408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.429020    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblhh\" (UniqueName: \"kubernetes.io/projected/1ac9b790-71ac-4f5a-bcff-d1679c48f5ba-kube-api-access-bblhh\") pod \"node-resolver-jtqj7\" (UID: \"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba\") " pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.430408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.429915    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssjc\" (UniqueName: \"kubernetes.io/projected/b6aa0edf-ebca-4806-93ad-3ded61f49395-kube-api-access-mssjc\") pod \"multus-kj7tr\" (UID: \"b6aa0edf-ebca-4806-93ad-3ded61f49395\") " pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.430408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.430357    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fckn4\" (UniqueName: \"kubernetes.io/projected/20a29a0a-c624-45b8-a4d4-c047a976eff4-kube-api-access-fckn4\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.489551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.489431    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal" event={"ID":"2920e7188ac4fd41ed939f0071dd168c","Type":"ContainerStarted","Data":"38226ce41201699bd60a33f5335d754c1acc18dc40119d078e0baefa86e97c3f"}
Jul 07 19:01:17.490493 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.490471    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal" event={"ID":"ea6aa2ed699049cefc1e795a074e4c66","Type":"ContainerStarted","Data":"a8eee6626f2eaa793ee8422689d54b0b927265fcb64f1978a7d32f6007aba775"}
Jul 07 19:01:17.521269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwdr\" (UniqueName: \"kubernetes.io/projected/d7bca08d-c51d-40c4-ba26-3ade146718b3-kube-api-access-mgwdr\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-systemd-units\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7bca08d-c51d-40c4-ba26-3ade146718b3-host-slash\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-var-lib-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521387    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-sys\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521409    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7bca08d-c51d-40c4-ba26-3ade146718b3-host-slash\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521413    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-systemd-units\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a03e1d90-67f3-4f8a-a185-0f542e623f54-kubelet-config\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521467    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a03e1d90-67f3-4f8a-a185-0f542e623f54-kubelet-config\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521497    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-slash\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521515    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-var-lib-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521524    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-etc-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521559    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-sys\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-run-ovn-kubernetes\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521606    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-etc-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521610    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-slash\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysctl-d\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521635    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-run-ovn-kubernetes\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-systemd\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8zwj\" (UniqueName: \"kubernetes.io/projected/5b692e26-8a80-4791-8e20-6e567d0b4fc7-kube-api-access-j8zwj\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521708    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-cnibin\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521729    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysctl-d\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521734    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-systemd\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.521909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521753    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-cnibin\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f557f0ef-50b9-4fd4-9ad3-ff4b62128088-agent-certs\") pod \"konnectivity-agent-zwv5z\" (UID: \"f557f0ef-50b9-4fd4-9ad3-ff4b62128088\") " pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521890    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-kubelet\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521933    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-registration-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-run-netns\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.521992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-ovn\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-log-socket\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-sys-fs\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522063    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-kubelet\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gz49\" (UniqueName: \"kubernetes.io/projected/2e074ca6-0b82-4000-8aef-f33a8686ff0b-kube-api-access-9gz49\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-cni-netd\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-modprobe-d\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522114    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-log-socket\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc52-090c-42b5-bf39-7842ebf31323-tmp\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522149    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522152    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-run-netns\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.522704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522190    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-openvswitch\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b692e26-8a80-4791-8e20-6e567d0b4fc7-serviceca\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-ovn\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b692e26-8a80-4791-8e20-6e567d0b4fc7-host\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522281    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522291    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522294    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-modprobe-d\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522345    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-cni-netd\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522345    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-sys-fs\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b692e26-8a80-4791-8e20-6e567d0b4fc7-host\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522032    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-registration-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522772    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a03e1d90-67f3-4f8a-a185-0f542e623f54-dbus\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522805    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysconfig\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522828    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-host\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.523569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f557f0ef-50b9-4fd4-9ad3-ff4b62128088-konnectivity-ca\") pod \"konnectivity-agent-zwv5z\" (UID: \"f557f0ef-50b9-4fd4-9ad3-ff4b62128088\") " pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-systemd\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522904    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-node-log\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522905    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b692e26-8a80-4791-8e20-6e567d0b4fc7-serviceca\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-env-overrides\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4sm\" (UniqueName: \"kubernetes.io/projected/bba98273-b094-40da-b060-9eed2b1ad8df-kube-api-access-8x4sm\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.522979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-ovnkube-script-lib\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523028    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-kubernetes\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-run\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523072    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-lib-modules\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523086    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysconfig\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523108    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-var-lib-kubelet\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523129    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-node-log\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523135    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bba98273-b094-40da-b060-9eed2b1ad8df-ovn-node-metrics-cert\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.524499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523139    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-run-systemd\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb7rv\" (UniqueName: \"kubernetes.io/projected/3e19bc52-090c-42b5-bf39-7842ebf31323-kube-api-access-lb7rv\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-host\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523197    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.523276    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.523342    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:18.023325407 +0000 UTC m=+3.163699589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523039    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a03e1d90-67f3-4f8a-a185-0f542e623f54-dbus\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523523    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f557f0ef-50b9-4fd4-9ad3-ff4b62128088-konnectivity-ca\") pod \"konnectivity-agent-zwv5z\" (UID: \"f557f0ef-50b9-4fd4-9ad3-ff4b62128088\") " pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523607    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-kubernetes\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523667    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-run\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523666    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-lib-modules\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-env-overrides\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523717    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-var-lib-kubelet\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-device-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysctl-conf\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-system-cni-dir\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-os-release\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.525273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-socket-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-cni-bin\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-tuned\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523921    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-sysctl-conf\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523935    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-os-release\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523980    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-system-cni-dir\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.523970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfq9l\" (UniqueName: \"kubernetes.io/projected/34a45bc1-7f60-4007-aa44-f80840ff206f-kube-api-access-nfq9l\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-ovnkube-config\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524032    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34a45bc1-7f60-4007-aa44-f80840ff206f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7bca08d-c51d-40c4-ba26-3ade146718b3-iptables-alerter-script\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524068    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34a45bc1-7f60-4007-aa44-f80840ff206f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524095    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bba98273-b094-40da-b060-9eed2b1ad8df-host-cni-bin\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524201    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-ovnkube-script-lib\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524046    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-device-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524202    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e074ca6-0b82-4000-8aef-f33a8686ff0b-socket-dir\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524641    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bba98273-b094-40da-b060-9eed2b1ad8df-ovnkube-config\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.526105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.524728    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7bca08d-c51d-40c4-ba26-3ade146718b3-iptables-alerter-script\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.528018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.527957    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f557f0ef-50b9-4fd4-9ad3-ff4b62128088-agent-certs\") pod \"konnectivity-agent-zwv5z\" (UID: \"f557f0ef-50b9-4fd4-9ad3-ff4b62128088\") " pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.528194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.528027    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bba98273-b094-40da-b060-9eed2b1ad8df-ovn-node-metrics-cert\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.528194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.528175    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc52-090c-42b5-bf39-7842ebf31323-etc-tuned\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.528374 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.528313    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc52-090c-42b5-bf39-7842ebf31323-tmp\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.530705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.530682    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8zwj\" (UniqueName: \"kubernetes.io/projected/5b692e26-8a80-4791-8e20-6e567d0b4fc7-kube-api-access-j8zwj\") pod \"node-ca-7dbh4\" (UID: \"5b692e26-8a80-4791-8e20-6e567d0b4fc7\") " pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.531220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.531198    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwdr\" (UniqueName: \"kubernetes.io/projected/d7bca08d-c51d-40c4-ba26-3ade146718b3-kube-api-access-mgwdr\") pod \"iptables-alerter-fsp5j\" (UID: \"d7bca08d-c51d-40c4-ba26-3ade146718b3\") " pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.531341 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.531320    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gz49\" (UniqueName: \"kubernetes.io/projected/2e074ca6-0b82-4000-8aef-f33a8686ff0b-kube-api-access-9gz49\") pod \"aws-ebs-csi-driver-node-v9kpr\" (UID: \"2e074ca6-0b82-4000-8aef-f33a8686ff0b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.535467 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.535443    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfq9l\" (UniqueName: \"kubernetes.io/projected/34a45bc1-7f60-4007-aa44-f80840ff206f-kube-api-access-nfq9l\") pod \"multus-additional-cni-plugins-dctsw\" (UID: \"34a45bc1-7f60-4007-aa44-f80840ff206f\") " pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.540188 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.540162    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb7rv\" (UniqueName: \"kubernetes.io/projected/3e19bc52-090c-42b5-bf39-7842ebf31323-kube-api-access-lb7rv\") pod \"tuned-xj6wh\" (UID: \"3e19bc52-090c-42b5-bf39-7842ebf31323\") " pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.540298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.540285    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4sm\" (UniqueName: \"kubernetes.io/projected/bba98273-b094-40da-b060-9eed2b1ad8df-kube-api-access-8x4sm\") pod \"ovnkube-node-6lqh2\" (UID: \"bba98273-b094-40da-b060-9eed2b1ad8df\") " pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.606578 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.606539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jtqj7"
Jul 07 19:01:17.616496 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.616473    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kj7tr"
Jul 07 19:01:17.618374 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.618323    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac9b790_71ac_4f5a_bcff_d1679c48f5ba.slice/crio-09563cfba3dfe252f3a85461a9ed0f42b23ee124193d8737555a446889b12655 WatchSource:0}: Error finding container 09563cfba3dfe252f3a85461a9ed0f42b23ee124193d8737555a446889b12655: Status 404 returned error can't find the container with id 09563cfba3dfe252f3a85461a9ed0f42b23ee124193d8737555a446889b12655
Jul 07 19:01:17.626047 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.626019    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6aa0edf_ebca_4806_93ad_3ded61f49395.slice/crio-23b14532f7b4a4f862398fdb05f2fa7c9fd1c3b6936f8245acf5a873961457a3 WatchSource:0}: Error finding container 23b14532f7b4a4f862398fdb05f2fa7c9fd1c3b6936f8245acf5a873961457a3: Status 404 returned error can't find the container with id 23b14532f7b4a4f862398fdb05f2fa7c9fd1c3b6936f8245acf5a873961457a3
Jul 07 19:01:17.626718 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.626694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fsp5j"
Jul 07 19:01:17.634015 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.633995    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:17.636348 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.636325    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bca08d_c51d_40c4_ba26_3ade146718b3.slice/crio-d91437610edebc7c43ece59634d3b81f99a902c479b6d1ecde445ef6e67544cd WatchSource:0}: Error finding container d91437610edebc7c43ece59634d3b81f99a902c479b6d1ecde445ef6e67544cd: Status 404 returned error can't find the container with id d91437610edebc7c43ece59634d3b81f99a902c479b6d1ecde445ef6e67544cd
Jul 07 19:01:17.643550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.643507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xj6wh"
Jul 07 19:01:17.643872 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.643849    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba98273_b094_40da_b060_9eed2b1ad8df.slice/crio-8b792d871b192bc32886824ed9d2c7ea60507a4ded6a5036cd9745617af75955 WatchSource:0}: Error finding container 8b792d871b192bc32886824ed9d2c7ea60507a4ded6a5036cd9745617af75955: Status 404 returned error can't find the container with id 8b792d871b192bc32886824ed9d2c7ea60507a4ded6a5036cd9745617af75955
Jul 07 19:01:17.651527 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.651506    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr"
Jul 07 19:01:17.653085 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.653060    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e19bc52_090c_42b5_bf39_7842ebf31323.slice/crio-90ac5d89e2819a9e12de4e4015ab5016632f98963ef4ccb1701e18cdb3995394 WatchSource:0}: Error finding container 90ac5d89e2819a9e12de4e4015ab5016632f98963ef4ccb1701e18cdb3995394: Status 404 returned error can't find the container with id 90ac5d89e2819a9e12de4e4015ab5016632f98963ef4ccb1701e18cdb3995394
Jul 07 19:01:17.659846 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.659821    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:17.661275 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.661250    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e074ca6_0b82_4000_8aef_f33a8686ff0b.slice/crio-d2ce4b46450729425067cc4b65e42987e99d6af31e6a18307c443e72ae94ca5c WatchSource:0}: Error finding container d2ce4b46450729425067cc4b65e42987e99d6af31e6a18307c443e72ae94ca5c: Status 404 returned error can't find the container with id d2ce4b46450729425067cc4b65e42987e99d6af31e6a18307c443e72ae94ca5c
Jul 07 19:01:17.667090 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.667069    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7dbh4"
Jul 07 19:01:17.669302 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.669278    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf557f0ef_50b9_4fd4_9ad3_ff4b62128088.slice/crio-03b8aafa4ed02d1df35135f8e89b93ff1f08a62afaecec257323c02bd4f7ada1 WatchSource:0}: Error finding container 03b8aafa4ed02d1df35135f8e89b93ff1f08a62afaecec257323c02bd4f7ada1: Status 404 returned error can't find the container with id 03b8aafa4ed02d1df35135f8e89b93ff1f08a62afaecec257323c02bd4f7ada1
Jul 07 19:01:17.680648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.680617    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dctsw"
Jul 07 19:01:17.680761 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.680667    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b692e26_8a80_4791_8e20_6e567d0b4fc7.slice/crio-090e2e5375772b9093799e7bcfb8e1d4a725db45c0d81fa46271f9dbf5eb0e2d WatchSource:0}: Error finding container 090e2e5375772b9093799e7bcfb8e1d4a725db45c0d81fa46271f9dbf5eb0e2d: Status 404 returned error can't find the container with id 090e2e5375772b9093799e7bcfb8e1d4a725db45c0d81fa46271f9dbf5eb0e2d
Jul 07 19:01:17.692349 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:17.692327    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a45bc1_7f60_4007_aa44_f80840ff206f.slice/crio-28a36a79ae2dc1cefeed03a9c5fae098bc50728c855e5d66c481dcdf5eee133b WatchSource:0}: Error finding container 28a36a79ae2dc1cefeed03a9c5fae098bc50728c855e5d66c481dcdf5eee133b: Status 404 returned error can't find the container with id 28a36a79ae2dc1cefeed03a9c5fae098bc50728c855e5d66c481dcdf5eee133b
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.927687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:17.927782    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.927861    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.927882    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.927890    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.927897    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.927951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:18.927933117 +0000 UTC m=+4.068307275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:17.927983 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:17.927971    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:18.927960742 +0000 UTC m=+4.068334907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:18.028315 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.028238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:18.028564 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.028381    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:18.028564 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.028462    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:19.028439831 +0000 UTC m=+4.168814016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:18.351520 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.351452    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:56:17 +0000 UTC" deadline="2028-02-25 09:24:05.93868959 +0000 UTC"
Jul 07 19:01:18.351520 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.351492    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14342h22m47.587203668s"
Jul 07 19:01:18.366689 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.366633    2569 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280"
Jul 07 19:01:18.366840 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.366792    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-zwv5z_kube-system(f557f0ef-50b9-4fd4-9ad3-ff4b62128088): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 07 19:01:18.366921 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.366835    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/konnectivity-agent-zwv5z" podUID="f557f0ef-50b9-4fd4-9ad3-ff4b62128088"
Jul 07 19:01:18.496297 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.496205    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dbh4" event={"ID":"5b692e26-8a80-4791-8e20-6e567d0b4fc7","Type":"ContainerStarted","Data":"090e2e5375772b9093799e7bcfb8e1d4a725db45c0d81fa46271f9dbf5eb0e2d"}
Jul 07 19:01:18.497802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.497771    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zwv5z" event={"ID":"f557f0ef-50b9-4fd4-9ad3-ff4b62128088","Type":"ContainerStarted","Data":"03b8aafa4ed02d1df35135f8e89b93ff1f08a62afaecec257323c02bd4f7ada1"}
Jul 07 19:01:18.500486 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.500138    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/konnectivity-agent-zwv5z" podUID="f557f0ef-50b9-4fd4-9ad3-ff4b62128088"
Jul 07 19:01:18.500998 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.500909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr" event={"ID":"2e074ca6-0b82-4000-8aef-f33a8686ff0b","Type":"ContainerStarted","Data":"d2ce4b46450729425067cc4b65e42987e99d6af31e6a18307c443e72ae94ca5c"}
Jul 07 19:01:18.503308 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.503233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xj6wh" event={"ID":"3e19bc52-090c-42b5-bf39-7842ebf31323","Type":"ContainerStarted","Data":"90ac5d89e2819a9e12de4e4015ab5016632f98963ef4ccb1701e18cdb3995394"}
Jul 07 19:01:18.505106 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.504738    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fsp5j" event={"ID":"d7bca08d-c51d-40c4-ba26-3ade146718b3","Type":"ContainerStarted","Data":"d91437610edebc7c43ece59634d3b81f99a902c479b6d1ecde445ef6e67544cd"}
Jul 07 19:01:18.506469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.506409    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerStarted","Data":"28a36a79ae2dc1cefeed03a9c5fae098bc50728c855e5d66c481dcdf5eee133b"}
Jul 07 19:01:18.508583 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.508464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"8b792d871b192bc32886824ed9d2c7ea60507a4ded6a5036cd9745617af75955"}
Jul 07 19:01:18.510664 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.510635    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kj7tr" event={"ID":"b6aa0edf-ebca-4806-93ad-3ded61f49395","Type":"ContainerStarted","Data":"23b14532f7b4a4f862398fdb05f2fa7c9fd1c3b6936f8245acf5a873961457a3"}
Jul 07 19:01:18.513401 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.513377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jtqj7" event={"ID":"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba","Type":"ContainerStarted","Data":"09563cfba3dfe252f3a85461a9ed0f42b23ee124193d8737555a446889b12655"}
Jul 07 19:01:18.937327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.937242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:18.937327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:18.937300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:18.937548 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.937411    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:18.937548 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.937434    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:18.937548 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.937453    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:18.937548 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.937466    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:18.937548 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.937485    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:20.937465746 +0000 UTC m=+6.077839925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:18.937548 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:18.937501    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:20.937491424 +0000 UTC m=+6.077865604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:19.038646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:19.037971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:19.038646 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:19.038168    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:19.038646 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:19.038267    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:21.038217871 +0000 UTC m=+6.178592036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:19.352762 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:19.352604    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:56:17 +0000 UTC" deadline="2028-03-21 06:05:51.264031228 +0000 UTC"
Jul 07 19:01:19.352762 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:19.352671    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14939h4m31.91136498s"
Jul 07 19:01:19.487491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:19.487440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:19.487698 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:19.487600    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:19.488043 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:19.488025    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:19.488140 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:19.488119    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:19.488208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:19.488192    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:19.488352 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:19.488268    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:20.956975 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:20.956939    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:20.957454 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:20.956998    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:20.957454 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:20.957154    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:20.957454 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:20.957225    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:20.957454 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:20.957238    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:20.957454 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:20.957299    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:24.957280348 +0000 UTC m=+10.097654511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:20.957852 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:20.957721    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:20.957852 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:20.957770    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:24.957755079 +0000 UTC m=+10.098129243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:21.058666 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:21.058087    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:21.058666 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:21.058256    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:21.058666 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:21.058320    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:25.058302677 +0000 UTC m=+10.198676838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:21.485633 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:21.485605    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:21.485802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:21.485739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:21.485802 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:21.485754    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:21.485907 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:21.485879    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:21.485984 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:21.485926    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:21.486036 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:21.485995    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:23.485629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:23.485590    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:23.486081 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:23.485728    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:23.486081 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:23.485893    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:23.486081 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:23.485998    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:23.486081 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:23.486080    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:23.486286 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:23.486168    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:24.994435 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:24.994396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:24.994460    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:24.994637    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:24.994650    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:24.994667    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:24.994679    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:24.994705    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:32.994685077 +0000 UTC m=+18.135059258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:24.994957 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:24.994723    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:32.994713472 +0000 UTC m=+18.135087633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:25.094977 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:25.094938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:25.095144 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:25.095115    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:25.095218 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:25.095192    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:33.095171838 +0000 UTC m=+18.235546013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:25.485082 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:25.485046    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:25.485271 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:25.485191    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:25.486819 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:25.486560    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:25.486819 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:25.486668    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:25.486819 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:25.486713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:25.486819 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:25.486778    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:27.485907 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:27.485872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:27.486349 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:27.485990    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:27.486563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:27.486402    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:27.486563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:27.486535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:27.486726 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:27.486654    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:27.486726 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:27.486538    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:29.485936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:29.485901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:29.485936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:29.485931    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:29.486467 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:29.485901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:29.486467 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:29.486021    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:29.486467 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:29.486083    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:29.486467 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:29.486188    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:31.485177 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:31.485139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:31.485649 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:31.485143    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:31.485649 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:31.485140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:31.485649 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:31.485266    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:31.485649 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:31.485464    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:31.485649 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:31.485559    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:33.056623 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:33.056381    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:33.056623 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.056594    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:33.056623 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.056623    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:33.056623 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.056637    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:33.057204 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:33.056673    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:33.057204 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.056695    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:49.056675084 +0000 UTC m=+34.197049266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:33.057204 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.056753    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:33.057204 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.056808    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:49.056792085 +0000 UTC m=+34.197166245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:33.157404 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:33.157361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:33.157600 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.157548    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:33.157677 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.157631    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:49.157616073 +0000 UTC m=+34.297990231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:33.485864 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:33.485774    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:33.486016 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:33.485774    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:33.486016 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.485933    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:33.486016 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:33.485943    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:33.486194 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.486023    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:33.486194 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:33.486115    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:35.486260 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:35.486112    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:35.486260 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:35.486207    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:35.486260 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:35.486233    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:35.486260 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:35.486245    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:35.486864 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:35.486345    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:35.486864 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:35.486434    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:36.557709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:36.557359    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kj7tr" event={"ID":"b6aa0edf-ebca-4806-93ad-3ded61f49395","Type":"ContainerStarted","Data":"3d894e2cfac159e95364b9048768e95beb29a34c5c9183f8641a347768489e97"}
Jul 07 19:01:36.559500 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:36.559465    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal" event={"ID":"ea6aa2ed699049cefc1e795a074e4c66","Type":"ContainerStarted","Data":"905356416bf6f8c814a1ff2b07a18415f2cb4a2c29b41020a5c633c308a1c22e"}
Jul 07 19:01:36.566125 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:36.566089    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xj6wh" event={"ID":"3e19bc52-090c-42b5-bf39-7842ebf31323","Type":"ContainerStarted","Data":"f6ac18271dfd4dd6fabd5ea1de9f55f41f5d288cdb844a3e00de0db7d5b56aca"}
Jul 07 19:01:36.583729 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:36.583668    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kj7tr" podStartSLOduration=2.89078332 podStartE2EDuration="21.583647858s" totalImagesPullingTime="18.692864538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:36.582445954 +0000 UTC m=+21.722820171" watchObservedRunningTime="2026-07-07 19:01:36.583647858 +0000 UTC m=+21.724022041"
Jul 07 19:01:36.601802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:36.600073    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-243.ec2.internal" podStartSLOduration=19.600058476 podStartE2EDuration="19.600058476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:36.598981651 +0000 UTC m=+21.739355831" watchObservedRunningTime="2026-07-07 19:01:36.600058476 +0000 UTC m=+21.740432658"
Jul 07 19:01:36.618913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:36.618852    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xj6wh" podStartSLOduration=2.992493899 podStartE2EDuration="21.618829887s" totalImagesPullingTime="18.626335988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:36.618501239 +0000 UTC m=+21.758875423" watchObservedRunningTime="2026-07-07 19:01:36.618829887 +0000 UTC m=+21.759204068"
Jul 07 19:01:37.485907 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.485578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:37.485907 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.485578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:37.486107 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:37.485940    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:37.486107 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.485578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:37.486107 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:37.486004    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:37.486107 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:37.486079    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:37.569638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.569608    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal" event={"ID":"2920e7188ac4fd41ed939f0071dd168c","Type":"ContainerStarted","Data":"4ecf2bd49222b3c39b09838211a5c27586d32ece77dfb0bb4691dbe6b01c729f"}
Jul 07 19:01:37.571071 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.571042    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7dbh4" event={"ID":"5b692e26-8a80-4791-8e20-6e567d0b4fc7","Type":"ContainerStarted","Data":"2016be2b47d9e1d2596d7cce20aded209dca96459dfa0f3006ad24f33e081585"}
Jul 07 19:01:37.572158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.572138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr" event={"ID":"2e074ca6-0b82-4000-8aef-f33a8686ff0b","Type":"ContainerStarted","Data":"4e05b4a35cd01d33834d63ec13f91199ce89e3f252ce1215d80f31cad0c2bb10"}
Jul 07 19:01:37.576207 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.576182    2569 generic.go:356] "Generic (PLEG): container finished" podID="34a45bc1-7f60-4007-aa44-f80840ff206f" containerID="8a0a798062b910f36ae5302b5fd4498c80390f7e8c0f6fb1345ca05e10b21e54" exitCode=0
Jul 07 19:01:37.576294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.576263    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerDied","Data":"8a0a798062b910f36ae5302b5fd4498c80390f7e8c0f6fb1345ca05e10b21e54"}
Jul 07 19:01:37.579371 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.579342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"2d3030dd671753961d578ca32d696c7b7dc90de73e60833d07023392cbbffbf8"}
Jul 07 19:01:37.579469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.579413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"d8307e0964149d49651cf846c815d6ffa57aa79836670d224f98c3adf408948c"}
Jul 07 19:01:37.579542 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.579467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"ffdae0f712ff726371366954b23b5cb8a4a203392adb91abed1cf07cf749effc"}
Jul 07 19:01:37.579586 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.579539    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"2eb65efe5cbce58f5d5802c2afa03130eb7ab3235b271f2a3d7c306b9fddb1eb"}
Jul 07 19:01:37.579640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.579589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"8185d75af374e8c323f30588cb415c0c028fbea774725ddf074cdfff9b56493e"}
Jul 07 19:01:37.580769 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.580745    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jtqj7" event={"ID":"1ac9b790-71ac-4f5a-bcff-d1679c48f5ba","Type":"ContainerStarted","Data":"0a001026d02ac5a40f4a21f60e36fb8ef9ae223afb582c534a6b34a1e71eb4a8"}
Jul 07 19:01:37.601266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.601230    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jtqj7" podStartSLOduration=8.460994899 podStartE2EDuration="22.60121382s" totalImagesPullingTime="14.140218921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:37.600919952 +0000 UTC m=+22.741294135" watchObservedRunningTime="2026-07-07 19:01:37.60121382 +0000 UTC m=+22.741588004"
Jul 07 19:01:37.619802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:37.619765    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7dbh4" podStartSLOduration=4.020759388 podStartE2EDuration="22.619753608s" totalImagesPullingTime="18.59899422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:37.619552074 +0000 UTC m=+22.759926256" watchObservedRunningTime="2026-07-07 19:01:37.619753608 +0000 UTC m=+22.760127788"
Jul 07 19:01:38.585917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.585734    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"c9799c1a1f6b9d67ddcb4a7a955d0a9f8f3034349f30262037cc1c58b51f07fa"}
Jul 07 19:01:38.587227 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.587202    2569 generic.go:356] "Generic (PLEG): container finished" podID="2920e7188ac4fd41ed939f0071dd168c" containerID="4ecf2bd49222b3c39b09838211a5c27586d32ece77dfb0bb4691dbe6b01c729f" exitCode=0
Jul 07 19:01:38.587361 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.587295    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal" event={"ID":"2920e7188ac4fd41ed939f0071dd168c","Type":"ContainerDied","Data":"4ecf2bd49222b3c39b09838211a5c27586d32ece77dfb0bb4691dbe6b01c729f"}
Jul 07 19:01:38.588620 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.588600    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zwv5z" event={"ID":"f557f0ef-50b9-4fd4-9ad3-ff4b62128088","Type":"ContainerStarted","Data":"ec3afdacda0483ab0d2a046d550d63791875b7e51d1a705c23eb6c22c7bc29d4"}
Jul 07 19:01:38.589888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.589866    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fsp5j" event={"ID":"d7bca08d-c51d-40c4-ba26-3ade146718b3","Type":"ContainerStarted","Data":"fe38ed73c5f39e0458c4327fac63938ec240036cf75fbdcb6dc55f8e7845748f"}
Jul 07 19:01:38.628395 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.628343    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fsp5j" podStartSLOduration=4.984892852 podStartE2EDuration="23.628327911s" totalImagesPullingTime="18.643435059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:38.627838874 +0000 UTC m=+23.768213053" watchObservedRunningTime="2026-07-07 19:01:38.628327911 +0000 UTC m=+23.768702091"
Jul 07 19:01:38.818127 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:38.818062    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 19:01:39.373708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.373590    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T19:01:38.818082887Z","UUID":"fb973b2e-1f03-4fa6-b621-abe3e6143f9e","Handler":null,"Name":"","Endpoint":""}
Jul 07 19:01:39.375029 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.375002    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 19:01:39.375163 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.375045    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 19:01:39.485852 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.485812    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:39.486039 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.485812    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:39.486039 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:39.485953    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:39.486039 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.485829    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:39.486039 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:39.486009    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:39.486371 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:39.486118    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:39.594935 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.594893    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal" event={"ID":"2920e7188ac4fd41ed939f0071dd168c","Type":"ContainerStarted","Data":"58bd5df2af1eba2eb26b5e4078a97e4bece74aa4b9e29be5cbf6c231597fe6a0"}
Jul 07 19:01:39.597046 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.597021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr" event={"ID":"2e074ca6-0b82-4000-8aef-f33a8686ff0b","Type":"ContainerStarted","Data":"c0f52b9dfec0bbb5039184f4593b02612c1868ab3eba851eac41245f0048314b"}
Jul 07 19:01:39.616226 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.616169    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zwv5z" podStartSLOduration=4.502292538 podStartE2EDuration="24.616151475s" totalImagesPullingTime="20.113858937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-07 19:01:38.652004356 +0000 UTC m=+23.792378536" watchObservedRunningTime="2026-07-07 19:01:39.616151475 +0000 UTC m=+24.756525654"
Jul 07 19:01:39.616390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:39.616273    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-243.ec2.internal" podStartSLOduration=22.616266275 podStartE2EDuration="22.616266275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:39.615771974 +0000 UTC m=+24.756146157" watchObservedRunningTime="2026-07-07 19:01:39.616266275 +0000 UTC m=+24.756640454"
Jul 07 19:01:40.601104 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:40.601061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr" event={"ID":"2e074ca6-0b82-4000-8aef-f33a8686ff0b","Type":"ContainerStarted","Data":"b384943bce9c7f799d5e8afc5d2b1c107867f5f8c4bc9010b32595114772aa64"}
Jul 07 19:01:40.604410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:40.604385    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"6e67060324e651dc9cafd446f2996b77836b721d8ee3ef353c31508336a27930"}
Jul 07 19:01:40.624205 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:40.624166    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9kpr" podStartSLOduration=4.305842034 podStartE2EDuration="25.62415385s" totalImagesPullingTime="21.318311816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:40.623019509 +0000 UTC m=+25.763393689" watchObservedRunningTime="2026-07-07 19:01:40.62415385 +0000 UTC m=+25.764528029"
Jul 07 19:01:41.488559 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:41.488524    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:41.488731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:41.488524    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:41.488731 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:41.488640    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:41.488731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:41.488528    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:41.488731 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:41.488712    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:41.488896 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:41.488752    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:42.613863 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:42.613651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" event={"ID":"bba98273-b094-40da-b060-9eed2b1ad8df","Type":"ContainerStarted","Data":"84af93b3b121c58936f24e2cdf44e1d851bb22aedf5c12aa47443e4093f4a355"}
Jul 07 19:01:42.614455 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:42.613983    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:42.614455 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:42.614054    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:42.630330 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:42.630296    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:42.630883 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:42.630849    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:42.680408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:42.680353    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2" podStartSLOduration=8.835595421 podStartE2EDuration="27.68033368s" totalImagesPullingTime="18.844738259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:42.651019419 +0000 UTC m=+27.791393590" watchObservedRunningTime="2026-07-07 19:01:42.68033368 +0000 UTC m=+27.820707865"
Jul 07 19:01:43.051878 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.051792    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:43.052403 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.052377    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:43.485888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.485816    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:43.486037 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.485816    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:43.486037 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:43.485940    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:43.486037 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:43.486014    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:43.486037 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.485816    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:43.486240 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:43.486121    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:43.616257 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.616232    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 19:01:43.927314 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.927122    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vclgj"]
Jul 07 19:01:43.927420 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.927399    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:43.927520 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:43.927486    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:43.927798 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.927777    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fnlx2"]
Jul 07 19:01:43.927870 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.927859    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:43.927949 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:43.927935    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:43.939990 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.939969    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wm5f9"]
Jul 07 19:01:43.940087 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:43.940056    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:43.940178 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:43.940144    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:44.620021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:44.619985    2569 generic.go:356] "Generic (PLEG): container finished" podID="34a45bc1-7f60-4007-aa44-f80840ff206f" containerID="fcca081cb73e35b578b34644e27ae347fa81199ddbcddf20351c89242691910a" exitCode=0
Jul 07 19:01:44.620587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:44.620068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerDied","Data":"fcca081cb73e35b578b34644e27ae347fa81199ddbcddf20351c89242691910a"}
Jul 07 19:01:44.620587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:44.620133    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 19:01:45.486602 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:45.486573    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:45.486764 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:45.486649    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:45.486764 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:45.486651    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:45.486858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:45.486761    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:45.486858 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:45.486759    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:45.486858 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:45.486852    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:45.624806 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:45.624728    2569 generic.go:356] "Generic (PLEG): container finished" podID="34a45bc1-7f60-4007-aa44-f80840ff206f" containerID="d1aca4842520c3727db3aeb48ff0e68475f23cd6bfc9fdc96984d14144125738" exitCode=0
Jul 07 19:01:45.624806 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:45.624781    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerDied","Data":"d1aca4842520c3727db3aeb48ff0e68475f23cd6bfc9fdc96984d14144125738"}
Jul 07 19:01:45.982744 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:45.982718    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:01:46.455823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:46.455788    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:46.455978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:46.455925    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 19:01:46.456654 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:46.456633    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zwv5z"
Jul 07 19:01:46.628919 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:46.628885    2569 generic.go:356] "Generic (PLEG): container finished" podID="34a45bc1-7f60-4007-aa44-f80840ff206f" containerID="09894fbba39a3c907795d21609ac57bfd3f57356869566d95ecf1615da5fbc92" exitCode=0
Jul 07 19:01:46.629255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:46.628962    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerDied","Data":"09894fbba39a3c907795d21609ac57bfd3f57356869566d95ecf1615da5fbc92"}
Jul 07 19:01:47.485898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:47.485865    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:47.486062 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:47.485865    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:47.486062 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:47.486002    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnlx2" podUID="20a29a0a-c624-45b8-a4d4-c047a976eff4"
Jul 07 19:01:47.486062 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:47.486039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:47.486230 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:47.486108    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm5f9" podUID="a03e1d90-67f3-4f8a-a185-0f542e623f54"
Jul 07 19:01:47.486230 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:47.486182    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vclgj" podUID="d2842b5e-28e5-43fc-a6b6-a470a7e1f548"
Jul 07 19:01:49.082538 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.082340    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.082554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.082494    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.082661    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs podName:20a29a0a-c624-45b8-a4d4-c047a976eff4 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:21.082645388 +0000 UTC m=+66.223019546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs") pod "network-metrics-daemon-fnlx2" (UID: "20a29a0a-c624-45b8-a4d4-c047a976eff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.082668    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.082682    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.082691    2569 projected.go:196] Error preparing data for projected volume kube-api-access-6fpvh for pod openshift-network-diagnostics/network-check-target-vclgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:49.082932 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.082731    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh podName:d2842b5e-28e5-43fc-a6b6-a470a7e1f548 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:21.082716553 +0000 UTC m=+66.223090729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fpvh" (UniqueName: "kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh") pod "network-check-target-vclgj" (UID: "d2842b5e-28e5-43fc-a6b6-a470a7e1f548") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:01:49.183244 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.183174    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:49.183368 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.183316    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:49.183401 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.183376    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret podName:a03e1d90-67f3-4f8a-a185-0f542e623f54 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:21.183356491 +0000 UTC m=+66.323730649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret") pod "global-pull-secret-syncer-wm5f9" (UID: "a03e1d90-67f3-4f8a-a185-0f542e623f54") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:01:49.224888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.224864    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-243.ec2.internal" event="NodeReady"
Jul 07 19:01:49.224990 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.224976    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 19:01:49.260477 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.260445    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78b694fd75-svnpd"]
Jul 07 19:01:49.266892 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.266870    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.269648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.269466    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 19:01:49.270076 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.269943    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 19:01:49.270171 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.270154    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 19:01:49.271919 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.270498    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wn7mq\""
Jul 07 19:01:49.271919 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.270703    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rp677"]
Jul 07 19:01:49.275402 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.275381    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 19:01:49.279167 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.279146    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-747jl"]
Jul 07 19:01:49.279288 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.279271    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.281715 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.281687    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 19:01:49.282033 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.282015    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hlmk\""
Jul 07 19:01:49.282389 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.282370    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 19:01:49.285781 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.285760    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b694fd75-svnpd"]
Jul 07 19:01:49.285879 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.285798    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rp677"]
Jul 07 19:01:49.285936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.285886    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.288323 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.288302    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 19:01:49.288408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.288348    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 19:01:49.288585 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.288496    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bv84w\""
Jul 07 19:01:49.288585 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.288497    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 19:01:49.289614 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.289540    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-747jl"]
Jul 07 19:01:49.384223 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24be916-b171-419c-88e4-105618b31ac6-tmp-dir\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.384387 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-installation-pull-secrets\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384387 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-certificates\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384387 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-bound-sa-token\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384388    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9zmb\" (UniqueName: \"kubernetes.io/projected/d2f62e5e-fea0-4778-8476-fba463cff416-kube-api-access-h9zmb\") pod \"ingress-canary-747jl\" (UID: \"d2f62e5e-fea0-4778-8476-fba463cff416\") " pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w86x8\" (UniqueName: \"kubernetes.io/projected/b24be916-b171-419c-88e4-105618b31ac6-kube-api-access-w86x8\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-trusted-ca\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2f62e5e-fea0-4778-8476-fba463cff416-cert\") pod \"ingress-canary-747jl\" (UID: \"d2f62e5e-fea0-4778-8476-fba463cff416\") " pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b24be916-b171-419c-88e4-105618b31ac6-config-volume\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.384577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c142468a-5d8a-4c69-abf9-3466a837cb9f-ca-trust-extracted\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-image-registry-private-configuration\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.384802 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.384643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzvj\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-kube-api-access-tvzvj\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.485543 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:01:49.485543 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485461    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:01:49.485543 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-certificates\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-bound-sa-token\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9zmb\" (UniqueName: \"kubernetes.io/projected/d2f62e5e-fea0-4778-8476-fba463cff416-kube-api-access-h9zmb\") pod \"ingress-canary-747jl\" (UID: \"d2f62e5e-fea0-4778-8476-fba463cff416\") " pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86x8\" (UniqueName: \"kubernetes.io/projected/b24be916-b171-419c-88e4-105618b31ac6-kube-api-access-w86x8\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485693    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-trusted-ca\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2f62e5e-fea0-4778-8476-fba463cff416-cert\") pod \"ingress-canary-747jl\" (UID: \"d2f62e5e-fea0-4778-8476-fba463cff416\") " pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b24be916-b171-419c-88e4-105618b31ac6-config-volume\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.485772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c142468a-5d8a-4c69-abf9-3466a837cb9f-ca-trust-extracted\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-image-registry-private-configuration\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485850    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzvj\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-kube-api-access-tvzvj\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24be916-b171-419c-88e4-105618b31ac6-tmp-dir\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.485937    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-installation-pull-secrets\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.486008    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.486120    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-certificates\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486211 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.486160    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls podName:b24be916-b171-419c-88e4-105618b31ac6 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:49.986140335 +0000 UTC m=+35.126514571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls") pod "dns-default-rp677" (UID: "b24be916-b171-419c-88e4-105618b31ac6") : secret "dns-default-metrics-tls" not found
Jul 07 19:01:49.486642 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.486474    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c142468a-5d8a-4c69-abf9-3466a837cb9f-ca-trust-extracted\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486642 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.486562    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 19:01:49.486642 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.486577    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b694fd75-svnpd: secret "image-registry-tls" not found
Jul 07 19:01:49.486642 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.486623    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls podName:c142468a-5d8a-4c69-abf9-3466a837cb9f nodeName:}" failed. No retries permitted until 2026-07-07 19:01:49.986606005 +0000 UTC m=+35.126980181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls") pod "image-registry-78b694fd75-svnpd" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f") : secret "image-registry-tls" not found
Jul 07 19:01:49.486799 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.486693    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-trusted-ca\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.486933 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.486912    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b24be916-b171-419c-88e4-105618b31ac6-config-volume\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.487173 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.487148    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b24be916-b171-419c-88e4-105618b31ac6-tmp-dir\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.488533 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.488327    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 19:01:49.488533 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.488360    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-546ff\""
Jul 07 19:01:49.488789 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.488761    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g87lc\""
Jul 07 19:01:49.488890 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.488866    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 19:01:49.488999 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.488984    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 19:01:49.489067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.489040    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 19:01:49.490939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.490911    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-image-registry-private-configuration\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.491049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.490936    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2f62e5e-fea0-4778-8476-fba463cff416-cert\") pod \"ingress-canary-747jl\" (UID: \"d2f62e5e-fea0-4778-8476-fba463cff416\") " pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.491049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.490936    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-installation-pull-secrets\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.495413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.495380    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9zmb\" (UniqueName: \"kubernetes.io/projected/d2f62e5e-fea0-4778-8476-fba463cff416-kube-api-access-h9zmb\") pod \"ingress-canary-747jl\" (UID: \"d2f62e5e-fea0-4778-8476-fba463cff416\") " pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.495556 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.495541    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzvj\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-kube-api-access-tvzvj\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.496375 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.496329    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-bound-sa-token\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.496858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.496833    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w86x8\" (UniqueName: \"kubernetes.io/projected/b24be916-b171-419c-88e4-105618b31ac6-kube-api-access-w86x8\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.598734 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.598703    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-747jl"
Jul 07 19:01:49.745521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.745440    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-747jl"]
Jul 07 19:01:49.749472 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:01:49.749441    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f62e5e_fea0_4778_8476_fba463cff416.slice/crio-c2aa595e4e541d18882bf58da724725a850a8c60c89f88f6b56ef4028b1107e0 WatchSource:0}: Error finding container c2aa595e4e541d18882bf58da724725a850a8c60c89f88f6b56ef4028b1107e0: Status 404 returned error can't find the container with id c2aa595e4e541d18882bf58da724725a850a8c60c89f88f6b56ef4028b1107e0
Jul 07 19:01:49.989142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.989113    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:49.989142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:49.989148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:49.989397 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.989254    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 19:01:49.989397 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.989266    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b694fd75-svnpd: secret "image-registry-tls" not found
Jul 07 19:01:49.989397 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.989309    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls podName:c142468a-5d8a-4c69-abf9-3466a837cb9f nodeName:}" failed. No retries permitted until 2026-07-07 19:01:50.989297503 +0000 UTC m=+36.129671661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls") pod "image-registry-78b694fd75-svnpd" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f") : secret "image-registry-tls" not found
Jul 07 19:01:49.989397 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.989255    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:01:49.989397 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:49.989378    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls podName:b24be916-b171-419c-88e4-105618b31ac6 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:50.989362091 +0000 UTC m=+36.129736250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls") pod "dns-default-rp677" (UID: "b24be916-b171-419c-88e4-105618b31ac6") : secret "dns-default-metrics-tls" not found
Jul 07 19:01:50.639908 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:50.639872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-747jl" event={"ID":"d2f62e5e-fea0-4778-8476-fba463cff416","Type":"ContainerStarted","Data":"c2aa595e4e541d18882bf58da724725a850a8c60c89f88f6b56ef4028b1107e0"}
Jul 07 19:01:50.996293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:50.996196    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:50.996293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:50.996255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:50.996628 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:50.996379    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:01:50.996628 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:50.996438    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 19:01:50.996628 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:50.996452    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b694fd75-svnpd: secret "image-registry-tls" not found
Jul 07 19:01:50.996628 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:50.996464    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls podName:b24be916-b171-419c-88e4-105618b31ac6 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:52.996440426 +0000 UTC m=+38.136814609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls") pod "dns-default-rp677" (UID: "b24be916-b171-419c-88e4-105618b31ac6") : secret "dns-default-metrics-tls" not found
Jul 07 19:01:50.996628 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:50.996498    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls podName:c142468a-5d8a-4c69-abf9-3466a837cb9f nodeName:}" failed. No retries permitted until 2026-07-07 19:01:52.996483115 +0000 UTC m=+38.136857289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls") pod "image-registry-78b694fd75-svnpd" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f") : secret "image-registry-tls" not found
Jul 07 19:01:52.901947 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.901778    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5kqkg"]
Jul 07 19:01:52.919374 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.919349    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5kqkg"]
Jul 07 19:01:52.919540 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.919478    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:52.922256 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.922231    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 19:01:52.922367 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.922281    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7xpr\""
Jul 07 19:01:52.923067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.922821    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 19:01:52.923067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.922831    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 19:01:52.923067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:52.922854    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 19:01:53.011679 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.011830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21cdff67-551f-447c-9314-b2f606b1068d-data-volume\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.011830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:53.011830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:53.011830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011804    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwzvf\" (UniqueName: \"kubernetes.io/projected/21cdff67-551f-447c-9314-b2f606b1068d-kube-api-access-pwzvf\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011835    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.011851    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.011893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21cdff67-551f-447c-9314-b2f606b1068d-crio-socket\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.011852    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.011934    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b694fd75-svnpd: secret "image-registry-tls" not found
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.011913    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls podName:b24be916-b171-419c-88e4-105618b31ac6 nodeName:}" failed. No retries permitted until 2026-07-07 19:01:57.01189276 +0000 UTC m=+42.152266918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls") pod "dns-default-rp677" (UID: "b24be916-b171-419c-88e4-105618b31ac6") : secret "dns-default-metrics-tls" not found
Jul 07 19:01:53.012006 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.012006    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls podName:c142468a-5d8a-4c69-abf9-3466a837cb9f nodeName:}" failed. No retries permitted until 2026-07-07 19:01:57.011992443 +0000 UTC m=+42.152366600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls") pod "image-registry-78b694fd75-svnpd" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f") : secret "image-registry-tls" not found
Jul 07 19:01:53.112629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.112590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwzvf\" (UniqueName: \"kubernetes.io/projected/21cdff67-551f-447c-9314-b2f606b1068d-kube-api-access-pwzvf\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.112629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.112627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.112818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.112659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21cdff67-551f-447c-9314-b2f606b1068d-crio-socket\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.112818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.112722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.112818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.112749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21cdff67-551f-447c-9314-b2f606b1068d-data-volume\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.112818 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.112756    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:53.112818 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.112803    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:01:53.112818 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.112816    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:01:53.612796992 +0000 UTC m=+38.753171163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:53.113041 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.112874    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:01:53.612857259 +0000 UTC m=+38.753231434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : configmap "kube-rbac-proxy" not found
Jul 07 19:01:53.113041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.112934    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21cdff67-551f-447c-9314-b2f606b1068d-crio-socket\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.113109 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.113038    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21cdff67-551f-447c-9314-b2f606b1068d-data-volume\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.123561 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.123538    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwzvf\" (UniqueName: \"kubernetes.io/projected/21cdff67-551f-447c-9314-b2f606b1068d-kube-api-access-pwzvf\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.616155 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.616065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.616310 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.616155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:53.616310 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.616207    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:53.616310 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.616228    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:01:53.616310 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.616276    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:01:54.616259673 +0000 UTC m=+39.756633831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:53.616310 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:53.616290    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:01:54.61628351 +0000 UTC m=+39.756657668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : configmap "kube-rbac-proxy" not found
Jul 07 19:01:53.648814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.648782    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-747jl" event={"ID":"d2f62e5e-fea0-4778-8476-fba463cff416","Type":"ContainerStarted","Data":"02cd8714e63ed71f4db0201d74ed9a67177f66d583410e9d18c409d05f78c53e"}
Jul 07 19:01:53.651463 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.651436    2569 generic.go:356] "Generic (PLEG): container finished" podID="34a45bc1-7f60-4007-aa44-f80840ff206f" containerID="9bfcae40e542063664912d31cc1a93f4bd2ad0ca5e41340f61e7a8be5416e587" exitCode=0
Jul 07 19:01:53.651614 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.651487    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerDied","Data":"9bfcae40e542063664912d31cc1a93f4bd2ad0ca5e41340f61e7a8be5416e587"}
Jul 07 19:01:53.665380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:53.665340    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-747jl" podStartSLOduration=1.189119622 podStartE2EDuration="4.665326819s" totalImagesPullingTime="3.476207197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:53.664760167 +0000 UTC m=+38.805134342" watchObservedRunningTime="2026-07-07 19:01:53.665326819 +0000 UTC m=+38.805700998"
Jul 07 19:01:54.622681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:54.622593    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:54.623032 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:54.622682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:54.623032 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:54.622739    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:54.623032 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:54.622770    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:01:54.623032 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:54.622814    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.62279809 +0000 UTC m=+41.763172270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:54.623032 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:54.622831    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:01:56.622824258 +0000 UTC m=+41.763198416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : configmap "kube-rbac-proxy" not found
Jul 07 19:01:54.657202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:54.657172    2569 generic.go:356] "Generic (PLEG): container finished" podID="34a45bc1-7f60-4007-aa44-f80840ff206f" containerID="2cc19cf40073059ef5384bb4b7c71bd04ba35bfefdabc2bdcf8c3e1ab6725c52" exitCode=0
Jul 07 19:01:54.657358 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:54.657266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerDied","Data":"2cc19cf40073059ef5384bb4b7c71bd04ba35bfefdabc2bdcf8c3e1ab6725c52"}
Jul 07 19:01:55.663061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:55.663022    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dctsw" event={"ID":"34a45bc1-7f60-4007-aa44-f80840ff206f","Type":"ContainerStarted","Data":"655f2d2049dee39be88b796f73cb98ecfe5185862fa1ae3379ee0eb5e59b8f87"}
Jul 07 19:01:55.714039 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:55.713989    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dctsw" podStartSLOduration=7.681625752 podStartE2EDuration="40.713974857s" totalImagesPullingTime="33.032349105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:01:55.713405854 +0000 UTC m=+40.853780034" watchObservedRunningTime="2026-07-07 19:01:55.713974857 +0000 UTC m=+40.854349036"
Jul 07 19:01:55.881360 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:55.881330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jtqj7_1ac9b790-71ac-4f5a-bcff-d1679c48f5ba/dns-node-resolver/0.log"
Jul 07 19:01:56.481031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:56.481005    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dbh4_5b692e26-8a80-4791-8e20-6e567d0b4fc7/node-ca/0.log"
Jul 07 19:01:56.637867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:56.637833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:56.638036 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:56.637929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:56.638036 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:56.637975    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:56.638036 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:56.638036    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:02:00.638020814 +0000 UTC m=+45.778394975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:01:56.638442 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:56.638426    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21cdff67-551f-447c-9314-b2f606b1068d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:01:57.042043 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:57.042010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:01:57.042043 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:57.042046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:01:57.042430 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:57.042132    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 19:01:57.042430 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:57.042142    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b694fd75-svnpd: secret "image-registry-tls" not found
Jul 07 19:01:57.042430 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:57.042150    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:01:57.042430 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:57.042191    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls podName:c142468a-5d8a-4c69-abf9-3466a837cb9f nodeName:}" failed. No retries permitted until 2026-07-07 19:02:05.042177936 +0000 UTC m=+50.182552094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls") pod "image-registry-78b694fd75-svnpd" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f") : secret "image-registry-tls" not found
Jul 07 19:01:57.042430 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:01:57.042244    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls podName:b24be916-b171-419c-88e4-105618b31ac6 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:05.042227264 +0000 UTC m=+50.182601423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls") pod "dns-default-rp677" (UID: "b24be916-b171-419c-88e4-105618b31ac6") : secret "dns-default-metrics-tls" not found
Jul 07 19:01:57.280685 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:01:57.280657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-747jl_d2f62e5e-fea0-4778-8476-fba463cff416/serve-healthcheck-canary/0.log"
Jul 07 19:02:00.670476 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:00.670435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:02:00.670929 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:00.670566    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:02:00.670929 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:00.670630    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls podName:21cdff67-551f-447c-9314-b2f606b1068d nodeName:}" failed. No retries permitted until 2026-07-07 19:02:08.670616712 +0000 UTC m=+53.810990869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5kqkg" (UID: "21cdff67-551f-447c-9314-b2f606b1068d") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:02:05.104895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.104853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:02:05.105370 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.104916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:05.109473 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.109434    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"image-registry-78b694fd75-svnpd\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") " pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:05.109643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.109627    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b24be916-b171-419c-88e4-105618b31ac6-metrics-tls\") pod \"dns-default-rp677\" (UID: \"b24be916-b171-419c-88e4-105618b31ac6\") " pod="openshift-dns/dns-default-rp677"
Jul 07 19:02:05.179892 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.179858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:05.191511 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.191491    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rp677"
Jul 07 19:02:05.329658 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.329629    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b694fd75-svnpd"]
Jul 07 19:02:05.332573 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:05.332546    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc142468a_5d8a_4c69_abf9_3466a837cb9f.slice/crio-5a70355c09ca541261bf7578e378f9ef3ebf2ed6c9ce43ce7e61ba1f89db496a WatchSource:0}: Error finding container 5a70355c09ca541261bf7578e378f9ef3ebf2ed6c9ce43ce7e61ba1f89db496a: Status 404 returned error can't find the container with id 5a70355c09ca541261bf7578e378f9ef3ebf2ed6c9ce43ce7e61ba1f89db496a
Jul 07 19:02:05.340974 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.340952    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rp677"]
Jul 07 19:02:05.343671 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:05.343651    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24be916_b171_419c_88e4_105618b31ac6.slice/crio-d6d5635c26b3bda8285c0816805cee3b4d69f8a0130136156cf1e469c5585575 WatchSource:0}: Error finding container d6d5635c26b3bda8285c0816805cee3b4d69f8a0130136156cf1e469c5585575: Status 404 returned error can't find the container with id d6d5635c26b3bda8285c0816805cee3b4d69f8a0130136156cf1e469c5585575
Jul 07 19:02:05.685157 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.685066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rp677" event={"ID":"b24be916-b171-419c-88e4-105618b31ac6","Type":"ContainerStarted","Data":"d6d5635c26b3bda8285c0816805cee3b4d69f8a0130136156cf1e469c5585575"}
Jul 07 19:02:05.686572 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.686549    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b694fd75-svnpd" event={"ID":"c142468a-5d8a-4c69-abf9-3466a837cb9f","Type":"ContainerStarted","Data":"229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d"}
Jul 07 19:02:05.686661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.686588    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b694fd75-svnpd" event={"ID":"c142468a-5d8a-4c69-abf9-3466a837cb9f","Type":"ContainerStarted","Data":"5a70355c09ca541261bf7578e378f9ef3ebf2ed6c9ce43ce7e61ba1f89db496a"}
Jul 07 19:02:05.686708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.686690    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:05.706243 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:05.706193    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78b694fd75-svnpd" podStartSLOduration=31.706178013 podStartE2EDuration="31.706178013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:05.705741781 +0000 UTC m=+50.846115986" watchObservedRunningTime="2026-07-07 19:02:05.706178013 +0000 UTC m=+50.846552170"
Jul 07 19:02:08.695275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.695235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rp677" event={"ID":"b24be916-b171-419c-88e4-105618b31ac6","Type":"ContainerStarted","Data":"eaf50fca9b3bbca9723461f5d3e19e3af3d2994e0dd8a62ded23d9a25b66332d"}
Jul 07 19:02:08.695728 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.695297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rp677" event={"ID":"b24be916-b171-419c-88e4-105618b31ac6","Type":"ContainerStarted","Data":"78fbf20d6ca155301666beafdd78d69eb50f1257ac93d4a7711c3b628149c466"}
Jul 07 19:02:08.695728 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.695380    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rp677"
Jul 07 19:02:08.715143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.715093    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rp677" podStartSLOduration=17.334717155 podStartE2EDuration="19.715081558s" totalImagesPullingTime="2.380364403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:08.714874435 +0000 UTC m=+53.855248614" watchObservedRunningTime="2026-07-07 19:02:08.715081558 +0000 UTC m=+53.855455738"
Jul 07 19:02:08.734470 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.734437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:02:08.736799 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.736770    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21cdff67-551f-447c-9314-b2f606b1068d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5kqkg\" (UID: \"21cdff67-551f-447c-9314-b2f606b1068d\") " pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:02:08.832058 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.832028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5kqkg"
Jul 07 19:02:08.973916 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:08.973836    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5kqkg"]
Jul 07 19:02:08.976626 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:08.976599    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cdff67_551f_447c_9314_b2f606b1068d.slice/crio-212551d1742e2a63156620b1035c1b290e76bfa64c20a9ab1e80cfc82245fbf9 WatchSource:0}: Error finding container 212551d1742e2a63156620b1035c1b290e76bfa64c20a9ab1e80cfc82245fbf9: Status 404 returned error can't find the container with id 212551d1742e2a63156620b1035c1b290e76bfa64c20a9ab1e80cfc82245fbf9
Jul 07 19:02:09.699963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:09.699928    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kqkg" event={"ID":"21cdff67-551f-447c-9314-b2f606b1068d","Type":"ContainerStarted","Data":"212551d1742e2a63156620b1035c1b290e76bfa64c20a9ab1e80cfc82245fbf9"}
Jul 07 19:02:12.709387 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:12.709353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kqkg" event={"ID":"21cdff67-551f-447c-9314-b2f606b1068d","Type":"ContainerStarted","Data":"015cc213559343d156a84f7b61a481504a9020a584499e750a116fc314a81899"}
Jul 07 19:02:13.714637 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:13.714595    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kqkg" event={"ID":"21cdff67-551f-447c-9314-b2f606b1068d","Type":"ContainerStarted","Data":"3affb40b6b53712fbc985e7fb39555bd1fd860eea3693e5bb6ff03cee2c19d1b"}
Jul 07 19:02:15.997677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:15.997649    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6lqh2"
Jul 07 19:02:16.725273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:16.725236    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5kqkg" event={"ID":"21cdff67-551f-447c-9314-b2f606b1068d","Type":"ContainerStarted","Data":"47cbb99432c9ef25cd243b09077a2520f3517124695b7a8223c29af5e9f07c55"}
Jul 07 19:02:16.746783 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:16.746720    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5kqkg" podStartSLOduration=17.814836131 podStartE2EDuration="24.746703551s" totalImagesPullingTime="6.93186742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:16.746211893 +0000 UTC m=+61.886586073" watchObservedRunningTime="2026-07-07 19:02:16.746703551 +0000 UTC m=+61.887077730"
Jul 07 19:02:17.171665 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.171632    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"]
Jul 07 19:02:17.176176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.176149    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"]
Jul 07 19:02:17.176310 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.176268    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.178006 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.177989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.178822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.178802    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 19:02:17.178917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.178802    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cxcb8\""
Jul 07 19:02:17.179989 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.179975    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 19:02:17.180896 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.180880    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 19:02:17.184395 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.184338    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 19:02:17.184395 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.184351    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 19:02:17.184576 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.184418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-c78pc\""
Jul 07 19:02:17.184647 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.184630    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 19:02:17.191301 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.191281    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"]
Jul 07 19:02:17.193793 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.193773    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"]
Jul 07 19:02:17.212004 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.211980    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b694fd75-svnpd"]
Jul 07 19:02:17.268803 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.268762    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-fkr88"]
Jul 07 19:02:17.270596 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.270579    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:17.273700 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.273679    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 19:02:17.274192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.274176    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9mrlj\""
Jul 07 19:02:17.274427 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.274414    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 19:02:17.310147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.310124    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12b194d0-ab4a-47f9-ab3f-ce3abe41c87c-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hz6fm\" (UID: \"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.310266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.310167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12b194d0-ab4a-47f9-ab3f-ce3abe41c87c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hz6fm\" (UID: \"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.310266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.310193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkwt\" (UniqueName: \"kubernetes.io/projected/83cdcc94-57cc-4852-9b1f-89fd1d0ccb73-kube-api-access-cbkwt\") pod \"managed-serviceaccount-addon-agent-7c8b76bf88-2bp76\" (UID: \"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.310353 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.310257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83cdcc94-57cc-4852-9b1f-89fd1d0ccb73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8b76bf88-2bp76\" (UID: \"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.345358 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.345328    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-fkr88"]
Jul 07 19:02:17.375684 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.375651    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5858cf7c49-2tfl6"]
Jul 07 19:02:17.377541 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.377527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.396174 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.396149    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5858cf7c49-2tfl6"]
Jul 07 19:02:17.411438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.411413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12b194d0-ab4a-47f9-ab3f-ce3abe41c87c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hz6fm\" (UID: \"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.411587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.411448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pft4g\" (UniqueName: \"kubernetes.io/projected/f15799ca-50bc-447b-8ff2-d9b4f9ee440e-kube-api-access-pft4g\") pod \"downloads-685bfb5f64-fkr88\" (UID: \"f15799ca-50bc-447b-8ff2-d9b4f9ee440e\") " pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:17.411587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.411471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkwt\" (UniqueName: \"kubernetes.io/projected/83cdcc94-57cc-4852-9b1f-89fd1d0ccb73-kube-api-access-cbkwt\") pod \"managed-serviceaccount-addon-agent-7c8b76bf88-2bp76\" (UID: \"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.411587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.411493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83cdcc94-57cc-4852-9b1f-89fd1d0ccb73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8b76bf88-2bp76\" (UID: \"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.411705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.411683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12b194d0-ab4a-47f9-ab3f-ce3abe41c87c-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hz6fm\" (UID: \"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.412224 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.412200    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12b194d0-ab4a-47f9-ab3f-ce3abe41c87c-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hz6fm\" (UID: \"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.413833 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.413818    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12b194d0-ab4a-47f9-ab3f-ce3abe41c87c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hz6fm\" (UID: \"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.413885 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.413851    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83cdcc94-57cc-4852-9b1f-89fd1d0ccb73-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8b76bf88-2bp76\" (UID: \"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.423146 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.423091    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkwt\" (UniqueName: \"kubernetes.io/projected/83cdcc94-57cc-4852-9b1f-89fd1d0ccb73-kube-api-access-cbkwt\") pod \"managed-serviceaccount-addon-agent-7c8b76bf88-2bp76\" (UID: \"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.485091 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.485042    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"
Jul 07 19:02:17.499542 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.499493    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"
Jul 07 19:02:17.512397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-registry-certificates\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pft4g\" (UniqueName: \"kubernetes.io/projected/f15799ca-50bc-447b-8ff2-d9b4f9ee440e-kube-api-access-pft4g\") pod \"downloads-685bfb5f64-fkr88\" (UID: \"f15799ca-50bc-447b-8ff2-d9b4f9ee440e\") " pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:17.512551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-registry-tls\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-installation-pull-secrets\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512578    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-ca-trust-extracted\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-trusted-ca\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-bound-sa-token\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-image-registry-private-configuration\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.512858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.512787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vtmt\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-kube-api-access-8vtmt\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.526334 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.526308    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pft4g\" (UniqueName: \"kubernetes.io/projected/f15799ca-50bc-447b-8ff2-d9b4f9ee440e-kube-api-access-pft4g\") pod \"downloads-685bfb5f64-fkr88\" (UID: \"f15799ca-50bc-447b-8ff2-d9b4f9ee440e\") " pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:17.578828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.578770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:17.613663 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-image-registry-private-configuration\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613663 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vtmt\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-kube-api-access-8vtmt\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613705    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-registry-certificates\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-registry-tls\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-installation-pull-secrets\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-ca-trust-extracted\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-trusted-ca\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.613895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.613821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-bound-sa-token\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.615420 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.614537    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-ca-trust-extracted\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.615420 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.615371    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-trusted-ca\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.615420 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.615414    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-registry-certificates\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.616523 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.616491    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-image-registry-private-configuration\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.617873 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.617228    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-installation-pull-secrets\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.617873 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.617851    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-registry-tls\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.626619 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.626598    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-bound-sa-token\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.628379 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.628355    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vtmt\" (UniqueName: \"kubernetes.io/projected/fbfc70f2-5b5e-49bd-af18-b28a1338d17e-kube-api-access-8vtmt\") pod \"image-registry-5858cf7c49-2tfl6\" (UID: \"fbfc70f2-5b5e-49bd-af18-b28a1338d17e\") " pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.629184 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.629164    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm"]
Jul 07 19:02:17.648421 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.648395    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76"]
Jul 07 19:02:17.651571 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:17.651547    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83cdcc94_57cc_4852_9b1f_89fd1d0ccb73.slice/crio-2303c6120a93d2f038093105067f463809534a816d30494a1a2a9108e34e77aa WatchSource:0}: Error finding container 2303c6120a93d2f038093105067f463809534a816d30494a1a2a9108e34e77aa: Status 404 returned error can't find the container with id 2303c6120a93d2f038093105067f463809534a816d30494a1a2a9108e34e77aa
Jul 07 19:02:17.686068 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.685986    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:17.713684 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.713656    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-fkr88"]
Jul 07 19:02:17.717354 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:17.717331    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15799ca_50bc_447b_8ff2_d9b4f9ee440e.slice/crio-6bb3aa3809aa4d1a119ad7e439ec9fce013fce66609cb3cccf5d3ef1c4bbbf1e WatchSource:0}: Error finding container 6bb3aa3809aa4d1a119ad7e439ec9fce013fce66609cb3cccf5d3ef1c4bbbf1e: Status 404 returned error can't find the container with id 6bb3aa3809aa4d1a119ad7e439ec9fce013fce66609cb3cccf5d3ef1c4bbbf1e
Jul 07 19:02:17.729063 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.729037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-fkr88" event={"ID":"f15799ca-50bc-447b-8ff2-d9b4f9ee440e","Type":"ContainerStarted","Data":"6bb3aa3809aa4d1a119ad7e439ec9fce013fce66609cb3cccf5d3ef1c4bbbf1e"}
Jul 07 19:02:17.730243 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.730214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76" event={"ID":"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73","Type":"ContainerStarted","Data":"2303c6120a93d2f038093105067f463809534a816d30494a1a2a9108e34e77aa"}
Jul 07 19:02:17.731766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.731741    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm" event={"ID":"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c","Type":"ContainerStarted","Data":"dbfeca2f21cb296aec2d63bc1f999d624b3b21641b150239659920ece7f0b51d"}
Jul 07 19:02:17.811267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:17.811242    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5858cf7c49-2tfl6"]
Jul 07 19:02:17.813581 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:17.813546    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfc70f2_5b5e_49bd_af18_b28a1338d17e.slice/crio-f8c23a5216d11c768a3cdff97babce48baf34770f3fdc6dac94e7423ac243270 WatchSource:0}: Error finding container f8c23a5216d11c768a3cdff97babce48baf34770f3fdc6dac94e7423ac243270: Status 404 returned error can't find the container with id f8c23a5216d11c768a3cdff97babce48baf34770f3fdc6dac94e7423ac243270
Jul 07 19:02:18.702677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:18.702644    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rp677"
Jul 07 19:02:18.752457 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:18.752423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6" event={"ID":"fbfc70f2-5b5e-49bd-af18-b28a1338d17e","Type":"ContainerStarted","Data":"d3314fedf282a6a05179f86f3e0809b365c92d78069bdee351d7dc54448a1155"}
Jul 07 19:02:18.752782 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:18.752761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6" event={"ID":"fbfc70f2-5b5e-49bd-af18-b28a1338d17e","Type":"ContainerStarted","Data":"f8c23a5216d11c768a3cdff97babce48baf34770f3fdc6dac94e7423ac243270"}
Jul 07 19:02:18.752964 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:18.752950    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:18.773260 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:18.772798    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6" podStartSLOduration=1.7727765720000002 podStartE2EDuration="1.772776572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:18.771434975 +0000 UTC m=+63.911809155" watchObservedRunningTime="2026-07-07 19:02:18.772776572 +0000 UTC m=+63.913150731"
Jul 07 19:02:19.758153 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:19.758101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm" event={"ID":"12b194d0-ab4a-47f9-ab3f-ce3abe41c87c","Type":"ContainerStarted","Data":"c618f40cc484ebdfb89c74c4837f6493dbe03474d98c8dde60b75da19d2f86bf"}
Jul 07 19:02:19.774825 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:19.774762    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hz6fm" podStartSLOduration=1.460542775 podStartE2EDuration="2.77474166s" totalImagesPullingTime="1.314198885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:19.773633217 +0000 UTC m=+64.914007410" watchObservedRunningTime="2026-07-07 19:02:19.77474166 +0000 UTC m=+64.915115838"
Jul 07 19:02:20.763377 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:20.763334    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76" event={"ID":"83cdcc94-57cc-4852-9b1f-89fd1d0ccb73","Type":"ContainerStarted","Data":"2fa6cb9aca41562952b8afb0aec3e0829cc3b36fa1a160c9168e8f2e8fac4d4c"}
Jul 07 19:02:20.783452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:20.783400    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8b76bf88-2bp76" podStartSLOduration=1.232797527 podStartE2EDuration="3.783381048s" totalImagesPullingTime="2.550583521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:20.782697475 +0000 UTC m=+65.923071645" watchObservedRunningTime="2026-07-07 19:02:20.783381048 +0000 UTC m=+65.923755231"
Jul 07 19:02:21.144635 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.144593    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:02:21.144824 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.144674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:02:21.146990 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.146964    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 19:02:21.147114 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.146979    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 19:02:21.157094 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.157065    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 19:02:21.157590 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.157568    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a29a0a-c624-45b8-a4d4-c047a976eff4-metrics-certs\") pod \"network-metrics-daemon-fnlx2\" (UID: \"20a29a0a-c624-45b8-a4d4-c047a976eff4\") " pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:02:21.168387 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.168368    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fpvh\" (UniqueName: \"kubernetes.io/projected/d2842b5e-28e5-43fc-a6b6-a470a7e1f548-kube-api-access-6fpvh\") pod \"network-check-target-vclgj\" (UID: \"d2842b5e-28e5-43fc-a6b6-a470a7e1f548\") " pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:02:21.245260 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.245229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:02:21.247469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.247453    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 19:02:21.258232 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.258207    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a03e1d90-67f3-4f8a-a185-0f542e623f54-original-pull-secret\") pod \"global-pull-secret-syncer-wm5f9\" (UID: \"a03e1d90-67f3-4f8a-a185-0f542e623f54\") " pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:02:21.309779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.309753    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm5f9"
Jul 07 19:02:21.320335 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.320314    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-546ff\""
Jul 07 19:02:21.326495 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.326472    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g87lc\""
Jul 07 19:02:21.328107 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.328089    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:02:21.335170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.335147    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnlx2"
Jul 07 19:02:21.468037 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.467981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wm5f9"]
Jul 07 19:02:21.471624 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:21.471596    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03e1d90_67f3_4f8a_a185_0f542e623f54.slice/crio-3fc8335285e7ba55c970ef76f9ac780c48dc4f49b5e356805d72fac9dcf4e4dc WatchSource:0}: Error finding container 3fc8335285e7ba55c970ef76f9ac780c48dc4f49b5e356805d72fac9dcf4e4dc: Status 404 returned error can't find the container with id 3fc8335285e7ba55c970ef76f9ac780c48dc4f49b5e356805d72fac9dcf4e4dc
Jul 07 19:02:21.498425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.498281    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fnlx2"]
Jul 07 19:02:21.501393 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:21.501369    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a29a0a_c624_45b8_a4d4_c047a976eff4.slice/crio-2f51f00253092b4a7834abe09ca19ab2ac724c04c11d3f085c2d3cb447665a00 WatchSource:0}: Error finding container 2f51f00253092b4a7834abe09ca19ab2ac724c04c11d3f085c2d3cb447665a00: Status 404 returned error can't find the container with id 2f51f00253092b4a7834abe09ca19ab2ac724c04c11d3f085c2d3cb447665a00
Jul 07 19:02:21.512616 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.512591    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vclgj"]
Jul 07 19:02:21.515069 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:21.515049    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2842b5e_28e5_43fc_a6b6_a470a7e1f548.slice/crio-878d14404b7e9fb329a5b47c3c91760246bcff99d6d1414e336224e62127c116 WatchSource:0}: Error finding container 878d14404b7e9fb329a5b47c3c91760246bcff99d6d1414e336224e62127c116: Status 404 returned error can't find the container with id 878d14404b7e9fb329a5b47c3c91760246bcff99d6d1414e336224e62127c116
Jul 07 19:02:21.767659 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.767572    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vclgj" event={"ID":"d2842b5e-28e5-43fc-a6b6-a470a7e1f548","Type":"ContainerStarted","Data":"878d14404b7e9fb329a5b47c3c91760246bcff99d6d1414e336224e62127c116"}
Jul 07 19:02:21.768765 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.768739    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wm5f9" event={"ID":"a03e1d90-67f3-4f8a-a185-0f542e623f54","Type":"ContainerStarted","Data":"3fc8335285e7ba55c970ef76f9ac780c48dc4f49b5e356805d72fac9dcf4e4dc"}
Jul 07 19:02:21.769761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:21.769743    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnlx2" event={"ID":"20a29a0a-c624-45b8-a4d4-c047a976eff4","Type":"ContainerStarted","Data":"2f51f00253092b4a7834abe09ca19ab2ac724c04c11d3f085c2d3cb447665a00"}
Jul 07 19:02:23.780681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:23.780633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnlx2" event={"ID":"20a29a0a-c624-45b8-a4d4-c047a976eff4","Type":"ContainerStarted","Data":"c22236818d2103f835720140b3f4c25d238dbe268754438281b46e4cc58e6ff3"}
Jul 07 19:02:24.098317 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.098286    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"]
Jul 07 19:02:24.118771 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.118691    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"]
Jul 07 19:02:24.118771 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.118762    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.121709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.121684    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 19:02:24.121709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.121691    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 19:02:24.122654 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.122632    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 19:02:24.123006 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.122855    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 19:02:24.123006 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.122911    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 19:02:24.123132 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.123066    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dldwb\""
Jul 07 19:02:24.268965 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.268934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.269153 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.268982    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.269153 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.269023    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e6fc1c-508a-48b6-82c9-9caf409ca091-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.269153 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.269063    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtxl\" (UniqueName: \"kubernetes.io/projected/d2e6fc1c-508a-48b6-82c9-9caf409ca091-kube-api-access-sdtxl\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.277491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.277460    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd45dd749-99qkv"]
Jul 07 19:02:24.298252 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.298218    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd45dd749-99qkv"]
Jul 07 19:02:24.298369 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.298337    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.301530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.301281    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 19:02:24.301530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.301307    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 19:02:24.301530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.301337    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 19:02:24.301530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.301368    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 19:02:24.301530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.301343    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t59jx\""
Jul 07 19:02:24.301530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.301462    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 19:02:24.369610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtxl\" (UniqueName: \"kubernetes.io/projected/d2e6fc1c-508a-48b6-82c9-9caf409ca091-kube-api-access-sdtxl\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.369772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369609    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-service-ca\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.369772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-oauth-config\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.369772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-config\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.369930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkgrc\" (UniqueName: \"kubernetes.io/projected/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-kube-api-access-zkgrc\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.369930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369813    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.369930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-oauth-serving-cert\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.369930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369884    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.369930 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:24.369913    2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 19:02:24.370158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.369912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-serving-cert\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.370158 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:24.369974    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-tls podName:d2e6fc1c-508a-48b6-82c9-9caf409ca091 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:24.869954757 +0000 UTC m=+70.010328917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-btvf2" (UID: "d2e6fc1c-508a-48b6-82c9-9caf409ca091") : secret "prometheus-operator-tls" not found
Jul 07 19:02:24.370158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.370019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e6fc1c-508a-48b6-82c9-9caf409ca091-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.370840 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.370795    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e6fc1c-508a-48b6-82c9-9caf409ca091-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.372812 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.372786    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.378912 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.378829    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtxl\" (UniqueName: \"kubernetes.io/projected/d2e6fc1c-508a-48b6-82c9-9caf409ca091-kube-api-access-sdtxl\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.471302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-service-ca\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.471302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-oauth-config\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.471485 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-config\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.471485 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkgrc\" (UniqueName: \"kubernetes.io/projected/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-kube-api-access-zkgrc\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.471485 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471393    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-oauth-serving-cert\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.471485 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471424    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-serving-cert\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.472028 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.471997    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-service-ca\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.472140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.472008    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-config\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.472194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.472149    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-oauth-serving-cert\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.474252 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.474230    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-oauth-config\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.474306 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.474265    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-serving-cert\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.478978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.478954    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkgrc\" (UniqueName: \"kubernetes.io/projected/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-kube-api-access-zkgrc\") pod \"console-7bd45dd749-99qkv\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") " pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.611868 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.611574    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:24.786840 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.786798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnlx2" event={"ID":"20a29a0a-c624-45b8-a4d4-c047a976eff4","Type":"ContainerStarted","Data":"3f8ddd0e9b112cc789c2db6adcbc4bc4a2b83a077e80ea9ad01578f1278c121b"}
Jul 07 19:02:24.803495 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.803434    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fnlx2" podStartSLOduration=67.842476626 podStartE2EDuration="1m9.803414065s" totalImagesPullingTime="1.960937439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:24.803286563 +0000 UTC m=+69.943660740" watchObservedRunningTime="2026-07-07 19:02:24.803414065 +0000 UTC m=+69.943788244"
Jul 07 19:02:24.874847 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.874810    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:24.878068 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:24.878040    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2e6fc1c-508a-48b6-82c9-9caf409ca091-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-btvf2\" (UID: \"d2e6fc1c-508a-48b6-82c9-9caf409ca091\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:25.031191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:25.031114    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"
Jul 07 19:02:25.732887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:25.732787    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2"]
Jul 07 19:02:25.751349 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:25.751314    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd45dd749-99qkv"]
Jul 07 19:02:25.793691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:25.793624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vclgj" event={"ID":"d2842b5e-28e5-43fc-a6b6-a470a7e1f548","Type":"ContainerStarted","Data":"e649da6afb0dbd2f3c7bcdbfb9d0690ebf77744e99ca0366cc0473af7db5ad93"}
Jul 07 19:02:25.794636 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:25.794610    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:02:25.811329 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:25.811269    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vclgj" podStartSLOduration=66.709741403 podStartE2EDuration="1m10.81124827s" totalImagesPullingTime="4.101506867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:25.810190147 +0000 UTC m=+70.950564323" watchObservedRunningTime="2026-07-07 19:02:25.81124827 +0000 UTC m=+70.951622450"
Jul 07 19:02:27.218921 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:27.218892    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:27.321298 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:27.321232    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e6fc1c_508a_48b6_82c9_9caf409ca091.slice/crio-91eb0cf1e1bedaa9f6edab9de58125632cc84d2c040d63184f0d9f6367d8f794 WatchSource:0}: Error finding container 91eb0cf1e1bedaa9f6edab9de58125632cc84d2c040d63184f0d9f6367d8f794: Status 404 returned error can't find the container with id 91eb0cf1e1bedaa9f6edab9de58125632cc84d2c040d63184f0d9f6367d8f794
Jul 07 19:02:27.322117 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:27.322087    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1250dfc_0494_4448_af3b_f8b58f9cd0e4.slice/crio-b542873806d11f49aa6d14139cb4c346fb29d4487d60926d0a8e3c7d682d3c1d WatchSource:0}: Error finding container b542873806d11f49aa6d14139cb4c346fb29d4487d60926d0a8e3c7d682d3c1d: Status 404 returned error can't find the container with id b542873806d11f49aa6d14139cb4c346fb29d4487d60926d0a8e3c7d682d3c1d
Jul 07 19:02:27.803582 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:27.803549    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd45dd749-99qkv" event={"ID":"c1250dfc-0494-4448-af3b-f8b58f9cd0e4","Type":"ContainerStarted","Data":"b542873806d11f49aa6d14139cb4c346fb29d4487d60926d0a8e3c7d682d3c1d"}
Jul 07 19:02:27.804943 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:27.804909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2" event={"ID":"d2e6fc1c-508a-48b6-82c9-9caf409ca091","Type":"ContainerStarted","Data":"91eb0cf1e1bedaa9f6edab9de58125632cc84d2c040d63184f0d9f6367d8f794"}
Jul 07 19:02:27.806376 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:27.806351    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wm5f9" event={"ID":"a03e1d90-67f3-4f8a-a185-0f542e623f54","Type":"ContainerStarted","Data":"956b12136f147c37b64c9a9ed5d9e0d439107319eeff09446c686c9065502966"}
Jul 07 19:02:27.824276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:27.824179    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wm5f9" podStartSLOduration=66.93973166399999 podStartE2EDuration="1m12.82416017s" totalImagesPullingTime="5.884428506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:27.822796762 +0000 UTC m=+72.963170942" watchObservedRunningTime="2026-07-07 19:02:27.82416017 +0000 UTC m=+72.964534348"
Jul 07 19:02:29.816900 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:29.816863    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2" event={"ID":"d2e6fc1c-508a-48b6-82c9-9caf409ca091","Type":"ContainerStarted","Data":"19b7cf6556ee8468794a284f36ccb6c449e6acc6c253b1ff416945f717e303dd"}
Jul 07 19:02:29.817322 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:29.816926    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2" event={"ID":"d2e6fc1c-508a-48b6-82c9-9caf409ca091","Type":"ContainerStarted","Data":"6093e4ee7a438831446a215ee6b6cc3596368ea566425ea75710e7d5749c552c"}
Jul 07 19:02:29.834796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:29.834736    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-btvf2" podStartSLOduration=4.141124151 podStartE2EDuration="5.834713874s" totalImagesPullingTime="1.693589723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:29.83379089 +0000 UTC m=+74.974165077" watchObservedRunningTime="2026-07-07 19:02:29.834713874 +0000 UTC m=+74.975088056"
Jul 07 19:02:31.561228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.561197    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"]
Jul 07 19:02:31.564107 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.564086    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.567161 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.567135    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-npjnn\""
Jul 07 19:02:31.567289 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.567208    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 19:02:31.567683 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.567661    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 19:02:31.588094 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.588070    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"]
Jul 07 19:02:31.603162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.603137    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"]
Jul 07 19:02:31.605567 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.605544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.607919 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.607900    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 19:02:31.608733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.608713    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 19:02:31.608834 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.608817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 19:02:31.609147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.609128    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x9ggf"]
Jul 07 19:02:31.609932 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.609912    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mbdm9\""
Jul 07 19:02:31.611593 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.611563    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.614067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.614047    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 19:02:31.614749 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.614689    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kc7z\""
Jul 07 19:02:31.614749 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.614729    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 19:02:31.615111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.615091    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 19:02:31.625168 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.625145    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"]
Jul 07 19:02:31.734299 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fb23e74-4e35-4076-ae31-7372982727a2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.734492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7fb23e74-4e35-4076-ae31-7372982727a2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.734492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-sys\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.734492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.734492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734409    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.734720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phpsr\" (UniqueName: \"kubernetes.io/projected/c9852e22-e9ef-4f1b-9128-69876c8663f6-kube-api-access-phpsr\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.734720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-tls\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.734720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9852e22-e9ef-4f1b-9128-69876c8663f6-metrics-client-ca\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.734720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.734720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734669    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.734720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734701    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.735022 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734775    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjjj\" (UniqueName: \"kubernetes.io/projected/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-kube-api-access-8pjjj\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.735022 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-742j8\" (UniqueName: \"kubernetes.io/projected/7fb23e74-4e35-4076-ae31-7372982727a2-kube-api-access-742j8\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.735022 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-root\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.735022 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-textfile\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.735022 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-wtmp\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.735022 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.734998    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.735275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.735038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.735275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.735064    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.826152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.826062    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd45dd749-99qkv" event={"ID":"c1250dfc-0494-4448-af3b-f8b58f9cd0e4","Type":"ContainerStarted","Data":"04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787"}
Jul 07 19:02:31.835741 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.835891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.835891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835772    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.835891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fb23e74-4e35-4076-ae31-7372982727a2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.835891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7fb23e74-4e35-4076-ae31-7372982727a2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.835891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-sys\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.835891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835877    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:31.835914    2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phpsr\" (UniqueName: \"kubernetes.io/projected/c9852e22-e9ef-4f1b-9128-69876c8663f6-kube-api-access-phpsr\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.835953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-tls\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:31.835979    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-tls podName:7fb23e74-4e35-4076-ae31-7372982727a2 nodeName:}" failed. No retries permitted until 2026-07-07 19:02:32.335959968 +0000 UTC m=+77.476334142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-gfspx" (UID: "7fb23e74-4e35-4076-ae31-7372982727a2") : secret "kube-state-metrics-tls" not found
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836017    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9852e22-e9ef-4f1b-9128-69876c8663f6-metrics-client-ca\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.836093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836122    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjjj\" (UniqueName: \"kubernetes.io/projected/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-kube-api-access-8pjjj\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836179    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-742j8\" (UniqueName: \"kubernetes.io/projected/7fb23e74-4e35-4076-ae31-7372982727a2-kube-api-access-742j8\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-root\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-textfile\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-wtmp\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836424    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-wtmp\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836739 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836599    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-root\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.836994 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.836948    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-textfile\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.837122 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.837042    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9852e22-e9ef-4f1b-9128-69876c8663f6-sys\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.837193 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.837141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7fb23e74-4e35-4076-ae31-7372982727a2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.838202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.837557    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9852e22-e9ef-4f1b-9128-69876c8663f6-metrics-client-ca\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.838202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.837557    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.838202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.837952    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fb23e74-4e35-4076-ae31-7372982727a2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.838202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.838041    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.838202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.838193    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.838915 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.838896    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.839015 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.838948    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.839577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.839559    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.839665 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.839621    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-tls\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.840379 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.840357    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9852e22-e9ef-4f1b-9128-69876c8663f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.847024 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.846979    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-742j8\" (UniqueName: \"kubernetes.io/projected/7fb23e74-4e35-4076-ae31-7372982727a2-kube-api-access-742j8\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:31.847437 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.847374    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phpsr\" (UniqueName: \"kubernetes.io/projected/c9852e22-e9ef-4f1b-9128-69876c8663f6-kube-api-access-phpsr\") pod \"node-exporter-x9ggf\" (UID: \"c9852e22-e9ef-4f1b-9128-69876c8663f6\") " pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:31.848048 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.848022    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjjj\" (UniqueName: \"kubernetes.io/projected/cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc-kube-api-access-8pjjj\") pod \"openshift-state-metrics-54cf96dfcf-fkrg7\" (UID: \"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.856694 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.856647    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd45dd749-99qkv" podStartSLOduration=4.224136217 podStartE2EDuration="7.856630547s" totalImagesPullingTime="3.63249433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:31.855485613 +0000 UTC m=+76.995859816" watchObservedRunningTime="2026-07-07 19:02:31.856630547 +0000 UTC m=+76.997004725"
Jul 07 19:02:31.874737 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.874714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"
Jul 07 19:02:31.924179 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:31.924148    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x9ggf"
Jul 07 19:02:32.075960 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.075922    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c57f578c5-pr8pr"]
Jul 07 19:02:32.078449 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.078389    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.086926 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.086880    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 19:02:32.096881 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.096853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c57f578c5-pr8pr"]
Jul 07 19:02:32.239195 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-oauth-serving-cert\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.239195 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxnsj\" (UniqueName: \"kubernetes.io/projected/60e4685c-e605-4d56-a097-c9a2246ba8d1-kube-api-access-nxnsj\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.239445 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-serving-cert\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.239445 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-oauth-config\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.239445 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-config\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.239445 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-trusted-ca-bundle\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.239636 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.239444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-service-ca\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340400 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:32.340610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-serving-cert\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-oauth-config\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-config\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-trusted-ca-bundle\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-service-ca\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-oauth-serving-cert\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.340879 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.340642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxnsj\" (UniqueName: \"kubernetes.io/projected/60e4685c-e605-4d56-a097-c9a2246ba8d1-kube-api-access-nxnsj\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.341701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.341669    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-service-ca\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.341820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.341730    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-oauth-serving-cert\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.341820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.341730    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-config\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.341931 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.341819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-trusted-ca-bundle\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.343396 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.343374    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-serving-cert\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.343500 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.343423    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fb23e74-4e35-4076-ae31-7372982727a2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-gfspx\" (UID: \"7fb23e74-4e35-4076-ae31-7372982727a2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:32.343796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.343768    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-oauth-config\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.351089 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.351067    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxnsj\" (UniqueName: \"kubernetes.io/projected/60e4685c-e605-4d56-a097-c9a2246ba8d1-kube-api-access-nxnsj\") pod \"console-c57f578c5-pr8pr\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") " pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.389965 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.389932    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:32.518326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:32.518295    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"
Jul 07 19:02:34.612713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:34.612624    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:34.612713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:34.612692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:34.618276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:34.618249    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:34.842346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:34.842313    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:02:36.255123 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.255093    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"]
Jul 07 19:02:36.406275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.406239    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"]
Jul 07 19:02:36.406452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.406353    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.408854 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.408787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 19:02:36.408996 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.408873    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4pjch\""
Jul 07 19:02:36.583278 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.583202    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq29z\" (UniqueName: \"kubernetes.io/projected/0a72389e-2e19-4bb1-9493-fe48d7c7e01d-kube-api-access-nq29z\") pod \"monitoring-plugin-d5dcff7cf-dqthb\" (UID: \"0a72389e-2e19-4bb1-9493-fe48d7c7e01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.583278 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.583264    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a72389e-2e19-4bb1-9493-fe48d7c7e01d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-dqthb\" (UID: \"0a72389e-2e19-4bb1-9493-fe48d7c7e01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.683792 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.683758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq29z\" (UniqueName: \"kubernetes.io/projected/0a72389e-2e19-4bb1-9493-fe48d7c7e01d-kube-api-access-nq29z\") pod \"monitoring-plugin-d5dcff7cf-dqthb\" (UID: \"0a72389e-2e19-4bb1-9493-fe48d7c7e01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.683983 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.683814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a72389e-2e19-4bb1-9493-fe48d7c7e01d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-dqthb\" (UID: \"0a72389e-2e19-4bb1-9493-fe48d7c7e01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.686723 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.686691    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a72389e-2e19-4bb1-9493-fe48d7c7e01d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-dqthb\" (UID: \"0a72389e-2e19-4bb1-9493-fe48d7c7e01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.696425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.696399    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq29z\" (UniqueName: \"kubernetes.io/projected/0a72389e-2e19-4bb1-9493-fe48d7c7e01d-kube-api-access-nq29z\") pod \"monitoring-plugin-d5dcff7cf-dqthb\" (UID: \"0a72389e-2e19-4bb1-9493-fe48d7c7e01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:36.717442 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:36.717416    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:37.491923 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:37.491871    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c57f578c5-pr8pr"]
Jul 07 19:02:38.410164 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:38.409955    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9852e22_e9ef_4f1b_9128_69876c8663f6.slice/crio-fce42a466c28d8b2bbfb10505ddff907fb4db15571fcdbdc28b7f6d08716a7cb WatchSource:0}: Error finding container fce42a466c28d8b2bbfb10505ddff907fb4db15571fcdbdc28b7f6d08716a7cb: Status 404 returned error can't find the container with id fce42a466c28d8b2bbfb10505ddff907fb4db15571fcdbdc28b7f6d08716a7cb
Jul 07 19:02:38.557012 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.556837    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx"]
Jul 07 19:02:38.560722 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:38.560686    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb23e74_4e35_4076_ae31_7372982727a2.slice/crio-68fe82ef0769eb2d71ce00564a4b1dfe0f68239e4c9295a4981e689499f4d256 WatchSource:0}: Error finding container 68fe82ef0769eb2d71ce00564a4b1dfe0f68239e4c9295a4981e689499f4d256: Status 404 returned error can't find the container with id 68fe82ef0769eb2d71ce00564a4b1dfe0f68239e4c9295a4981e689499f4d256
Jul 07 19:02:38.575219 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.575191    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c57f578c5-pr8pr"]
Jul 07 19:02:38.751954 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:38.751883    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e4685c_e605_4d56_a097_c9a2246ba8d1.slice/crio-5af53be9d7a518b14b8c1b2035b764221efd7a9a7c1c09142c49196f0684eaee WatchSource:0}: Error finding container 5af53be9d7a518b14b8c1b2035b764221efd7a9a7c1c09142c49196f0684eaee: Status 404 returned error can't find the container with id 5af53be9d7a518b14b8c1b2035b764221efd7a9a7c1c09142c49196f0684eaee
Jul 07 19:02:38.796957 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.796854    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7"]
Jul 07 19:02:38.799695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.799677    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"]
Jul 07 19:02:38.812689 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:38.812644    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb1bcb2_bcee_4f96_91df_35e4eb2a29cc.slice/crio-8a2b766c6d2f1a9d87a5a2b742224160de01eed909582a6671c8326d817b05d8 WatchSource:0}: Error finding container 8a2b766c6d2f1a9d87a5a2b742224160de01eed909582a6671c8326d817b05d8: Status 404 returned error can't find the container with id 8a2b766c6d2f1a9d87a5a2b742224160de01eed909582a6671c8326d817b05d8
Jul 07 19:02:38.812890 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:38.812850    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a72389e_2e19_4bb1_9493_fe48d7c7e01d.slice/crio-e7b1e4fcc5f69e94d66af50b25a5dee47e800116d93c1b7dcf7c7b4ca94d2293 WatchSource:0}: Error finding container e7b1e4fcc5f69e94d66af50b25a5dee47e800116d93c1b7dcf7c7b4ca94d2293: Status 404 returned error can't find the container with id e7b1e4fcc5f69e94d66af50b25a5dee47e800116d93c1b7dcf7c7b4ca94d2293
Jul 07 19:02:38.855876 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.855846    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57f578c5-pr8pr" event={"ID":"60e4685c-e605-4d56-a097-c9a2246ba8d1","Type":"ContainerStarted","Data":"5af53be9d7a518b14b8c1b2035b764221efd7a9a7c1c09142c49196f0684eaee"}
Jul 07 19:02:38.858587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.858548    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7" event={"ID":"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc","Type":"ContainerStarted","Data":"8a2b766c6d2f1a9d87a5a2b742224160de01eed909582a6671c8326d817b05d8"}
Jul 07 19:02:38.860064 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.860039    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx" event={"ID":"7fb23e74-4e35-4076-ae31-7372982727a2","Type":"ContainerStarted","Data":"68fe82ef0769eb2d71ce00564a4b1dfe0f68239e4c9295a4981e689499f4d256"}
Jul 07 19:02:38.861557 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.861533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9ggf" event={"ID":"c9852e22-e9ef-4f1b-9128-69876c8663f6","Type":"ContainerStarted","Data":"fce42a466c28d8b2bbfb10505ddff907fb4db15571fcdbdc28b7f6d08716a7cb"}
Jul 07 19:02:38.862774 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:38.862755    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb" event={"ID":"0a72389e-2e19-4bb1-9493-fe48d7c7e01d","Type":"ContainerStarted","Data":"e7b1e4fcc5f69e94d66af50b25a5dee47e800116d93c1b7dcf7c7b4ca94d2293"}
Jul 07 19:02:39.870540 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.870096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57f578c5-pr8pr" event={"ID":"60e4685c-e605-4d56-a097-c9a2246ba8d1","Type":"ContainerStarted","Data":"d3e4d54a0293195dcc06f962990e53f5c3ccdf8e4fa2ed6e48c9e813f0c0376e"}
Jul 07 19:02:39.878005 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.877972    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7" event={"ID":"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc","Type":"ContainerStarted","Data":"bce160ed3f4ace8a11f1db46fab956cfb9c7878f477c0dbc19e91d495fae5f9a"}
Jul 07 19:02:39.878284 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.878250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7" event={"ID":"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc","Type":"ContainerStarted","Data":"f0ba8ddaeaf7f1d2d86ff97213648b052f4eaae8c9d2138c09aa9f7897b78847"}
Jul 07 19:02:39.881404 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.881376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-fkr88" event={"ID":"f15799ca-50bc-447b-8ff2-d9b4f9ee440e","Type":"ContainerStarted","Data":"59c6eec0b325e1a4ab0594f95038ff5fdfca011e8161804bd8ddd9293c5308a3"}
Jul 07 19:02:39.883723 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.883620    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:39.890584 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.890110    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c57f578c5-pr8pr" podStartSLOduration=7.890091978 podStartE2EDuration="7.890091978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:39.88932664 +0000 UTC m=+85.029700820" watchObservedRunningTime="2026-07-07 19:02:39.890091978 +0000 UTC m=+85.030466137"
Jul 07 19:02:39.896872 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.896827    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-fkr88"
Jul 07 19:02:39.912951 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:39.912894    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-fkr88" podStartSLOduration=1.8230507440000001 podStartE2EDuration="22.912879684s" totalImagesPullingTime="21.08982894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:39.911059418 +0000 UTC m=+85.051433599" watchObservedRunningTime="2026-07-07 19:02:39.912879684 +0000 UTC m=+85.053253879"
Jul 07 19:02:40.771375 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:40.771339    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5858cf7c49-2tfl6"
Jul 07 19:02:41.444448 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.444415    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d8f675f95-v4pp6"]
Jul 07 19:02:41.471908 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.471870    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8f675f95-v4pp6"]
Jul 07 19:02:41.472083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.471998    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.631562 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mk6t\" (UniqueName: \"kubernetes.io/projected/15eda52a-06a5-480f-8970-885d5179d07d-kube-api-access-8mk6t\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.631761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631601    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-console-config\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.631761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-trusted-ca-bundle\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.631761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-serving-cert\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.631761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631688    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-service-ca\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.631761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-oauth-config\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.632031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.631779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-oauth-serving-cert\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732381 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732346    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-oauth-config\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732381 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-oauth-serving-cert\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732659 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mk6t\" (UniqueName: \"kubernetes.io/projected/15eda52a-06a5-480f-8970-885d5179d07d-kube-api-access-8mk6t\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732659 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-console-config\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732659 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732619    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-trusted-ca-bundle\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732659 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-serving-cert\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.732858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.732674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-service-ca\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.733397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.733363    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-console-config\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.733669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.733541    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-oauth-serving-cert\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.734017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.733967    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-service-ca\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.734327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.734297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-trusted-ca-bundle\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.735272 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.735247    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-oauth-config\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.735608 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.735586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-serving-cert\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.741402 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.741372    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mk6t\" (UniqueName: \"kubernetes.io/projected/15eda52a-06a5-480f-8970-885d5179d07d-kube-api-access-8mk6t\") pod \"console-6d8f675f95-v4pp6\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") " pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:41.783326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:41.783286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:42.003062 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.003032    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8f675f95-v4pp6"]
Jul 07 19:02:42.005908 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:02:42.005877    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15eda52a_06a5_480f_8970_885d5179d07d.slice/crio-634ff67359697ee787c7692f21a333f62ecbebaa0227692a17ad81160c4c0fcd WatchSource:0}: Error finding container 634ff67359697ee787c7692f21a333f62ecbebaa0227692a17ad81160c4c0fcd: Status 404 returned error can't find the container with id 634ff67359697ee787c7692f21a333f62ecbebaa0227692a17ad81160c4c0fcd
Jul 07 19:02:42.232257 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.232217    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78b694fd75-svnpd" podUID="c142468a-5d8a-4c69-abf9-3466a837cb9f" containerName="registry" containerID="cri-o://229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d" gracePeriod=30
Jul 07 19:02:42.390883 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.390692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:02:42.573878 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.573601    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:42.740017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.739930    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-bound-sa-token\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740008    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c142468a-5d8a-4c69-abf9-3466a837cb9f-ca-trust-extracted\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740041    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-image-registry-private-configuration\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740099    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvzvj\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-kube-api-access-tvzvj\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740145    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-installation-pull-secrets\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-certificates\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740189    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740215    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-trusted-ca\") pod \"c142468a-5d8a-4c69-abf9-3466a837cb9f\" (UID: \"c142468a-5d8a-4c69-abf9-3466a837cb9f\") "
Jul 07 19:02:42.740885 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740783    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:02:42.740885 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.740796    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:02:42.745710 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.745632    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-kube-api-access-tvzvj" (OuterVolumeSpecName: "kube-api-access-tvzvj") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "kube-api-access-tvzvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:02:42.745865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.745737    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:02:42.745865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.745831    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:02:42.746119 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.746097    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:02:42.747295 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.747257    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:02:42.753683 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.752842    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c142468a-5d8a-4c69-abf9-3466a837cb9f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c142468a-5d8a-4c69-abf9-3466a837cb9f" (UID: "c142468a-5d8a-4c69-abf9-3466a837cb9f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:02:42.840855 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840820    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-installation-pull-secrets\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.840855 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840850    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-certificates\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.841120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840868    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-registry-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.841120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840882    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c142468a-5d8a-4c69-abf9-3466a837cb9f-trusted-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.841120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840895    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-bound-sa-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.841120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840908    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c142468a-5d8a-4c69-abf9-3466a837cb9f-ca-trust-extracted\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.841120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840923    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c142468a-5d8a-4c69-abf9-3466a837cb9f-image-registry-private-configuration\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.841120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.840934    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvzvj\" (UniqueName: \"kubernetes.io/projected/c142468a-5d8a-4c69-abf9-3466a837cb9f-kube-api-access-tvzvj\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:02:42.905272 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.905233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx" event={"ID":"7fb23e74-4e35-4076-ae31-7372982727a2","Type":"ContainerStarted","Data":"421d09f8bf581acc4fc155b49634106782d8f561e748cc19d5e6bb7ef2926c8e"}
Jul 07 19:02:42.905462 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.905302    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx" event={"ID":"7fb23e74-4e35-4076-ae31-7372982727a2","Type":"ContainerStarted","Data":"78efb0278729a242129b10a3b1367b6e56a2cfa8b2c8597a9218d5cb46d7f017"}
Jul 07 19:02:42.905462 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.905330    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx" event={"ID":"7fb23e74-4e35-4076-ae31-7372982727a2","Type":"ContainerStarted","Data":"967d8eca2a6b8a4261d3702ee23a8682cad2463bfbc9a5625e4955ab9fc3f99e"}
Jul 07 19:02:42.908142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.908108    2569 generic.go:356] "Generic (PLEG): container finished" podID="c9852e22-e9ef-4f1b-9128-69876c8663f6" containerID="824b2f3e0b20d8848a784abc46106b5cbf5d22831fa02e05feaee19eba5f3bcd" exitCode=0
Jul 07 19:02:42.908264 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.908223    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9ggf" event={"ID":"c9852e22-e9ef-4f1b-9128-69876c8663f6","Type":"ContainerDied","Data":"824b2f3e0b20d8848a784abc46106b5cbf5d22831fa02e05feaee19eba5f3bcd"}
Jul 07 19:02:42.911949 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.911922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8f675f95-v4pp6" event={"ID":"15eda52a-06a5-480f-8970-885d5179d07d","Type":"ContainerStarted","Data":"f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682"}
Jul 07 19:02:42.912047 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.911970    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8f675f95-v4pp6" event={"ID":"15eda52a-06a5-480f-8970-885d5179d07d","Type":"ContainerStarted","Data":"634ff67359697ee787c7692f21a333f62ecbebaa0227692a17ad81160c4c0fcd"}
Jul 07 19:02:42.914256 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.914193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb" event={"ID":"0a72389e-2e19-4bb1-9493-fe48d7c7e01d","Type":"ContainerStarted","Data":"3df76576b70cb882dd661d646931d0bf62333baee2eff04e0a96fa5432b35b39"}
Jul 07 19:02:42.914428 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.914387    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:42.918731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.918415    2569 generic.go:356] "Generic (PLEG): container finished" podID="c142468a-5d8a-4c69-abf9-3466a837cb9f" containerID="229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d" exitCode=0
Jul 07 19:02:42.918731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.918501    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b694fd75-svnpd" event={"ID":"c142468a-5d8a-4c69-abf9-3466a837cb9f","Type":"ContainerDied","Data":"229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d"}
Jul 07 19:02:42.918731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.918569    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b694fd75-svnpd" event={"ID":"c142468a-5d8a-4c69-abf9-3466a837cb9f","Type":"ContainerDied","Data":"5a70355c09ca541261bf7578e378f9ef3ebf2ed6c9ce43ce7e61ba1f89db496a"}
Jul 07 19:02:42.918731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.918616    2569 scope.go:117] "RemoveContainer" containerID="229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d"
Jul 07 19:02:42.918731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.918633    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b694fd75-svnpd"
Jul 07 19:02:42.927698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.927064    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb"
Jul 07 19:02:42.927698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.927461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7" event={"ID":"cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc","Type":"ContainerStarted","Data":"4dd44aa78c6355410cb3310c2ba679a0004c4c59458d8eeac3c06a91f531e2f5"}
Jul 07 19:02:42.947740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.947677    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-gfspx" podStartSLOduration=8.679269597 podStartE2EDuration="11.947653623s" totalImagesPullingTime="3.268384026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:42.928934068 +0000 UTC m=+88.069308252" watchObservedRunningTime="2026-07-07 19:02:42.947653623 +0000 UTC m=+88.088027805"
Jul 07 19:02:42.950088 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.948494    2569 scope.go:117] "RemoveContainer" containerID="229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d"
Jul 07 19:02:42.950088 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:02:42.948971    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d\": container with ID starting with 229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d not found: ID does not exist" containerID="229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d"
Jul 07 19:02:42.950088 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:42.949003    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d"} err="failed to get container status \"229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d\": rpc error: code = NotFound desc = could not find container \"229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d\": container with ID starting with 229acb025cf5b7d020c6ce850e7c28dba7300b6dea98ff3699fc89e3573ef94d not found: ID does not exist"
Jul 07 19:02:43.006087 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.005998    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-dqthb" podStartSLOduration=3.987229036 podStartE2EDuration="7.005977939s" totalImagesPullingTime="3.018748903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:43.004612618 +0000 UTC m=+88.144986814" watchObservedRunningTime="2026-07-07 19:02:43.005977939 +0000 UTC m=+88.146352119"
Jul 07 19:02:43.041759 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.040667    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fkrg7" podStartSLOduration=8.862666792 podStartE2EDuration="12.040646448s" totalImagesPullingTime="3.177979656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:43.038884288 +0000 UTC m=+88.179258468" watchObservedRunningTime="2026-07-07 19:02:43.040646448 +0000 UTC m=+88.181020630"
Jul 07 19:02:43.064223 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.063700    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d8f675f95-v4pp6" podStartSLOduration=2.063678229 podStartE2EDuration="2.063678229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:43.062137331 +0000 UTC m=+88.202511511" watchObservedRunningTime="2026-07-07 19:02:43.063678229 +0000 UTC m=+88.204052411"
Jul 07 19:02:43.088567 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.088480    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b694fd75-svnpd"]
Jul 07 19:02:43.092169 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.092143    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78b694fd75-svnpd"]
Jul 07 19:02:43.492816 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.492780    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c142468a-5d8a-4c69-abf9-3466a837cb9f" path="/var/lib/kubelet/pods/c142468a-5d8a-4c69-abf9-3466a837cb9f/volumes"
Jul 07 19:02:43.935558 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.935522    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9ggf" event={"ID":"c9852e22-e9ef-4f1b-9128-69876c8663f6","Type":"ContainerStarted","Data":"aeac6fef42b8927d8f78a5ad8f9dc9f916bf0395417b31086b812c12715f4427"}
Jul 07 19:02:43.936170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.935586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9ggf" event={"ID":"c9852e22-e9ef-4f1b-9128-69876c8663f6","Type":"ContainerStarted","Data":"edb621590d7612775683b4863ea76b993ffe991fc8baee1dd7ed5f2d3d45e6e2"}
Jul 07 19:02:43.956677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:43.956611    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x9ggf" podStartSLOduration=9.424091448 podStartE2EDuration="12.95659108s" totalImagesPullingTime="3.41676508s" totalInitContainerRuntime="115.734552ms" isStatefulPod=true podCreationTimestamp="2026-07-07 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:43.955113259 +0000 UTC m=+89.095487451" watchObservedRunningTime="2026-07-07 19:02:43.95659108 +0000 UTC m=+89.096965264"
Jul 07 19:02:51.784055 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:51.784014    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:51.784593 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:51.784078    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:51.789501 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:51.789476    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:51.973339 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:51.973304    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:02:52.022950 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:52.022919    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd45dd749-99qkv"]
Jul 07 19:02:56.800634 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:02:56.800599    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vclgj"
Jul 07 19:03:04.899520 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:04.899439    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c57f578c5-pr8pr" podUID="60e4685c-e605-4d56-a097-c9a2246ba8d1" containerName="console" containerID="cri-o://d3e4d54a0293195dcc06f962990e53f5c3ccdf8e4fa2ed6e48c9e813f0c0376e" gracePeriod=15
Jul 07 19:03:05.018416 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.018386    2569 generic.go:356] "Generic (PLEG): container finished" podID="60e4685c-e605-4d56-a097-c9a2246ba8d1" containerID="d3e4d54a0293195dcc06f962990e53f5c3ccdf8e4fa2ed6e48c9e813f0c0376e" exitCode=0
Jul 07 19:03:05.018582 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.018433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57f578c5-pr8pr" event={"ID":"60e4685c-e605-4d56-a097-c9a2246ba8d1","Type":"ContainerDied","Data":"d3e4d54a0293195dcc06f962990e53f5c3ccdf8e4fa2ed6e48c9e813f0c0376e"}
Jul 07 19:03:05.174857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.174833    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:03:05.249380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249347    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-oauth-serving-cert\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249381    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-trusted-ca-bundle\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249398    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-oauth-config\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249417    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-config\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249578    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxnsj\" (UniqueName: \"kubernetes.io/projected/60e4685c-e605-4d56-a097-c9a2246ba8d1-kube-api-access-nxnsj\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249621    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-service-ca\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249788 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249701    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-serving-cert\") pod \"60e4685c-e605-4d56-a097-c9a2246ba8d1\" (UID: \"60e4685c-e605-4d56-a097-c9a2246ba8d1\") "
Jul 07 19:03:05.249842 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249793    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-config" (OuterVolumeSpecName: "console-config") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:05.249842 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.249804    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:05.250046 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.250014    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:05.250162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.250100    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-oauth-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:05.250162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.250121    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:05.250162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.250134    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:05.250325 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.250197    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:05.251758 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.251732    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e4685c-e605-4d56-a097-c9a2246ba8d1-kube-api-access-nxnsj" (OuterVolumeSpecName: "kube-api-access-nxnsj") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "kube-api-access-nxnsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:03:05.251838 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.251757    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:03:05.251838 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.251786    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "60e4685c-e605-4d56-a097-c9a2246ba8d1" (UID: "60e4685c-e605-4d56-a097-c9a2246ba8d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:03:05.351081 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.351044    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e4685c-e605-4d56-a097-c9a2246ba8d1-trusted-ca-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:05.351081 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.351075    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-oauth-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:05.351081 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.351085    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxnsj\" (UniqueName: \"kubernetes.io/projected/60e4685c-e605-4d56-a097-c9a2246ba8d1-kube-api-access-nxnsj\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:05.351284 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:05.351093    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60e4685c-e605-4d56-a097-c9a2246ba8d1-console-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:06.023622 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:06.023586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57f578c5-pr8pr" event={"ID":"60e4685c-e605-4d56-a097-c9a2246ba8d1","Type":"ContainerDied","Data":"5af53be9d7a518b14b8c1b2035b764221efd7a9a7c1c09142c49196f0684eaee"}
Jul 07 19:03:06.023622 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:06.023606    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57f578c5-pr8pr"
Jul 07 19:03:06.024146 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:06.023644    2569 scope.go:117] "RemoveContainer" containerID="d3e4d54a0293195dcc06f962990e53f5c3ccdf8e4fa2ed6e48c9e813f0c0376e"
Jul 07 19:03:06.039632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:06.039606    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c57f578c5-pr8pr"]
Jul 07 19:03:06.042702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:06.042675    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c57f578c5-pr8pr"]
Jul 07 19:03:07.493442 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:07.491306    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e4685c-e605-4d56-a097-c9a2246ba8d1" path="/var/lib/kubelet/pods/60e4685c-e605-4d56-a097-c9a2246ba8d1/volumes"
Jul 07 19:03:17.043258 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.043210    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bd45dd749-99qkv" podUID="c1250dfc-0494-4448-af3b-f8b58f9cd0e4" containerName="console" containerID="cri-o://04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787" gracePeriod=15
Jul 07 19:03:17.321571 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.321538    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:03:17.450722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.450688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-service-ca\") pod \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") "
Jul 07 19:03:17.450722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.450734    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-oauth-config\") pod \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") "
Jul 07 19:03:17.450936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.450760    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-config\") pod \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") "
Jul 07 19:03:17.450936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.450788    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-serving-cert\") pod \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") "
Jul 07 19:03:17.450936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.450884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkgrc\" (UniqueName: \"kubernetes.io/projected/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-kube-api-access-zkgrc\") pod \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") "
Jul 07 19:03:17.451059 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.450980    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-oauth-serving-cert\") pod \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\" (UID: \"c1250dfc-0494-4448-af3b-f8b58f9cd0e4\") "
Jul 07 19:03:17.451207 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.451170    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-config" (OuterVolumeSpecName: "console-config") pod "c1250dfc-0494-4448-af3b-f8b58f9cd0e4" (UID: "c1250dfc-0494-4448-af3b-f8b58f9cd0e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:17.451397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.451237    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "c1250dfc-0494-4448-af3b-f8b58f9cd0e4" (UID: "c1250dfc-0494-4448-af3b-f8b58f9cd0e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:17.451397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.451245    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:17.451482 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.451427    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c1250dfc-0494-4448-af3b-f8b58f9cd0e4" (UID: "c1250dfc-0494-4448-af3b-f8b58f9cd0e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:03:17.453109 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.453081    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c1250dfc-0494-4448-af3b-f8b58f9cd0e4" (UID: "c1250dfc-0494-4448-af3b-f8b58f9cd0e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:03:17.453109 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.453077    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-kube-api-access-zkgrc" (OuterVolumeSpecName: "kube-api-access-zkgrc") pod "c1250dfc-0494-4448-af3b-f8b58f9cd0e4" (UID: "c1250dfc-0494-4448-af3b-f8b58f9cd0e4"). InnerVolumeSpecName "kube-api-access-zkgrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:03:17.453248 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.453139    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c1250dfc-0494-4448-af3b-f8b58f9cd0e4" (UID: "c1250dfc-0494-4448-af3b-f8b58f9cd0e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:03:17.552701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.552624    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-oauth-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:17.552701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.552650    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:17.552701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.552660    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-oauth-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:17.552701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.552671    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-console-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:17.552701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:17.552683    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkgrc\" (UniqueName: \"kubernetes.io/projected/c1250dfc-0494-4448-af3b-f8b58f9cd0e4-kube-api-access-zkgrc\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:03:18.071257 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.071220    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1250dfc-0494-4448-af3b-f8b58f9cd0e4" containerID="04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787" exitCode=0
Jul 07 19:03:18.071763 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.071274    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd45dd749-99qkv"
Jul 07 19:03:18.071763 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.071305    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd45dd749-99qkv" event={"ID":"c1250dfc-0494-4448-af3b-f8b58f9cd0e4","Type":"ContainerDied","Data":"04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787"}
Jul 07 19:03:18.071763 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.071353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd45dd749-99qkv" event={"ID":"c1250dfc-0494-4448-af3b-f8b58f9cd0e4","Type":"ContainerDied","Data":"b542873806d11f49aa6d14139cb4c346fb29d4487d60926d0a8e3c7d682d3c1d"}
Jul 07 19:03:18.071763 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.071377    2569 scope.go:117] "RemoveContainer" containerID="04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787"
Jul 07 19:03:18.079103 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.079086    2569 scope.go:117] "RemoveContainer" containerID="04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787"
Jul 07 19:03:18.079431 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:03:18.079412    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787\": container with ID starting with 04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787 not found: ID does not exist" containerID="04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787"
Jul 07 19:03:18.079498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.079440    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787"} err="failed to get container status \"04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787\": rpc error: code = NotFound desc = could not find container \"04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787\": container with ID starting with 04ad72efe2f8a9f5c6168cb07bf4eed1b382afc5c39115e2deb461424c9d5787 not found: ID does not exist"
Jul 07 19:03:18.090138 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.090117    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd45dd749-99qkv"]
Jul 07 19:03:18.094713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:18.094692    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd45dd749-99qkv"]
Jul 07 19:03:19.489657 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:19.489623    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1250dfc-0494-4448-af3b-f8b58f9cd0e4" path="/var/lib/kubelet/pods/c1250dfc-0494-4448-af3b-f8b58f9cd0e4/volumes"
Jul 07 19:03:48.477170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477135    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65bfc9659c-8lprq"]
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477426    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1250dfc-0494-4448-af3b-f8b58f9cd0e4" containerName="console"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477437    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1250dfc-0494-4448-af3b-f8b58f9cd0e4" containerName="console"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477445    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c142468a-5d8a-4c69-abf9-3466a837cb9f" containerName="registry"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477451    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c142468a-5d8a-4c69-abf9-3466a837cb9f" containerName="registry"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477462    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e4685c-e605-4d56-a097-c9a2246ba8d1" containerName="console"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477467    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e4685c-e605-4d56-a097-c9a2246ba8d1" containerName="console"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477536    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1250dfc-0494-4448-af3b-f8b58f9cd0e4" containerName="console"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477554    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e4685c-e605-4d56-a097-c9a2246ba8d1" containerName="console"
Jul 07 19:03:48.477650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.477561    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c142468a-5d8a-4c69-abf9-3466a837cb9f" containerName="registry"
Jul 07 19:03:48.479698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.479682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.501709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.501677    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bfc9659c-8lprq"]
Jul 07 19:03:48.585386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-oauth-config\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.585386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-config\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.585650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-trusted-ca-bundle\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.585650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-service-ca\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.585650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-serving-cert\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.585650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pgh\" (UniqueName: \"kubernetes.io/projected/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-kube-api-access-c8pgh\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.585650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.585587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-oauth-serving-cert\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-config\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-trusted-ca-bundle\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-service-ca\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686303    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-serving-cert\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pgh\" (UniqueName: \"kubernetes.io/projected/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-kube-api-access-c8pgh\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686552 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-oauth-serving-cert\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.686552 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.686422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-oauth-config\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.687043 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.687014    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-config\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.687174 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.687088    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-service-ca\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.687288 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.687191    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-oauth-serving-cert\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.687288 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.687213    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-trusted-ca-bundle\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.688830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.688814    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-serving-cert\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.688889 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.688845    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-oauth-config\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.695530 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.695485    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pgh\" (UniqueName: \"kubernetes.io/projected/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-kube-api-access-c8pgh\") pod \"console-65bfc9659c-8lprq\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") " pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.788438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.788359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:48.928112 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:48.928088    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bfc9659c-8lprq"]
Jul 07 19:03:48.930534 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:03:48.930495    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbf5104_ae75_4ac5_9eea_bc73a211dfc9.slice/crio-0b1e810be6e67f0c12fbdc70a8dd7453a74ba69484da2a54e6060c41e8a6c02e WatchSource:0}: Error finding container 0b1e810be6e67f0c12fbdc70a8dd7453a74ba69484da2a54e6060c41e8a6c02e: Status 404 returned error can't find the container with id 0b1e810be6e67f0c12fbdc70a8dd7453a74ba69484da2a54e6060c41e8a6c02e
Jul 07 19:03:49.178964 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:49.178931    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bfc9659c-8lprq" event={"ID":"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9","Type":"ContainerStarted","Data":"cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18"}
Jul 07 19:03:49.179142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:49.179005    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bfc9659c-8lprq" event={"ID":"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9","Type":"ContainerStarted","Data":"0b1e810be6e67f0c12fbdc70a8dd7453a74ba69484da2a54e6060c41e8a6c02e"}
Jul 07 19:03:49.206576 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:49.206529    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65bfc9659c-8lprq" podStartSLOduration=1.206499188 podStartE2EDuration="1.206499188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:03:49.204182137 +0000 UTC m=+154.344556318" watchObservedRunningTime="2026-07-07 19:03:49.206499188 +0000 UTC m=+154.346873412"
Jul 07 19:03:58.789252 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:58.789198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:58.789252 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:58.789267    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:58.794011 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:58.793990    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:59.220316 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:59.220293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:03:59.266444 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:03:59.266402    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d8f675f95-v4pp6"]
Jul 07 19:04:24.286374 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.286305    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d8f675f95-v4pp6" podUID="15eda52a-06a5-480f-8970-885d5179d07d" containerName="console" containerID="cri-o://f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682" gracePeriod=15
Jul 07 19:04:24.526021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.525997    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:04:24.674886 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.674837    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-service-ca\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.674886 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.674896    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-console-config\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.675145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.674952    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-trusted-ca-bundle\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.675145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.674979    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mk6t\" (UniqueName: \"kubernetes.io/projected/15eda52a-06a5-480f-8970-885d5179d07d-kube-api-access-8mk6t\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.675145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675001    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-oauth-serving-cert\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.675145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675032    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-serving-cert\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.675145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675077    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-oauth-config\") pod \"15eda52a-06a5-480f-8970-885d5179d07d\" (UID: \"15eda52a-06a5-480f-8970-885d5179d07d\") "
Jul 07 19:04:24.675417 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675380    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-console-config" (OuterVolumeSpecName: "console-config") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:04:24.675417 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675403    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-service-ca" (OuterVolumeSpecName: "service-ca") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:04:24.675558 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675458    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:04:24.675558 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.675467    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:04:24.677295 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.677268    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15eda52a-06a5-480f-8970-885d5179d07d-kube-api-access-8mk6t" (OuterVolumeSpecName: "kube-api-access-8mk6t") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "kube-api-access-8mk6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:04:24.677295 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.677279    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:04:24.677412 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.677388    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15eda52a-06a5-480f-8970-885d5179d07d" (UID: "15eda52a-06a5-480f-8970-885d5179d07d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:04:24.775817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775768    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-trusted-ca-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:24.775817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775811    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mk6t\" (UniqueName: \"kubernetes.io/projected/15eda52a-06a5-480f-8970-885d5179d07d-kube-api-access-8mk6t\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:24.775817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775822    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-oauth-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:24.775817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775831    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:24.775817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775839    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15eda52a-06a5-480f-8970-885d5179d07d-console-oauth-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:24.776111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775848    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:24.776111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:24.775858    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15eda52a-06a5-480f-8970-885d5179d07d-console-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:04:25.308613 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.308574    2569 generic.go:356] "Generic (PLEG): container finished" podID="15eda52a-06a5-480f-8970-885d5179d07d" containerID="f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682" exitCode=0
Jul 07 19:04:25.309031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.308627    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8f675f95-v4pp6"
Jul 07 19:04:25.309031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.308654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8f675f95-v4pp6" event={"ID":"15eda52a-06a5-480f-8970-885d5179d07d","Type":"ContainerDied","Data":"f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682"}
Jul 07 19:04:25.309031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.308704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8f675f95-v4pp6" event={"ID":"15eda52a-06a5-480f-8970-885d5179d07d","Type":"ContainerDied","Data":"634ff67359697ee787c7692f21a333f62ecbebaa0227692a17ad81160c4c0fcd"}
Jul 07 19:04:25.309031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.308723    2569 scope.go:117] "RemoveContainer" containerID="f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682"
Jul 07 19:04:25.316591 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.316571    2569 scope.go:117] "RemoveContainer" containerID="f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682"
Jul 07 19:04:25.316867 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:04:25.316848    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682\": container with ID starting with f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682 not found: ID does not exist" containerID="f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682"
Jul 07 19:04:25.316935 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.316874    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682"} err="failed to get container status \"f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682\": rpc error: code = NotFound desc = could not find container \"f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682\": container with ID starting with f98a64a23aa496eee1f92e6b035f8c6259bfd5db55e706b6737601bc2a7df682 not found: ID does not exist"
Jul 07 19:04:25.329167 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.329143    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d8f675f95-v4pp6"]
Jul 07 19:04:25.334720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.334700    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d8f675f95-v4pp6"]
Jul 07 19:04:25.489865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:25.489833    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15eda52a-06a5-480f-8970-885d5179d07d" path="/var/lib/kubelet/pods/15eda52a-06a5-480f-8970-885d5179d07d/volumes"
Jul 07 19:04:36.088632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.088598    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"]
Jul 07 19:04:36.089083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.088911    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15eda52a-06a5-480f-8970-885d5179d07d" containerName="console"
Jul 07 19:04:36.089083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.088924    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15eda52a-06a5-480f-8970-885d5179d07d" containerName="console"
Jul 07 19:04:36.089083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.088978    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="15eda52a-06a5-480f-8970-885d5179d07d" containerName="console"
Jul 07 19:04:36.090909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.090893    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.093691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.093673    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 19:04:36.093898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.093879    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 19:04:36.094575 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.094559    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ws58n\""
Jul 07 19:04:36.109629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.109604    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"]
Jul 07 19:04:36.263930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.263892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.263930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.263931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcslw\" (UniqueName: \"kubernetes.io/projected/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-kube-api-access-vcslw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.264152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.263969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.364643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.364558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.364643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.364593    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcslw\" (UniqueName: \"kubernetes.io/projected/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-kube-api-access-vcslw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.364643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.364642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.364952 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.364935    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.364992 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.364964    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.374028 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.374006    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcslw\" (UniqueName: \"kubernetes.io/projected/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-kube-api-access-vcslw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.399997 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.399969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:04:36.528166 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:36.528069    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"]
Jul 07 19:04:36.530807 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:04:36.530778    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36d4192_b8a9_4b6b_bd01_fd046d7f42b0.slice/crio-c5ed81e4c2b9e9b1cde5a87273912bb27228aeb991d915363f5f7854c9b8b37a WatchSource:0}: Error finding container c5ed81e4c2b9e9b1cde5a87273912bb27228aeb991d915363f5f7854c9b8b37a: Status 404 returned error can't find the container with id c5ed81e4c2b9e9b1cde5a87273912bb27228aeb991d915363f5f7854c9b8b37a
Jul 07 19:04:37.350939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:37.350903    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7" event={"ID":"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0","Type":"ContainerStarted","Data":"c5ed81e4c2b9e9b1cde5a87273912bb27228aeb991d915363f5f7854c9b8b37a"}
Jul 07 19:04:48.392521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:48.392469    2569 generic.go:356] "Generic (PLEG): container finished" podID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerID="87cdf6627449e1bfe7b20f6485c234f463aa1055911c7792af144e86f145dd14" exitCode=0
Jul 07 19:04:48.392920 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:48.392562    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7" event={"ID":"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0","Type":"ContainerDied","Data":"87cdf6627449e1bfe7b20f6485c234f463aa1055911c7792af144e86f145dd14"}
Jul 07 19:04:58.428982 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:58.428951    2569 generic.go:356] "Generic (PLEG): container finished" podID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerID="b54852028293fedb83a533365e6105a66ca0f5d1b35dcda1f04253e8af675d6e" exitCode=0
Jul 07 19:04:58.429376 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:04:58.429040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7" event={"ID":"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0","Type":"ContainerDied","Data":"b54852028293fedb83a533365e6105a66ca0f5d1b35dcda1f04253e8af675d6e"}
Jul 07 19:05:07.467194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:07.467155    2569 generic.go:356] "Generic (PLEG): container finished" podID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerID="4136f01fd3c6861f8a3cdad20588f8a9e581df0ac042a90a424528b4828fafbb" exitCode=0
Jul 07 19:05:07.467618 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:07.467238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7" event={"ID":"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0","Type":"ContainerDied","Data":"4136f01fd3c6861f8a3cdad20588f8a9e581df0ac042a90a424528b4828fafbb"}
Jul 07 19:05:08.594298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.594275    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:05:08.705127 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.705095    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcslw\" (UniqueName: \"kubernetes.io/projected/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-kube-api-access-vcslw\") pod \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") "
Jul 07 19:05:08.705291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.705144    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-util\") pod \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") "
Jul 07 19:05:08.705291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.705201    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-bundle\") pod \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\" (UID: \"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0\") "
Jul 07 19:05:08.706050 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.706014    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-bundle" (OuterVolumeSpecName: "bundle") pod "b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" (UID: "b36d4192-b8a9-4b6b-bd01-fd046d7f42b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:05:08.707290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.707259    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-kube-api-access-vcslw" (OuterVolumeSpecName: "kube-api-access-vcslw") pod "b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" (UID: "b36d4192-b8a9-4b6b-bd01-fd046d7f42b0"). InnerVolumeSpecName "kube-api-access-vcslw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:05:08.710346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.710327    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-util" (OuterVolumeSpecName: "util") pod "b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" (UID: "b36d4192-b8a9-4b6b-bd01-fd046d7f42b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:05:08.805733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.805663    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcslw\" (UniqueName: \"kubernetes.io/projected/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-kube-api-access-vcslw\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:08.805733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.805690    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:08.805733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:08.805701    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b36d4192-b8a9-4b6b-bd01-fd046d7f42b0-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:09.476676 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:09.476650    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7"
Jul 07 19:05:09.476852 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:09.476649    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m7rd7" event={"ID":"b36d4192-b8a9-4b6b-bd01-fd046d7f42b0","Type":"ContainerDied","Data":"c5ed81e4c2b9e9b1cde5a87273912bb27228aeb991d915363f5f7854c9b8b37a"}
Jul 07 19:05:09.476852 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:09.476800    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5ed81e4c2b9e9b1cde5a87273912bb27228aeb991d915363f5f7854c9b8b37a"
Jul 07 19:05:14.604750 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.604714    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"]
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.604984    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="extract"
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.604996    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="extract"
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.605009    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="util"
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.605015    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="util"
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.605023    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="pull"
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.605027    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="pull"
Jul 07 19:05:14.605237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.605077    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b36d4192-b8a9-4b6b-bd01-fd046d7f42b0" containerName="extract"
Jul 07 19:05:14.608235 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.608216    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.611444 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.611418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ttzt4\""
Jul 07 19:05:14.611932 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.611917    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:05:14.612237 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.612222    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 19:05:14.633671 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.633646    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"]
Jul 07 19:05:14.654415 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.654389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk4d8\" (UniqueName: \"kubernetes.io/projected/299b6d04-f572-4d6b-8ac5-2ebe808d8bf3-kube-api-access-wk4d8\") pod \"cert-manager-operator-controller-manager-55c444bf86-std9p\" (UID: \"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.654570 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.654431    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299b6d04-f572-4d6b-8ac5-2ebe808d8bf3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-std9p\" (UID: \"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.754977 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.754942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4d8\" (UniqueName: \"kubernetes.io/projected/299b6d04-f572-4d6b-8ac5-2ebe808d8bf3-kube-api-access-wk4d8\") pod \"cert-manager-operator-controller-manager-55c444bf86-std9p\" (UID: \"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.754977 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.754984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299b6d04-f572-4d6b-8ac5-2ebe808d8bf3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-std9p\" (UID: \"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.755357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.755337    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299b6d04-f572-4d6b-8ac5-2ebe808d8bf3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-std9p\" (UID: \"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.766385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.766363    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4d8\" (UniqueName: \"kubernetes.io/projected/299b6d04-f572-4d6b-8ac5-2ebe808d8bf3-kube-api-access-wk4d8\") pod \"cert-manager-operator-controller-manager-55c444bf86-std9p\" (UID: \"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:14.916800 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:14.916687    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"
Jul 07 19:05:15.065326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:15.065293    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p"]
Jul 07 19:05:15.071816 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:05:15.071768    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299b6d04_f572_4d6b_8ac5_2ebe808d8bf3.slice/crio-6a9b283bf9cf127ee880b89a46875b7c7c01b6fb9dd46dec61eb63cfe07d1d66 WatchSource:0}: Error finding container 6a9b283bf9cf127ee880b89a46875b7c7c01b6fb9dd46dec61eb63cfe07d1d66: Status 404 returned error can't find the container with id 6a9b283bf9cf127ee880b89a46875b7c7c01b6fb9dd46dec61eb63cfe07d1d66
Jul 07 19:05:15.499173 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:15.499135    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p" event={"ID":"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3","Type":"ContainerStarted","Data":"6a9b283bf9cf127ee880b89a46875b7c7c01b6fb9dd46dec61eb63cfe07d1d66"}
Jul 07 19:05:17.509585 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:17.509545    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p" event={"ID":"299b6d04-f572-4d6b-8ac5-2ebe808d8bf3","Type":"ContainerStarted","Data":"4f3182f7682fb671d89ce2ad7a8db3364eba82ec0a221e5a9894d17f9666fbe4"}
Jul 07 19:05:17.541566 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:17.541493    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-std9p" podStartSLOduration=1.961245361 podStartE2EDuration="3.541477267s" totalImagesPullingTime="1.580231906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:05:17.540743362 +0000 UTC m=+242.681117553" watchObservedRunningTime="2026-07-07 19:05:17.541477267 +0000 UTC m=+242.681851446"
Jul 07 19:05:18.121553 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.121502    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"]
Jul 07 19:05:18.125150 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.125126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.127570 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.127549    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ws58n\""
Jul 07 19:05:18.127947 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.127930    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 19:05:18.128052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.128036    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 19:05:18.142827 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.142802    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"]
Jul 07 19:05:18.189999 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.189963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.190162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.190058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjnfs\" (UniqueName: \"kubernetes.io/projected/8762d344-7ebc-48d2-8b98-374f7059bfec-kube-api-access-vjnfs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.190162 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.190119    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.291463 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.291428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.291634 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.291487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjnfs\" (UniqueName: \"kubernetes.io/projected/8762d344-7ebc-48d2-8b98-374f7059bfec-kube-api-access-vjnfs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.291634 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.291532    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.291917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.291895    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.291953 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.291906    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.303962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.303928    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjnfs\" (UniqueName: \"kubernetes.io/projected/8762d344-7ebc-48d2-8b98-374f7059bfec-kube-api-access-vjnfs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.434797 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.434714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:18.561667 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:18.561640    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"]
Jul 07 19:05:18.564041 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:05:18.564006    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8762d344_7ebc_48d2_8b98_374f7059bfec.slice/crio-eef1d1c5eb5144d86b5c74c5af1e97035e2f246fb8549efb8f40281d2a193902 WatchSource:0}: Error finding container eef1d1c5eb5144d86b5c74c5af1e97035e2f246fb8549efb8f40281d2a193902: Status 404 returned error can't find the container with id eef1d1c5eb5144d86b5c74c5af1e97035e2f246fb8549efb8f40281d2a193902
Jul 07 19:05:19.504316 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.504283    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-76v9w"]
Jul 07 19:05:19.507341 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.507326    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.509619 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.509595    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 19:05:19.509734 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.509634    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 19:05:19.510466 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.510446    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-m8qwg\""
Jul 07 19:05:19.517419 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.517395    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-76v9w"]
Jul 07 19:05:19.519318 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.519295    2569 generic.go:356] "Generic (PLEG): container finished" podID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerID="7f16944161df5981048f412837c8469f509f27a76f5059ef36c7762b16afdc67" exitCode=0
Jul 07 19:05:19.519410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.519377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc" event={"ID":"8762d344-7ebc-48d2-8b98-374f7059bfec","Type":"ContainerDied","Data":"7f16944161df5981048f412837c8469f509f27a76f5059ef36c7762b16afdc67"}
Jul 07 19:05:19.519467 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.519422    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc" event={"ID":"8762d344-7ebc-48d2-8b98-374f7059bfec","Type":"ContainerStarted","Data":"eef1d1c5eb5144d86b5c74c5af1e97035e2f246fb8549efb8f40281d2a193902"}
Jul 07 19:05:19.603768 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.603736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb6f5040-6661-4099-a7ed-f6cc027ddfce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-76v9w\" (UID: \"eb6f5040-6661-4099-a7ed-f6cc027ddfce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.604116 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.603791    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6bq\" (UniqueName: \"kubernetes.io/projected/eb6f5040-6661-4099-a7ed-f6cc027ddfce-kube-api-access-5m6bq\") pod \"cert-manager-webhook-6486ffd997-76v9w\" (UID: \"eb6f5040-6661-4099-a7ed-f6cc027ddfce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.704564 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.704533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb6f5040-6661-4099-a7ed-f6cc027ddfce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-76v9w\" (UID: \"eb6f5040-6661-4099-a7ed-f6cc027ddfce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.704723 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.704636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6bq\" (UniqueName: \"kubernetes.io/projected/eb6f5040-6661-4099-a7ed-f6cc027ddfce-kube-api-access-5m6bq\") pod \"cert-manager-webhook-6486ffd997-76v9w\" (UID: \"eb6f5040-6661-4099-a7ed-f6cc027ddfce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.719240 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.719212    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb6f5040-6661-4099-a7ed-f6cc027ddfce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-76v9w\" (UID: \"eb6f5040-6661-4099-a7ed-f6cc027ddfce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.719355 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.719310    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6bq\" (UniqueName: \"kubernetes.io/projected/eb6f5040-6661-4099-a7ed-f6cc027ddfce-kube-api-access-5m6bq\") pod \"cert-manager-webhook-6486ffd997-76v9w\" (UID: \"eb6f5040-6661-4099-a7ed-f6cc027ddfce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.816695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.816666    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:19.941215 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:19.941167    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-76v9w"]
Jul 07 19:05:19.943328 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:05:19.943305    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb6f5040_6661_4099_a7ed_f6cc027ddfce.slice/crio-5c7f13c2c17645cc49ac8d2c07521a632f5de04171a625aed1cdfeb22ba8dbb9 WatchSource:0}: Error finding container 5c7f13c2c17645cc49ac8d2c07521a632f5de04171a625aed1cdfeb22ba8dbb9: Status 404 returned error can't find the container with id 5c7f13c2c17645cc49ac8d2c07521a632f5de04171a625aed1cdfeb22ba8dbb9
Jul 07 19:05:20.525699 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:20.525661    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w" event={"ID":"eb6f5040-6661-4099-a7ed-f6cc027ddfce","Type":"ContainerStarted","Data":"5c7f13c2c17645cc49ac8d2c07521a632f5de04171a625aed1cdfeb22ba8dbb9"}
Jul 07 19:05:21.532740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:21.532701    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc" event={"ID":"8762d344-7ebc-48d2-8b98-374f7059bfec","Type":"ContainerStarted","Data":"374bcfb67498f0502d4f40f268ceeffdbeebac4b2a0ca9ace521fa0f8b005c8b"}
Jul 07 19:05:22.538146 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:22.538103    2569 generic.go:356] "Generic (PLEG): container finished" podID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerID="374bcfb67498f0502d4f40f268ceeffdbeebac4b2a0ca9ace521fa0f8b005c8b" exitCode=0
Jul 07 19:05:22.538532 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:22.538178    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc" event={"ID":"8762d344-7ebc-48d2-8b98-374f7059bfec","Type":"ContainerDied","Data":"374bcfb67498f0502d4f40f268ceeffdbeebac4b2a0ca9ace521fa0f8b005c8b"}
Jul 07 19:05:23.543981 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:23.543941    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w" event={"ID":"eb6f5040-6661-4099-a7ed-f6cc027ddfce","Type":"ContainerStarted","Data":"ea2d5f3cd301e193e7e1bb1ae00cd076eaa19d0c54ec8774626f22b4d25df7ac"}
Jul 07 19:05:23.544552 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:23.544097    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:23.545962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:23.545937    2569 generic.go:356] "Generic (PLEG): container finished" podID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerID="8bd540f3f180d282d019ced37f501f062aeecad1b929efebf7db406c4a2a8473" exitCode=0
Jul 07 19:05:23.546073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:23.546008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc" event={"ID":"8762d344-7ebc-48d2-8b98-374f7059bfec","Type":"ContainerDied","Data":"8bd540f3f180d282d019ced37f501f062aeecad1b929efebf7db406c4a2a8473"}
Jul 07 19:05:23.560569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:23.560494    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w" podStartSLOduration=1.900222722 podStartE2EDuration="4.560478481s" totalImagesPullingTime="2.660255759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:05:23.55894272 +0000 UTC m=+248.699316911" watchObservedRunningTime="2026-07-07 19:05:23.560478481 +0000 UTC m=+248.700852673"
Jul 07 19:05:24.675390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.675367    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:24.744857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.744824    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-bundle\") pod \"8762d344-7ebc-48d2-8b98-374f7059bfec\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") "
Jul 07 19:05:24.744997 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.744887    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjnfs\" (UniqueName: \"kubernetes.io/projected/8762d344-7ebc-48d2-8b98-374f7059bfec-kube-api-access-vjnfs\") pod \"8762d344-7ebc-48d2-8b98-374f7059bfec\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") "
Jul 07 19:05:24.744997 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.744916    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-util\") pod \"8762d344-7ebc-48d2-8b98-374f7059bfec\" (UID: \"8762d344-7ebc-48d2-8b98-374f7059bfec\") "
Jul 07 19:05:24.745262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.745233    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-bundle" (OuterVolumeSpecName: "bundle") pod "8762d344-7ebc-48d2-8b98-374f7059bfec" (UID: "8762d344-7ebc-48d2-8b98-374f7059bfec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:05:24.747016 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.746986    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8762d344-7ebc-48d2-8b98-374f7059bfec-kube-api-access-vjnfs" (OuterVolumeSpecName: "kube-api-access-vjnfs") pod "8762d344-7ebc-48d2-8b98-374f7059bfec" (UID: "8762d344-7ebc-48d2-8b98-374f7059bfec"). InnerVolumeSpecName "kube-api-access-vjnfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:05:24.749974 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.749938    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-util" (OuterVolumeSpecName: "util") pod "8762d344-7ebc-48d2-8b98-374f7059bfec" (UID: "8762d344-7ebc-48d2-8b98-374f7059bfec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:05:24.845474 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.845445    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:24.845474 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.845471    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjnfs\" (UniqueName: \"kubernetes.io/projected/8762d344-7ebc-48d2-8b98-374f7059bfec-kube-api-access-vjnfs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:24.845655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:24.845481    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8762d344-7ebc-48d2-8b98-374f7059bfec-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:25.557492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:25.557459    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc" event={"ID":"8762d344-7ebc-48d2-8b98-374f7059bfec","Type":"ContainerDied","Data":"eef1d1c5eb5144d86b5c74c5af1e97035e2f246fb8549efb8f40281d2a193902"}
Jul 07 19:05:25.557492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:25.557479    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvjdc"
Jul 07 19:05:25.557678 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:25.557527    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eef1d1c5eb5144d86b5c74c5af1e97035e2f246fb8549efb8f40281d2a193902"
Jul 07 19:05:29.552479 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:29.552449    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-76v9w"
Jul 07 19:05:31.200161 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200126    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9wlnz"]
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200418    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="pull"
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200428    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="pull"
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200441    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="util"
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200446    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="util"
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200459    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="extract"
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200464    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="extract"
Jul 07 19:05:31.200554 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.200527    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8762d344-7ebc-48d2-8b98-374f7059bfec" containerName="extract"
Jul 07 19:05:31.202819 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.202801    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.205088 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.205068    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d5zvp\""
Jul 07 19:05:31.214418 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.214394    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9wlnz"]
Jul 07 19:05:31.303397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.303373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7a7e865-f222-47ee-b941-0cdc80dd4d39-bound-sa-token\") pod \"cert-manager-55b4d954d5-9wlnz\" (UID: \"d7a7e865-f222-47ee-b941-0cdc80dd4d39\") " pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.303557 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.303426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfh4n\" (UniqueName: \"kubernetes.io/projected/d7a7e865-f222-47ee-b941-0cdc80dd4d39-kube-api-access-kfh4n\") pod \"cert-manager-55b4d954d5-9wlnz\" (UID: \"d7a7e865-f222-47ee-b941-0cdc80dd4d39\") " pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.404307 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.404243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7a7e865-f222-47ee-b941-0cdc80dd4d39-bound-sa-token\") pod \"cert-manager-55b4d954d5-9wlnz\" (UID: \"d7a7e865-f222-47ee-b941-0cdc80dd4d39\") " pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.404531 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.404320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfh4n\" (UniqueName: \"kubernetes.io/projected/d7a7e865-f222-47ee-b941-0cdc80dd4d39-kube-api-access-kfh4n\") pod \"cert-manager-55b4d954d5-9wlnz\" (UID: \"d7a7e865-f222-47ee-b941-0cdc80dd4d39\") " pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.415211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.415182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfh4n\" (UniqueName: \"kubernetes.io/projected/d7a7e865-f222-47ee-b941-0cdc80dd4d39-kube-api-access-kfh4n\") pod \"cert-manager-55b4d954d5-9wlnz\" (UID: \"d7a7e865-f222-47ee-b941-0cdc80dd4d39\") " pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.415577 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.415559    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7a7e865-f222-47ee-b941-0cdc80dd4d39-bound-sa-token\") pod \"cert-manager-55b4d954d5-9wlnz\" (UID: \"d7a7e865-f222-47ee-b941-0cdc80dd4d39\") " pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.512287 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.512211    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9wlnz"
Jul 07 19:05:31.635134 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:31.635083    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9wlnz"]
Jul 07 19:05:31.637087 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:05:31.637057    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7a7e865_f222_47ee_b941_0cdc80dd4d39.slice/crio-9aacdd00169bf2ac91b46e652e808c74832645eded35ad04ad1d96877943920c WatchSource:0}: Error finding container 9aacdd00169bf2ac91b46e652e808c74832645eded35ad04ad1d96877943920c: Status 404 returned error can't find the container with id 9aacdd00169bf2ac91b46e652e808c74832645eded35ad04ad1d96877943920c
Jul 07 19:05:32.586707 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:32.586672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9wlnz" event={"ID":"d7a7e865-f222-47ee-b941-0cdc80dd4d39","Type":"ContainerStarted","Data":"a6b758f6d6ede2b307738bc7fb222ecd0bc4dd025f0104655413b4983b22ff1c"}
Jul 07 19:05:32.587089 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:32.586715    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9wlnz" event={"ID":"d7a7e865-f222-47ee-b941-0cdc80dd4d39","Type":"ContainerStarted","Data":"9aacdd00169bf2ac91b46e652e808c74832645eded35ad04ad1d96877943920c"}
Jul 07 19:05:32.603836 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:32.603787    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9wlnz" podStartSLOduration=1.60377224 podStartE2EDuration="1.60377224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:05:32.601881454 +0000 UTC m=+257.742255635" watchObservedRunningTime="2026-07-07 19:05:32.60377224 +0000 UTC m=+257.744146420"
Jul 07 19:05:38.374143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.374066    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"]
Jul 07 19:05:38.394791 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.394765    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"]
Jul 07 19:05:38.394925 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.394858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.397918 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.397895    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 19:05:38.398050 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.397982    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 19:05:38.398859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.398839    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ws58n\""
Jul 07 19:05:38.560526 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.560470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.560695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.560547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5flxj\" (UniqueName: \"kubernetes.io/projected/d7313b1d-1c54-4180-81aa-efecf2390857-kube-api-access-5flxj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.560695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.560610    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.662064 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.661981    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5flxj\" (UniqueName: \"kubernetes.io/projected/d7313b1d-1c54-4180-81aa-efecf2390857-kube-api-access-5flxj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.662064 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.662029    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.662064 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.662066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.662377 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.662361    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.662469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.662451    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.670092 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.670065    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5flxj\" (UniqueName: \"kubernetes.io/projected/d7313b1d-1c54-4180-81aa-efecf2390857-kube-api-access-5flxj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.704051 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.704028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:38.848693 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:38.848667    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"]
Jul 07 19:05:38.851477 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:05:38.851447    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7313b1d_1c54_4180_81aa_efecf2390857.slice/crio-2d0e1a2c7ca0a4a7efebd584d4d277de72e8a9f0d9f0148e68a8986f7cce019d WatchSource:0}: Error finding container 2d0e1a2c7ca0a4a7efebd584d4d277de72e8a9f0d9f0148e68a8986f7cce019d: Status 404 returned error can't find the container with id 2d0e1a2c7ca0a4a7efebd584d4d277de72e8a9f0d9f0148e68a8986f7cce019d
Jul 07 19:05:39.619072 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:39.619037    2569 generic.go:356] "Generic (PLEG): container finished" podID="d7313b1d-1c54-4180-81aa-efecf2390857" containerID="ee442c988bf730dcac57cf8918bd3853a14c9123855669845a790d0a77cf8803" exitCode=0
Jul 07 19:05:39.619441 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:39.619118    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9" event={"ID":"d7313b1d-1c54-4180-81aa-efecf2390857","Type":"ContainerDied","Data":"ee442c988bf730dcac57cf8918bd3853a14c9123855669845a790d0a77cf8803"}
Jul 07 19:05:39.619441 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:39.619177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9" event={"ID":"d7313b1d-1c54-4180-81aa-efecf2390857","Type":"ContainerStarted","Data":"2d0e1a2c7ca0a4a7efebd584d4d277de72e8a9f0d9f0148e68a8986f7cce019d"}
Jul 07 19:05:40.624964 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:40.624932    2569 generic.go:356] "Generic (PLEG): container finished" podID="d7313b1d-1c54-4180-81aa-efecf2390857" containerID="9c36530d68c2edda3b4067994685ba2433ef9d0d5f14a4edf012b233583b62d5" exitCode=0
Jul 07 19:05:40.625400 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:40.625019    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9" event={"ID":"d7313b1d-1c54-4180-81aa-efecf2390857","Type":"ContainerDied","Data":"9c36530d68c2edda3b4067994685ba2433ef9d0d5f14a4edf012b233583b62d5"}
Jul 07 19:05:41.630851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:41.630819    2569 generic.go:356] "Generic (PLEG): container finished" podID="d7313b1d-1c54-4180-81aa-efecf2390857" containerID="303d991e039d19c3143499f7ad7fd85ac40915ae8eb614b830371cd27254054e" exitCode=0
Jul 07 19:05:41.631227 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:41.630900    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9" event={"ID":"d7313b1d-1c54-4180-81aa-efecf2390857","Type":"ContainerDied","Data":"303d991e039d19c3143499f7ad7fd85ac40915ae8eb614b830371cd27254054e"}
Jul 07 19:05:42.756546 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.756522    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:42.797711 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.797681    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5flxj\" (UniqueName: \"kubernetes.io/projected/d7313b1d-1c54-4180-81aa-efecf2390857-kube-api-access-5flxj\") pod \"d7313b1d-1c54-4180-81aa-efecf2390857\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") "
Jul 07 19:05:42.797883 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.797744    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-util\") pod \"d7313b1d-1c54-4180-81aa-efecf2390857\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") "
Jul 07 19:05:42.797883 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.797850    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-bundle\") pod \"d7313b1d-1c54-4180-81aa-efecf2390857\" (UID: \"d7313b1d-1c54-4180-81aa-efecf2390857\") "
Jul 07 19:05:42.798681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.798656    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-bundle" (OuterVolumeSpecName: "bundle") pod "d7313b1d-1c54-4180-81aa-efecf2390857" (UID: "d7313b1d-1c54-4180-81aa-efecf2390857"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:05:42.799834 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.799803    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7313b1d-1c54-4180-81aa-efecf2390857-kube-api-access-5flxj" (OuterVolumeSpecName: "kube-api-access-5flxj") pod "d7313b1d-1c54-4180-81aa-efecf2390857" (UID: "d7313b1d-1c54-4180-81aa-efecf2390857"). InnerVolumeSpecName "kube-api-access-5flxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:05:42.804060 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.804039    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-util" (OuterVolumeSpecName: "util") pod "d7313b1d-1c54-4180-81aa-efecf2390857" (UID: "d7313b1d-1c54-4180-81aa-efecf2390857"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:05:42.898369 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.898293    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:42.898369 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.898317    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7313b1d-1c54-4180-81aa-efecf2390857-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:42.898369 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:42.898326    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5flxj\" (UniqueName: \"kubernetes.io/projected/d7313b1d-1c54-4180-81aa-efecf2390857-kube-api-access-5flxj\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:05:43.640997 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:43.640964    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9"
Jul 07 19:05:43.640997 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:43.640976    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq4lk9" event={"ID":"d7313b1d-1c54-4180-81aa-efecf2390857","Type":"ContainerDied","Data":"2d0e1a2c7ca0a4a7efebd584d4d277de72e8a9f0d9f0148e68a8986f7cce019d"}
Jul 07 19:05:43.641246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:43.641043    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d0e1a2c7ca0a4a7efebd584d4d277de72e8a9f0d9f0148e68a8986f7cce019d"
Jul 07 19:05:51.433106 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433066    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"]
Jul 07 19:05:51.433599 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433564    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="pull"
Jul 07 19:05:51.433669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433604    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="pull"
Jul 07 19:05:51.433669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433619    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="util"
Jul 07 19:05:51.433669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433627    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="util"
Jul 07 19:05:51.433669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433659    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="extract"
Jul 07 19:05:51.433669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433668    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="extract"
Jul 07 19:05:51.433909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.433744    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7313b1d-1c54-4180-81aa-efecf2390857" containerName="extract"
Jul 07 19:05:51.435760 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.435739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.439401 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.439382    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 19:05:51.439653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.439640    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sflhs\""
Jul 07 19:05:51.439983 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.439960    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 19:05:51.440185 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.440170    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 19:05:51.440668 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.440654    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 19:05:51.457470 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.457445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tvrc\" (UniqueName: \"kubernetes.io/projected/80814367-8254-4351-9f3f-fbca8e76417c-kube-api-access-5tvrc\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.457603 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.457488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80814367-8254-4351-9f3f-fbca8e76417c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.457603 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.457546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80814367-8254-4351-9f3f-fbca8e76417c-manifests\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.457603 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.457586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80814367-8254-4351-9f3f-fbca8e76417c-tmp\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.457765 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.457630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80814367-8254-4351-9f3f-fbca8e76417c-webhook-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.459314 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.459294    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"]
Jul 07 19:05:51.558122 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.558094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tvrc\" (UniqueName: \"kubernetes.io/projected/80814367-8254-4351-9f3f-fbca8e76417c-kube-api-access-5tvrc\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.558265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.558128    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80814367-8254-4351-9f3f-fbca8e76417c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.558265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.558154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80814367-8254-4351-9f3f-fbca8e76417c-manifests\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.558265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.558189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80814367-8254-4351-9f3f-fbca8e76417c-tmp\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.558265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.558225    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80814367-8254-4351-9f3f-fbca8e76417c-webhook-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.558661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.558631    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80814367-8254-4351-9f3f-fbca8e76417c-manifests\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.560498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.560470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80814367-8254-4351-9f3f-fbca8e76417c-tmp\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.560671 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.560651    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80814367-8254-4351-9f3f-fbca8e76417c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.560717 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.560683    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80814367-8254-4351-9f3f-fbca8e76417c-webhook-cert\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.568397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.568371    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tvrc\" (UniqueName: \"kubernetes.io/projected/80814367-8254-4351-9f3f-fbca8e76417c-kube-api-access-5tvrc\") pod \"opendatahub-operator-controller-manager-59996cbd9d-n4c9b\" (UID: \"80814367-8254-4351-9f3f-fbca8e76417c\") " pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.745538 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.745431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:51.891404 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:51.891379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"]
Jul 07 19:05:51.893834 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:05:51.893803    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80814367_8254_4351_9f3f_fbca8e76417c.slice/crio-4afbffd6edb1a37c6441e18bef977aa44cead057c9111265ce9d9d3f48bd2b91 WatchSource:0}: Error finding container 4afbffd6edb1a37c6441e18bef977aa44cead057c9111265ce9d9d3f48bd2b91: Status 404 returned error can't find the container with id 4afbffd6edb1a37c6441e18bef977aa44cead057c9111265ce9d9d3f48bd2b91
Jul 07 19:05:52.677109 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:52.677071    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b" event={"ID":"80814367-8254-4351-9f3f-fbca8e76417c","Type":"ContainerStarted","Data":"4afbffd6edb1a37c6441e18bef977aa44cead057c9111265ce9d9d3f48bd2b91"}
Jul 07 19:05:55.692271 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:55.692231    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b" event={"ID":"80814367-8254-4351-9f3f-fbca8e76417c","Type":"ContainerStarted","Data":"1129e68d4f601e3bb892eda71aa76613afc42e099f6a014d88ac394754023765"}
Jul 07 19:05:56.698001 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:56.697969    2569 generic.go:356] "Generic (PLEG): container finished" podID="80814367-8254-4351-9f3f-fbca8e76417c" containerID="1129e68d4f601e3bb892eda71aa76613afc42e099f6a014d88ac394754023765" exitCode=0
Jul 07 19:05:56.698371 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:56.698053    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b" event={"ID":"80814367-8254-4351-9f3f-fbca8e76417c","Type":"ContainerDied","Data":"1129e68d4f601e3bb892eda71aa76613afc42e099f6a014d88ac394754023765"}
Jul 07 19:05:57.704143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:57.704106    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b" event={"ID":"80814367-8254-4351-9f3f-fbca8e76417c","Type":"ContainerStarted","Data":"bd1d27861ccff2e8fe5dec03be22d0e434eff3bb275b2860c82eb13ab5188292"}
Jul 07 19:05:57.704503 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:57.704294    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:05:57.728596 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:05:57.728554    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b" podStartSLOduration=2.012518287 podStartE2EDuration="6.728541445s" totalImagesPullingTime="3.578443902s" totalInitContainerRuntime="1.137579256s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:05:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:05:57.725998007 +0000 UTC m=+282.866372186" watchObservedRunningTime="2026-07-07 19:05:57.728541445 +0000 UTC m=+282.868915621"
Jul 07 19:06:08.711293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:08.711263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59996cbd9d-n4c9b"
Jul 07 19:06:11.687393 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.687353    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"]
Jul 07 19:06:11.692901 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.692883    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.695321 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.695298    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 19:06:11.695473 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.695456    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 19:06:11.695610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.695593    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 19:06:11.696227 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.696210    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 19:06:11.696316 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.696211    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jqwcr\""
Jul 07 19:06:11.703753 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.703727    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"]
Jul 07 19:06:11.823463 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.823425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dqv\" (UniqueName: \"kubernetes.io/projected/4e05057e-6b20-4087-b12f-bee036bc3f7e-kube-api-access-s4dqv\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.823463 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.823468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e05057e-6b20-4087-b12f-bee036bc3f7e-tls-certs\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.823675 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.823491    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e05057e-6b20-4087-b12f-bee036bc3f7e-tmp\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.892523 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.892478    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dgb54"]
Jul 07 19:06:11.894597 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.894576    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:11.897876 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.897855    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 19:06:11.906472 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.906449    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dgb54"]
Jul 07 19:06:11.924314 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.924292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dqv\" (UniqueName: \"kubernetes.io/projected/4e05057e-6b20-4087-b12f-bee036bc3f7e-kube-api-access-s4dqv\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.924418 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.924329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e05057e-6b20-4087-b12f-bee036bc3f7e-tls-certs\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.924418 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.924352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e05057e-6b20-4087-b12f-bee036bc3f7e-tmp\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.926579 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.926558    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e05057e-6b20-4087-b12f-bee036bc3f7e-tmp\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.926820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.926800    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e05057e-6b20-4087-b12f-bee036bc3f7e-tls-certs\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:11.933172 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:11.933150    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dqv\" (UniqueName: \"kubernetes.io/projected/4e05057e-6b20-4087-b12f-bee036bc3f7e-kube-api-access-s4dqv\") pod \"kube-auth-proxy-955bd7587-7mjhb\" (UID: \"4e05057e-6b20-4087-b12f-bee036bc3f7e\") " pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:12.002140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.002055    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"
Jul 07 19:06:12.025058 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.025028    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44254f20-e593-4d81-a233-2e02887cca48-tls-certs\") pod \"model-serving-api-54d89bd5fc-dgb54\" (UID: \"44254f20-e593-4d81-a233-2e02887cca48\") " pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.025198 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.025078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xqz\" (UniqueName: \"kubernetes.io/projected/44254f20-e593-4d81-a233-2e02887cca48-kube-api-access-k2xqz\") pod \"model-serving-api-54d89bd5fc-dgb54\" (UID: \"44254f20-e593-4d81-a233-2e02887cca48\") " pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.125797 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.125766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44254f20-e593-4d81-a233-2e02887cca48-tls-certs\") pod \"model-serving-api-54d89bd5fc-dgb54\" (UID: \"44254f20-e593-4d81-a233-2e02887cca48\") " pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.125973 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.125819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xqz\" (UniqueName: \"kubernetes.io/projected/44254f20-e593-4d81-a233-2e02887cca48-kube-api-access-k2xqz\") pod \"model-serving-api-54d89bd5fc-dgb54\" (UID: \"44254f20-e593-4d81-a233-2e02887cca48\") " pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.128376 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.128350    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44254f20-e593-4d81-a233-2e02887cca48-tls-certs\") pod \"model-serving-api-54d89bd5fc-dgb54\" (UID: \"44254f20-e593-4d81-a233-2e02887cca48\") " pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.139435 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.139407    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xqz\" (UniqueName: \"kubernetes.io/projected/44254f20-e593-4d81-a233-2e02887cca48-kube-api-access-k2xqz\") pod \"model-serving-api-54d89bd5fc-dgb54\" (UID: \"44254f20-e593-4d81-a233-2e02887cca48\") " pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.162527 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.162478    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-955bd7587-7mjhb"]
Jul 07 19:06:12.164094 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:06:12.164042    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e05057e_6b20_4087_b12f_bee036bc3f7e.slice/crio-350b681824779bb785e8b166a09b074e0838db259c011853ace7a6253ed70171 WatchSource:0}: Error finding container 350b681824779bb785e8b166a09b074e0838db259c011853ace7a6253ed70171: Status 404 returned error can't find the container with id 350b681824779bb785e8b166a09b074e0838db259c011853ace7a6253ed70171
Jul 07 19:06:12.204391 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.204359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:12.345887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.345861    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dgb54"]
Jul 07 19:06:12.347865 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:06:12.347834    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44254f20_e593_4d81_a233_2e02887cca48.slice/crio-36c766afcc101b8cc9f43691919f72e75d9ceb202906bf4d037cfd104c1f6cf2 WatchSource:0}: Error finding container 36c766afcc101b8cc9f43691919f72e75d9ceb202906bf4d037cfd104c1f6cf2: Status 404 returned error can't find the container with id 36c766afcc101b8cc9f43691919f72e75d9ceb202906bf4d037cfd104c1f6cf2
Jul 07 19:06:12.783271 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.783235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54" event={"ID":"44254f20-e593-4d81-a233-2e02887cca48","Type":"ContainerStarted","Data":"36c766afcc101b8cc9f43691919f72e75d9ceb202906bf4d037cfd104c1f6cf2"}
Jul 07 19:06:12.784318 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.784297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb" event={"ID":"4e05057e-6b20-4087-b12f-bee036bc3f7e","Type":"ContainerStarted","Data":"350b681824779bb785e8b166a09b074e0838db259c011853ace7a6253ed70171"}
Jul 07 19:06:12.940628 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.940595    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"]
Jul 07 19:06:12.942773 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.942758    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:12.944993 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.944970    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 19:06:12.945123 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.945003    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 19:06:12.945123 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.945038    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2gpc4\""
Jul 07 19:06:12.945123 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.945084    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 19:06:12.945526 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.945493    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:06:12.956084 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:12.956057    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"]
Jul 07 19:06:13.034396 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034306    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.034396 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d01f14c-20ad-4569-a963-cb9b1c6038ae-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.034396 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.034689 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.034689 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.034689 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qpl\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-kube-api-access-27qpl\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.034689 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.034536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.135869 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.135830    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.135869 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.135873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d01f14c-20ad-4569-a963-cb9b1c6038ae-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.136105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.135920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.136105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.135943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.136105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.135973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.136105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.136003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qpl\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-kube-api-access-27qpl\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.136105 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.136031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.136633 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.136603    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.138775 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.138747    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.138895 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.138777    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d01f14c-20ad-4569-a963-cb9b1c6038ae-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.138985 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.138952    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.139087 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.139027    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.144233 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.144206    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qpl\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-kube-api-access-27qpl\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.144556 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.144537    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvzrb\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.252518 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.252481    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:13.409019 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.408977    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"]
Jul 07 19:06:13.411407 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:06:13.411378    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d01f14c_20ad_4569_a963_cb9b1c6038ae.slice/crio-af9a528529f0c4c0deea4ef39bfc18a8e730d92d00c3c1b7606bbd29fdb77e78 WatchSource:0}: Error finding container af9a528529f0c4c0deea4ef39bfc18a8e730d92d00c3c1b7606bbd29fdb77e78: Status 404 returned error can't find the container with id af9a528529f0c4c0deea4ef39bfc18a8e730d92d00c3c1b7606bbd29fdb77e78
Jul 07 19:06:13.792118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:13.792080    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb" event={"ID":"9d01f14c-20ad-4569-a963-cb9b1c6038ae","Type":"ContainerStarted","Data":"af9a528529f0c4c0deea4ef39bfc18a8e730d92d00c3c1b7606bbd29fdb77e78"}
Jul 07 19:06:16.483303 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.483279    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 19:06:16.486669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.486635    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:06:16.486770 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.486699    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:06:16.503503 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.503483    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 19:06:16.807788 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.807673    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb" event={"ID":"9d01f14c-20ad-4569-a963-cb9b1c6038ae","Type":"ContainerStarted","Data":"4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10"}
Jul 07 19:06:16.807956 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.807906    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:16.809265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.809232    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb" event={"ID":"4e05057e-6b20-4087-b12f-bee036bc3f7e","Type":"ContainerStarted","Data":"312b6a56ad7358198c74499f56046d589c63da3a25d20d812a05fe0553052bf9"}
Jul 07 19:06:16.810688 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.810659    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54" event={"ID":"44254f20-e593-4d81-a233-2e02887cca48","Type":"ContainerStarted","Data":"29cdb6ab10298bfa3a4074b71e8a68ccd9682f7058a96d958cf10a7cd6a0428e"}
Jul 07 19:06:16.810820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.810804    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:16.829110 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.829067    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb" podStartSLOduration=1.756435948 podStartE2EDuration="4.829048831s" totalImagesPullingTime="3.072612883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:16.827172541 +0000 UTC m=+301.967546755" watchObservedRunningTime="2026-07-07 19:06:16.829048831 +0000 UTC m=+301.969423011"
Jul 07 19:06:16.845005 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.844959    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54" podStartSLOduration=1.719641965 podStartE2EDuration="5.844944795s" totalImagesPullingTime="4.12530283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:16.844870687 +0000 UTC m=+301.985244868" watchObservedRunningTime="2026-07-07 19:06:16.844944795 +0000 UTC m=+301.985318975"
Jul 07 19:06:16.860551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:16.860485    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-955bd7587-7mjhb" podStartSLOduration=1.545132809 podStartE2EDuration="5.860471349s" totalImagesPullingTime="4.31533854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:16.859556842 +0000 UTC m=+301.999931023" watchObservedRunningTime="2026-07-07 19:06:16.860471349 +0000 UTC m=+302.000845528"
Jul 07 19:06:17.817021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:17.816993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:21.591787 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.591757    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"]
Jul 07 19:06:21.593967 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.593951    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.599486 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.599458    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 19:06:21.599635 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.599488    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-k57qc\""
Jul 07 19:06:21.606209 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.606187    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"]
Jul 07 19:06:21.608259 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.608242    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:21.610971 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.610953    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k2q7d\""
Jul 07 19:06:21.611433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.611411    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 19:06:21.613192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.613169    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"]
Jul 07 19:06:21.622293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.622266    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"]
Jul 07 19:06:21.718728 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.718695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:21.718901 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.718739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/454c9f76-6028-4126-8d47-7970b51cb362-cert\") pod \"kserve-controller-manager-d6f4b65b8-r86ct\" (UID: \"454c9f76-6028-4126-8d47-7970b51cb362\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.718901 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.718761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvvs7\" (UniqueName: \"kubernetes.io/projected/454c9f76-6028-4126-8d47-7970b51cb362-kube-api-access-qvvs7\") pod \"kserve-controller-manager-d6f4b65b8-r86ct\" (UID: \"454c9f76-6028-4126-8d47-7970b51cb362\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.718901 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.718861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82snn\" (UniqueName: \"kubernetes.io/projected/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-kube-api-access-82snn\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:21.819981 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.819944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82snn\" (UniqueName: \"kubernetes.io/projected/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-kube-api-access-82snn\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:21.820137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.819997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:21.820137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.820039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/454c9f76-6028-4126-8d47-7970b51cb362-cert\") pod \"kserve-controller-manager-d6f4b65b8-r86ct\" (UID: \"454c9f76-6028-4126-8d47-7970b51cb362\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.820137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.820066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvvs7\" (UniqueName: \"kubernetes.io/projected/454c9f76-6028-4126-8d47-7970b51cb362-kube-api-access-qvvs7\") pod \"kserve-controller-manager-d6f4b65b8-r86ct\" (UID: \"454c9f76-6028-4126-8d47-7970b51cb362\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.820240 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:06:21.820181    2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 19:06:21.820273 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:06:21.820253    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-cert podName:fa1f95f5-a2f9-4bf1-96d6-aef881d3b956 nodeName:}" failed. No retries permitted until 2026-07-07 19:06:22.320233439 +0000 UTC m=+307.460607610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-cert") pod "llmisvc-controller-manager-777c6bd7d5-rbpkk" (UID: "fa1f95f5-a2f9-4bf1-96d6-aef881d3b956") : secret "llmisvc-webhook-server-cert" not found
Jul 07 19:06:21.822502 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.822486    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/454c9f76-6028-4126-8d47-7970b51cb362-cert\") pod \"kserve-controller-manager-d6f4b65b8-r86ct\" (UID: \"454c9f76-6028-4126-8d47-7970b51cb362\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.850610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.850539    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82snn\" (UniqueName: \"kubernetes.io/projected/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-kube-api-access-82snn\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:21.850610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.850553    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvvs7\" (UniqueName: \"kubernetes.io/projected/454c9f76-6028-4126-8d47-7970b51cb362-kube-api-access-qvvs7\") pod \"kserve-controller-manager-d6f4b65b8-r86ct\" (UID: \"454c9f76-6028-4126-8d47-7970b51cb362\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:21.904471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:21.904444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:22.043263 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.043230    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"]
Jul 07 19:06:22.045431 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:06:22.045407    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454c9f76_6028_4126_8d47_7970b51cb362.slice/crio-bf10283603cf9f57d83866d7ac3916e5c89b1d42b33bb0da9d8128f5dcb02010 WatchSource:0}: Error finding container bf10283603cf9f57d83866d7ac3916e5c89b1d42b33bb0da9d8128f5dcb02010: Status 404 returned error can't find the container with id bf10283603cf9f57d83866d7ac3916e5c89b1d42b33bb0da9d8128f5dcb02010
Jul 07 19:06:22.046880 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.046863    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:06:22.324011 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.323921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:22.326273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.326253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa1f95f5-a2f9-4bf1-96d6-aef881d3b956-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rbpkk\" (UID: \"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:22.517279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.517241    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:22.658310 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.658287    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"]
Jul 07 19:06:22.659624 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:06:22.659602    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa1f95f5_a2f9_4bf1_96d6_aef881d3b956.slice/crio-b88a3405451db6b3bd98d2916baaeaf73fbd8f6879981c0606dba9de1dbb9124 WatchSource:0}: Error finding container b88a3405451db6b3bd98d2916baaeaf73fbd8f6879981c0606dba9de1dbb9124: Status 404 returned error can't find the container with id b88a3405451db6b3bd98d2916baaeaf73fbd8f6879981c0606dba9de1dbb9124
Jul 07 19:06:22.839678 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.839638    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk" event={"ID":"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956","Type":"ContainerStarted","Data":"b88a3405451db6b3bd98d2916baaeaf73fbd8f6879981c0606dba9de1dbb9124"}
Jul 07 19:06:22.840782 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:22.840756    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct" event={"ID":"454c9f76-6028-4126-8d47-7970b51cb362","Type":"ContainerStarted","Data":"bf10283603cf9f57d83866d7ac3916e5c89b1d42b33bb0da9d8128f5dcb02010"}
Jul 07 19:06:24.560710 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.560680    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"]
Jul 07 19:06:24.561092 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.560899    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb" podUID="9d01f14c-20ad-4569-a963-cb9b1c6038ae" containerName="discovery" containerID="cri-o://4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10" gracePeriod=30
Jul 07 19:06:24.823738 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.823715    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:24.855695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.855664    2569 generic.go:356] "Generic (PLEG): container finished" podID="9d01f14c-20ad-4569-a963-cb9b1c6038ae" containerID="4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10" exitCode=0
Jul 07 19:06:24.855851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.855713    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb" event={"ID":"9d01f14c-20ad-4569-a963-cb9b1c6038ae","Type":"ContainerDied","Data":"4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10"}
Jul 07 19:06:24.855851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.855721    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"
Jul 07 19:06:24.855851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.855752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb" event={"ID":"9d01f14c-20ad-4569-a963-cb9b1c6038ae","Type":"ContainerDied","Data":"af9a528529f0c4c0deea4ef39bfc18a8e730d92d00c3c1b7606bbd29fdb77e78"}
Jul 07 19:06:24.855851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.855778    2569 scope.go:117] "RemoveContainer" containerID="4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10"
Jul 07 19:06:24.947183 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-dns-cert\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947200    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-kubeconfig\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947274    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-cacerts\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947331    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27qpl\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-kube-api-access-27qpl\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947596 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947441    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-ca-configmap\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947596 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947527    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d01f14c-20ad-4569-a963-cb9b1c6038ae-local-certs\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947596 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947556    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-token\") pod \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\" (UID: \"9d01f14c-20ad-4569-a963-cb9b1c6038ae\") "
Jul 07 19:06:24.947931 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.947890    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:06:24.950273 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.950225    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:06:24.950411 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.950330    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d01f14c-20ad-4569-a963-cb9b1c6038ae-local-certs" (OuterVolumeSpecName: "local-certs") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:06:24.950411 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.950388    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-kube-api-access-27qpl" (OuterVolumeSpecName: "kube-api-access-27qpl") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "kube-api-access-27qpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:06:24.950539 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.950388    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-cacerts" (OuterVolumeSpecName: "cacerts") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:06:24.950601 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.950562    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:06:24.950661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:24.950602    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d01f14c-20ad-4569-a963-cb9b1c6038ae" (UID: "9d01f14c-20ad-4569-a963-cb9b1c6038ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:06:25.049095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049058    2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-cacerts\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.049095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049096    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27qpl\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-kube-api-access-27qpl\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.049346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049111    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-ca-configmap\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.049346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049125    2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d01f14c-20ad-4569-a963-cb9b1c6038ae-local-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.049346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049140    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.049346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049152    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-csr-dns-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.049346 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.049164    2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d01f14c-20ad-4569-a963-cb9b1c6038ae-istio-kubeconfig\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:06:25.182337 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.182309    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"]
Jul 07 19:06:25.186817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.186788    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvzrb"]
Jul 07 19:06:25.411196 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.411174    2569 scope.go:117] "RemoveContainer" containerID="4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10"
Jul 07 19:06:25.411498 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:06:25.411479    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10\": container with ID starting with 4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10 not found: ID does not exist" containerID="4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10"
Jul 07 19:06:25.411579 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.411528    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10"} err="failed to get container status \"4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10\": rpc error: code = NotFound desc = could not find container \"4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10\": container with ID starting with 4f7ae675b4be69d44040433aa96a637686f5f3b9b9004e1d2346e9e7cbe8db10 not found: ID does not exist"
Jul 07 19:06:25.492632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.492596    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d01f14c-20ad-4569-a963-cb9b1c6038ae" path="/var/lib/kubelet/pods/9d01f14c-20ad-4569-a963-cb9b1c6038ae/volumes"
Jul 07 19:06:25.862221 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.862187    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct" event={"ID":"454c9f76-6028-4126-8d47-7970b51cb362","Type":"ContainerStarted","Data":"1b6cc3b7b675d1f24039564d22de50ae499235d256b240e8692450b636762dea"}
Jul 07 19:06:25.862705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.862273    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:25.884623 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:25.884561    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct" podStartSLOduration=1.495697395 podStartE2EDuration="4.884545695s" totalImagesPullingTime="3.3888483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:25.882296761 +0000 UTC m=+311.022670979" watchObservedRunningTime="2026-07-07 19:06:25.884545695 +0000 UTC m=+311.024919874"
Jul 07 19:06:26.869228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:26.869191    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk" event={"ID":"fa1f95f5-a2f9-4bf1-96d6-aef881d3b956","Type":"ContainerStarted","Data":"397cb0fcfa66eed565ae173395403d5bdec023218b083115d62b4a0252db6604"}
Jul 07 19:06:26.869642 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:26.869392    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:06:26.890278 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:26.890226    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk" podStartSLOduration=2.4762532950000002 podStartE2EDuration="5.890211678s" totalImagesPullingTime="3.413958383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:26.888735152 +0000 UTC m=+312.029109332" watchObservedRunningTime="2026-07-07 19:06:26.890211678 +0000 UTC m=+312.030585861"
Jul 07 19:06:27.818860 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:27.818829    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dgb54"
Jul 07 19:06:56.875192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:56.875157    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-r86ct"
Jul 07 19:06:57.877256 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:06:57.877222    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rbpkk"
Jul 07 19:07:12.011754 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.011681    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z9whz"]
Jul 07 19:07:12.012106 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.011999    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d01f14c-20ad-4569-a963-cb9b1c6038ae" containerName="discovery"
Jul 07 19:07:12.012106 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.012013    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d01f14c-20ad-4569-a963-cb9b1c6038ae" containerName="discovery"
Jul 07 19:07:12.012106 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.012087    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d01f14c-20ad-4569-a963-cb9b1c6038ae" containerName="discovery"
Jul 07 19:07:12.013885 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.013870    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:12.016317 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.016295    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 19:07:12.017139 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.017116    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 19:07:12.017268 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.017140    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6bfsz\""
Jul 07 19:07:12.025726 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.025698    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z9whz"]
Jul 07 19:07:12.145309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.145270    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6jf7\" (UniqueName: \"kubernetes.io/projected/6b628ba3-62ec-4dd5-8876-2c1ebecd5410-kube-api-access-j6jf7\") pod \"kuadrant-operator-catalog-z9whz\" (UID: \"6b628ba3-62ec-4dd5-8876-2c1ebecd5410\") " pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:12.246740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.246702    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6jf7\" (UniqueName: \"kubernetes.io/projected/6b628ba3-62ec-4dd5-8876-2c1ebecd5410-kube-api-access-j6jf7\") pod \"kuadrant-operator-catalog-z9whz\" (UID: \"6b628ba3-62ec-4dd5-8876-2c1ebecd5410\") " pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:12.256279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.256248    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6jf7\" (UniqueName: \"kubernetes.io/projected/6b628ba3-62ec-4dd5-8876-2c1ebecd5410-kube-api-access-j6jf7\") pod \"kuadrant-operator-catalog-z9whz\" (UID: \"6b628ba3-62ec-4dd5-8876-2c1ebecd5410\") " pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:12.325709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.325604    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:12.360778 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.360743    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z9whz"]
Jul 07 19:07:12.457545 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.457492    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z9whz"]
Jul 07 19:07:12.460688 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:12.460662    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b628ba3_62ec_4dd5_8876_2c1ebecd5410.slice/crio-efe75d0a3d86c7c826ed4724aedcdc5bd63e4470ca70eb8e520f60c152e547c1 WatchSource:0}: Error finding container efe75d0a3d86c7c826ed4724aedcdc5bd63e4470ca70eb8e520f60c152e547c1: Status 404 returned error can't find the container with id efe75d0a3d86c7c826ed4724aedcdc5bd63e4470ca70eb8e520f60c152e547c1
Jul 07 19:07:12.571061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.571029    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gjpkm"]
Jul 07 19:07:12.573705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.573690    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:12.582216 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.582192    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gjpkm"]
Jul 07 19:07:12.650367 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.650335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwp52\" (UniqueName: \"kubernetes.io/projected/cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918-kube-api-access-kwp52\") pod \"kuadrant-operator-catalog-gjpkm\" (UID: \"cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918\") " pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:12.751074 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.751039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwp52\" (UniqueName: \"kubernetes.io/projected/cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918-kube-api-access-kwp52\") pod \"kuadrant-operator-catalog-gjpkm\" (UID: \"cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918\") " pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:12.759112 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.759086    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwp52\" (UniqueName: \"kubernetes.io/projected/cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918-kube-api-access-kwp52\") pod \"kuadrant-operator-catalog-gjpkm\" (UID: \"cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918\") " pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:12.883249 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:12.883219    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:13.068405 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:13.068376    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gjpkm"]
Jul 07 19:07:13.073116 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:13.073086    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6c1d7e_f2d0_4b1b_9735_b9f7d0e9d918.slice/crio-80399ffc7b0570ebf7720afb9f68e338135bc58f19ff77153bf64d3a6191e6fa WatchSource:0}: Error finding container 80399ffc7b0570ebf7720afb9f68e338135bc58f19ff77153bf64d3a6191e6fa: Status 404 returned error can't find the container with id 80399ffc7b0570ebf7720afb9f68e338135bc58f19ff77153bf64d3a6191e6fa
Jul 07 19:07:13.081824 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:13.081792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z9whz" event={"ID":"6b628ba3-62ec-4dd5-8876-2c1ebecd5410","Type":"ContainerStarted","Data":"efe75d0a3d86c7c826ed4724aedcdc5bd63e4470ca70eb8e520f60c152e547c1"}
Jul 07 19:07:13.082914 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:13.082886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm" event={"ID":"cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918","Type":"ContainerStarted","Data":"80399ffc7b0570ebf7720afb9f68e338135bc58f19ff77153bf64d3a6191e6fa"}
Jul 07 19:07:15.094749 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.094714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z9whz" event={"ID":"6b628ba3-62ec-4dd5-8876-2c1ebecd5410","Type":"ContainerStarted","Data":"c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4"}
Jul 07 19:07:15.095216 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.094761    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-z9whz" podUID="6b628ba3-62ec-4dd5-8876-2c1ebecd5410" containerName="registry-server" containerID="cri-o://c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4" gracePeriod=2
Jul 07 19:07:15.096255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.096228    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm" event={"ID":"cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918","Type":"ContainerStarted","Data":"698e856edeb3eb364ec40409b1e4c2e1865cadd255c45e7e44f9b7a73af7ef27"}
Jul 07 19:07:15.113376 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.113319    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z9whz" podStartSLOduration=2.301181661 podStartE2EDuration="4.113299626s" totalImagesPullingTime="1.812117965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:07:15.110618112 +0000 UTC m=+360.250992293" watchObservedRunningTime="2026-07-07 19:07:15.113299626 +0000 UTC m=+360.253673808"
Jul 07 19:07:15.127993 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.127937    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm" podStartSLOduration=1.927635861 podStartE2EDuration="3.127914547s" totalImagesPullingTime="1.200278686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:07:15.126012904 +0000 UTC m=+360.266387080" watchObservedRunningTime="2026-07-07 19:07:15.127914547 +0000 UTC m=+360.268288728"
Jul 07 19:07:15.340489 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.340465    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:15.477285 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.477256    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6jf7\" (UniqueName: \"kubernetes.io/projected/6b628ba3-62ec-4dd5-8876-2c1ebecd5410-kube-api-access-j6jf7\") pod \"6b628ba3-62ec-4dd5-8876-2c1ebecd5410\" (UID: \"6b628ba3-62ec-4dd5-8876-2c1ebecd5410\") "
Jul 07 19:07:15.479451 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.479429    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b628ba3-62ec-4dd5-8876-2c1ebecd5410-kube-api-access-j6jf7" (OuterVolumeSpecName: "kube-api-access-j6jf7") pod "6b628ba3-62ec-4dd5-8876-2c1ebecd5410" (UID: "6b628ba3-62ec-4dd5-8876-2c1ebecd5410"). InnerVolumeSpecName "kube-api-access-j6jf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:07:15.578555 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:15.578501    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6jf7\" (UniqueName: \"kubernetes.io/projected/6b628ba3-62ec-4dd5-8876-2c1ebecd5410-kube-api-access-j6jf7\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:16.101377 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.101343    2569 generic.go:356] "Generic (PLEG): container finished" podID="6b628ba3-62ec-4dd5-8876-2c1ebecd5410" containerID="c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4" exitCode=0
Jul 07 19:07:16.101828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.101385    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z9whz"
Jul 07 19:07:16.101828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.101429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z9whz" event={"ID":"6b628ba3-62ec-4dd5-8876-2c1ebecd5410","Type":"ContainerDied","Data":"c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4"}
Jul 07 19:07:16.101828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.101476    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z9whz" event={"ID":"6b628ba3-62ec-4dd5-8876-2c1ebecd5410","Type":"ContainerDied","Data":"efe75d0a3d86c7c826ed4724aedcdc5bd63e4470ca70eb8e520f60c152e547c1"}
Jul 07 19:07:16.101828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.101497    2569 scope.go:117] "RemoveContainer" containerID="c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4"
Jul 07 19:07:16.110255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.110238    2569 scope.go:117] "RemoveContainer" containerID="c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4"
Jul 07 19:07:16.110532 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:07:16.110497    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4\": container with ID starting with c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4 not found: ID does not exist" containerID="c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4"
Jul 07 19:07:16.110610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.110553    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4"} err="failed to get container status \"c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4\": rpc error: code = NotFound desc = could not find container \"c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4\": container with ID starting with c154b05d321291334e63a15ccb152407fe45d47f2566df2a0abbfa5a48f259b4 not found: ID does not exist"
Jul 07 19:07:16.117491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.117468    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z9whz"]
Jul 07 19:07:16.128649 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:16.124236    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z9whz"]
Jul 07 19:07:17.491024 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:17.490981    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b628ba3-62ec-4dd5-8876-2c1ebecd5410" path="/var/lib/kubelet/pods/6b628ba3-62ec-4dd5-8876-2c1ebecd5410/volumes"
Jul 07 19:07:22.884424 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:22.884377    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:22.884845 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:22.884447    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:22.906951 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:22.906922    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:23.155534 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:23.155445    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gjpkm"
Jul 07 19:07:27.390779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.390746    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"]
Jul 07 19:07:27.391277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.391050    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b628ba3-62ec-4dd5-8876-2c1ebecd5410" containerName="registry-server"
Jul 07 19:07:27.391277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.391060    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b628ba3-62ec-4dd5-8876-2c1ebecd5410" containerName="registry-server"
Jul 07 19:07:27.391277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.391127    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b628ba3-62ec-4dd5-8876-2c1ebecd5410" containerName="registry-server"
Jul 07 19:07:27.395619 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.395603    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.397893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.397869    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jqsvg\""
Jul 07 19:07:27.409866 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.404879    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"]
Jul 07 19:07:27.480324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.480286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.480538 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.480338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc497\" (UniqueName: \"kubernetes.io/projected/99b142a1-662e-4fbb-b354-04bdcd347145-kube-api-access-vc497\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.480538 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.480425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.580821 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.580776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.580969 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.580844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.580969 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.580876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc497\" (UniqueName: \"kubernetes.io/projected/99b142a1-662e-4fbb-b354-04bdcd347145-kube-api-access-vc497\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.581140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.581122    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.581221 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.581199    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.590399 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.590377    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc497\" (UniqueName: \"kubernetes.io/projected/99b142a1-662e-4fbb-b354-04bdcd347145-kube-api-access-vc497\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.706005 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.705922    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:27.837039 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.836995    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"]
Jul 07 19:07:27.839198 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:27.839173    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b142a1_662e_4fbb_b354_04bdcd347145.slice/crio-e02788908a00bac9fcb1b353d4cd3524cf186bd7b7f0ec44f152b1b4b9928760 WatchSource:0}: Error finding container e02788908a00bac9fcb1b353d4cd3524cf186bd7b7f0ec44f152b1b4b9928760: Status 404 returned error can't find the container with id e02788908a00bac9fcb1b353d4cd3524cf186bd7b7f0ec44f152b1b4b9928760
Jul 07 19:07:27.994646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.994570    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"]
Jul 07 19:07:27.997958 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:27.997937    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.009307 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.009269    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"]
Jul 07 19:07:28.085809 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.085776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.086013 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.085832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs2pz\" (UniqueName: \"kubernetes.io/projected/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-kube-api-access-hs2pz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.086013 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.085924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.157923 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.157892    2569 generic.go:356] "Generic (PLEG): container finished" podID="99b142a1-662e-4fbb-b354-04bdcd347145" containerID="c9c20e1077f317d5edbb90fd6c135d2efda0c209094a97df2b2598664195ae9d" exitCode=0
Jul 07 19:07:28.158102 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.157982    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8" event={"ID":"99b142a1-662e-4fbb-b354-04bdcd347145","Type":"ContainerDied","Data":"c9c20e1077f317d5edbb90fd6c135d2efda0c209094a97df2b2598664195ae9d"}
Jul 07 19:07:28.158102 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.158038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8" event={"ID":"99b142a1-662e-4fbb-b354-04bdcd347145","Type":"ContainerStarted","Data":"e02788908a00bac9fcb1b353d4cd3524cf186bd7b7f0ec44f152b1b4b9928760"}
Jul 07 19:07:28.187176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.187144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.187329 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.187211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs2pz\" (UniqueName: \"kubernetes.io/projected/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-kube-api-access-hs2pz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.187329 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.187236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.187546 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.187499    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.187617 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.187562    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.196449 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.196429    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs2pz\" (UniqueName: \"kubernetes.io/projected/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-kube-api-access-hs2pz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.307475 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.307393    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:28.401338 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.401309    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"]
Jul 07 19:07:28.406291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.406271    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.416343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.416315    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"]
Jul 07 19:07:28.443528 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.443485    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"]
Jul 07 19:07:28.446480 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:28.446455    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069ebcf7_5c0c_4e15_9f16_f93c2a50bb2b.slice/crio-af32fc8753e59d5b2002f4bd924570f994adfd4edcf6ca7e1fb90e936679275e WatchSource:0}: Error finding container af32fc8753e59d5b2002f4bd924570f994adfd4edcf6ca7e1fb90e936679275e: Status 404 returned error can't find the container with id af32fc8753e59d5b2002f4bd924570f994adfd4edcf6ca7e1fb90e936679275e
Jul 07 19:07:28.591142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.591117    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jg62\" (UniqueName: \"kubernetes.io/projected/b06ea888-7b96-4d67-8f83-24f14cf17d7b-kube-api-access-4jg62\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.591261 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.591168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.591303 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.591284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.692718 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.692683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.692849 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.692750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.692849 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.692777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jg62\" (UniqueName: \"kubernetes.io/projected/b06ea888-7b96-4d67-8f83-24f14cf17d7b-kube-api-access-4jg62\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.693062 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.693045    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.693102 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.693075    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.702931 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.702903    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jg62\" (UniqueName: \"kubernetes.io/projected/b06ea888-7b96-4d67-8f83-24f14cf17d7b-kube-api-access-4jg62\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.718010 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.717989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:28.792487 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.792456    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"]
Jul 07 19:07:28.797043 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.797021    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.805525 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.805425    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"]
Jul 07 19:07:28.866613 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.866592    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"]
Jul 07 19:07:28.875554 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:28.875523    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06ea888_7b96_4d67_8f83_24f14cf17d7b.slice/crio-0ceb788dd34ade20d7ebdaea68ce79e997a7717b8579d752026cba4bd449bcc4 WatchSource:0}: Error finding container 0ceb788dd34ade20d7ebdaea68ce79e997a7717b8579d752026cba4bd449bcc4: Status 404 returned error can't find the container with id 0ceb788dd34ade20d7ebdaea68ce79e997a7717b8579d752026cba4bd449bcc4
Jul 07 19:07:28.894277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.894254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.894400 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.894327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwd8\" (UniqueName: \"kubernetes.io/projected/1f4c01ad-4be8-48bb-8440-94e2675aff11-kube-api-access-gmwd8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.894400 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.894353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.995058 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.995031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.995175 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.995084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.995175 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.995155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwd8\" (UniqueName: \"kubernetes.io/projected/1f4c01ad-4be8-48bb-8440-94e2675aff11-kube-api-access-gmwd8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.995367 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.995346    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:28.995440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:28.995417    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:29.004326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.004306    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwd8\" (UniqueName: \"kubernetes.io/projected/1f4c01ad-4be8-48bb-8440-94e2675aff11-kube-api-access-gmwd8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:29.109555 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.109522    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:29.168137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.168099    2569 generic.go:356] "Generic (PLEG): container finished" podID="99b142a1-662e-4fbb-b354-04bdcd347145" containerID="67130f6fb540280baa2c5f8967310bdb00166a3ce3c6f789ca45a13a6575a6a2" exitCode=0
Jul 07 19:07:29.168302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.168211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8" event={"ID":"99b142a1-662e-4fbb-b354-04bdcd347145","Type":"ContainerDied","Data":"67130f6fb540280baa2c5f8967310bdb00166a3ce3c6f789ca45a13a6575a6a2"}
Jul 07 19:07:29.170093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.170070    2569 generic.go:356] "Generic (PLEG): container finished" podID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerID="3af31221306e929ee86dc9dc4191d665f76ea387a4b300981ba508a129c4981b" exitCode=0
Jul 07 19:07:29.170207 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.170166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65" event={"ID":"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b","Type":"ContainerDied","Data":"3af31221306e929ee86dc9dc4191d665f76ea387a4b300981ba508a129c4981b"}
Jul 07 19:07:29.170267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.170211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65" event={"ID":"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b","Type":"ContainerStarted","Data":"af32fc8753e59d5b2002f4bd924570f994adfd4edcf6ca7e1fb90e936679275e"}
Jul 07 19:07:29.171972 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.171951    2569 generic.go:356] "Generic (PLEG): container finished" podID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerID="6d5a24579204438ed01b87c1b0e91de4d075c5b9e704415ccc021132b19c178e" exitCode=0
Jul 07 19:07:29.172080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.171995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8" event={"ID":"b06ea888-7b96-4d67-8f83-24f14cf17d7b","Type":"ContainerDied","Data":"6d5a24579204438ed01b87c1b0e91de4d075c5b9e704415ccc021132b19c178e"}
Jul 07 19:07:29.172080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.172026    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8" event={"ID":"b06ea888-7b96-4d67-8f83-24f14cf17d7b","Type":"ContainerStarted","Data":"0ceb788dd34ade20d7ebdaea68ce79e997a7717b8579d752026cba4bd449bcc4"}
Jul 07 19:07:29.246359 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:29.246331    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"]
Jul 07 19:07:29.248132 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:29.248104    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4c01ad_4be8_48bb_8440_94e2675aff11.slice/crio-8ccd482c1e17fd4110bdf1c1a2396b14ff90701ba8ea29cccd32337e0206c7a1 WatchSource:0}: Error finding container 8ccd482c1e17fd4110bdf1c1a2396b14ff90701ba8ea29cccd32337e0206c7a1: Status 404 returned error can't find the container with id 8ccd482c1e17fd4110bdf1c1a2396b14ff90701ba8ea29cccd32337e0206c7a1
Jul 07 19:07:30.178143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.178117    2569 generic.go:356] "Generic (PLEG): container finished" podID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerID="e873f5b2f3000ff69ece7f61e7d5d3e323af6d9a04312b9ad07ec31e87ff4e89" exitCode=0
Jul 07 19:07:30.178523 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.178198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd" event={"ID":"1f4c01ad-4be8-48bb-8440-94e2675aff11","Type":"ContainerDied","Data":"e873f5b2f3000ff69ece7f61e7d5d3e323af6d9a04312b9ad07ec31e87ff4e89"}
Jul 07 19:07:30.178523 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.178287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd" event={"ID":"1f4c01ad-4be8-48bb-8440-94e2675aff11","Type":"ContainerStarted","Data":"8ccd482c1e17fd4110bdf1c1a2396b14ff90701ba8ea29cccd32337e0206c7a1"}
Jul 07 19:07:30.180599 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.180573    2569 generic.go:356] "Generic (PLEG): container finished" podID="99b142a1-662e-4fbb-b354-04bdcd347145" containerID="07b8b2c0c690acd239cc6a68938dd9aae783329197089c4c0c915f238ac602ee" exitCode=0
Jul 07 19:07:30.180710 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.180654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8" event={"ID":"99b142a1-662e-4fbb-b354-04bdcd347145","Type":"ContainerDied","Data":"07b8b2c0c690acd239cc6a68938dd9aae783329197089c4c0c915f238ac602ee"}
Jul 07 19:07:30.182754 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.182731    2569 generic.go:356] "Generic (PLEG): container finished" podID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerID="43296fa915bd6d887041740f5ccb4db3002275ee8113e19d88557f00e7cffd6d" exitCode=0
Jul 07 19:07:30.182857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.182819    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65" event={"ID":"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b","Type":"ContainerDied","Data":"43296fa915bd6d887041740f5ccb4db3002275ee8113e19d88557f00e7cffd6d"}
Jul 07 19:07:30.184844 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:30.184822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8" event={"ID":"b06ea888-7b96-4d67-8f83-24f14cf17d7b","Type":"ContainerStarted","Data":"d8c25e7ff76b747e6ede5c45c9d8abf078a1a291449557fa2283ab2e2c1c483d"}
Jul 07 19:07:31.192025 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.191934    2569 generic.go:356] "Generic (PLEG): container finished" podID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerID="931959bcff3ef575f1f4baccaa37bba5b9e2309b9da641cc6b43606e588992ec" exitCode=0
Jul 07 19:07:31.192412 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.192025    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65" event={"ID":"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b","Type":"ContainerDied","Data":"931959bcff3ef575f1f4baccaa37bba5b9e2309b9da641cc6b43606e588992ec"}
Jul 07 19:07:31.193721 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.193694    2569 generic.go:356] "Generic (PLEG): container finished" podID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerID="d8c25e7ff76b747e6ede5c45c9d8abf078a1a291449557fa2283ab2e2c1c483d" exitCode=0
Jul 07 19:07:31.193865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.193773    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8" event={"ID":"b06ea888-7b96-4d67-8f83-24f14cf17d7b","Type":"ContainerDied","Data":"d8c25e7ff76b747e6ede5c45c9d8abf078a1a291449557fa2283ab2e2c1c483d"}
Jul 07 19:07:31.195843 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.195823    2569 generic.go:356] "Generic (PLEG): container finished" podID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerID="600ef623089d208d0c0a58e833f5dcb04707d3923b0c5d20af58cccc8bdc2496" exitCode=0
Jul 07 19:07:31.195957 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.195854    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd" event={"ID":"1f4c01ad-4be8-48bb-8440-94e2675aff11","Type":"ContainerDied","Data":"600ef623089d208d0c0a58e833f5dcb04707d3923b0c5d20af58cccc8bdc2496"}
Jul 07 19:07:31.323328 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.323302    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:31.517733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.517652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-bundle\") pod \"99b142a1-662e-4fbb-b354-04bdcd347145\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") "
Jul 07 19:07:31.517733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.517689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc497\" (UniqueName: \"kubernetes.io/projected/99b142a1-662e-4fbb-b354-04bdcd347145-kube-api-access-vc497\") pod \"99b142a1-662e-4fbb-b354-04bdcd347145\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") "
Jul 07 19:07:31.517733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.517721    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-util\") pod \"99b142a1-662e-4fbb-b354-04bdcd347145\" (UID: \"99b142a1-662e-4fbb-b354-04bdcd347145\") "
Jul 07 19:07:31.518274 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.518251    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-bundle" (OuterVolumeSpecName: "bundle") pod "99b142a1-662e-4fbb-b354-04bdcd347145" (UID: "99b142a1-662e-4fbb-b354-04bdcd347145"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:31.519821 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.519797    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b142a1-662e-4fbb-b354-04bdcd347145-kube-api-access-vc497" (OuterVolumeSpecName: "kube-api-access-vc497") pod "99b142a1-662e-4fbb-b354-04bdcd347145" (UID: "99b142a1-662e-4fbb-b354-04bdcd347145"). InnerVolumeSpecName "kube-api-access-vc497". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:07:31.523151 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.523130    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-util" (OuterVolumeSpecName: "util") pod "99b142a1-662e-4fbb-b354-04bdcd347145" (UID: "99b142a1-662e-4fbb-b354-04bdcd347145"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:31.619069 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.619044    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:31.619069 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.619070    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc497\" (UniqueName: \"kubernetes.io/projected/99b142a1-662e-4fbb-b354-04bdcd347145-kube-api-access-vc497\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:31.619212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:31.619080    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99b142a1-662e-4fbb-b354-04bdcd347145-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:32.202744 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.202710    2569 generic.go:356] "Generic (PLEG): container finished" podID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerID="7157a8a7a3bd6cc7df715711b28ace5cfd2103999554363bfa2794a0f5f1c6ec" exitCode=0
Jul 07 19:07:32.203142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.202804    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd" event={"ID":"1f4c01ad-4be8-48bb-8440-94e2675aff11","Type":"ContainerDied","Data":"7157a8a7a3bd6cc7df715711b28ace5cfd2103999554363bfa2794a0f5f1c6ec"}
Jul 07 19:07:32.204551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.204529    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8"
Jul 07 19:07:32.204551 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.204539    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8" event={"ID":"99b142a1-662e-4fbb-b354-04bdcd347145","Type":"ContainerDied","Data":"e02788908a00bac9fcb1b353d4cd3524cf186bd7b7f0ec44f152b1b4b9928760"}
Jul 07 19:07:32.204743 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.204574    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e02788908a00bac9fcb1b353d4cd3524cf186bd7b7f0ec44f152b1b4b9928760"
Jul 07 19:07:32.206875 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.206832    2569 generic.go:356] "Generic (PLEG): container finished" podID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerID="450a0a83a333933cf5cf5503c3315bcea93d717bd0c03c4467b7aec4fa9abc3c" exitCode=0
Jul 07 19:07:32.206875 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.206856    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8" event={"ID":"b06ea888-7b96-4d67-8f83-24f14cf17d7b","Type":"ContainerDied","Data":"450a0a83a333933cf5cf5503c3315bcea93d717bd0c03c4467b7aec4fa9abc3c"}
Jul 07 19:07:32.339988 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.339965    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:32.527474 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.527393    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-util\") pod \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") "
Jul 07 19:07:32.527638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.527487    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs2pz\" (UniqueName: \"kubernetes.io/projected/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-kube-api-access-hs2pz\") pod \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") "
Jul 07 19:07:32.527638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.527557    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-bundle\") pod \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\" (UID: \"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b\") "
Jul 07 19:07:32.528009 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.527988    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-bundle" (OuterVolumeSpecName: "bundle") pod "069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" (UID: "069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:32.529595 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.529561    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-kube-api-access-hs2pz" (OuterVolumeSpecName: "kube-api-access-hs2pz") pod "069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" (UID: "069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b"). InnerVolumeSpecName "kube-api-access-hs2pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:07:32.532871 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.532851    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-util" (OuterVolumeSpecName: "util") pod "069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" (UID: "069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:32.629191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.628944    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs2pz\" (UniqueName: \"kubernetes.io/projected/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-kube-api-access-hs2pz\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:32.629191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.628978    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:32.629191 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:32.628992    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:33.213275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.213245    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65"
Jul 07 19:07:33.213275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.213269    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65" event={"ID":"069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b","Type":"ContainerDied","Data":"af32fc8753e59d5b2002f4bd924570f994adfd4edcf6ca7e1fb90e936679275e"}
Jul 07 19:07:33.213784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.213316    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af32fc8753e59d5b2002f4bd924570f994adfd4edcf6ca7e1fb90e936679275e"
Jul 07 19:07:33.357222 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.357199    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:33.384979 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.384954    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:33.435488 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.435461    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-util\") pod \"1f4c01ad-4be8-48bb-8440-94e2675aff11\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") "
Jul 07 19:07:33.435627 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.435537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jg62\" (UniqueName: \"kubernetes.io/projected/b06ea888-7b96-4d67-8f83-24f14cf17d7b-kube-api-access-4jg62\") pod \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") "
Jul 07 19:07:33.435627 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.435577    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-bundle\") pod \"1f4c01ad-4be8-48bb-8440-94e2675aff11\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") "
Jul 07 19:07:33.435627 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.435612    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmwd8\" (UniqueName: \"kubernetes.io/projected/1f4c01ad-4be8-48bb-8440-94e2675aff11-kube-api-access-gmwd8\") pod \"1f4c01ad-4be8-48bb-8440-94e2675aff11\" (UID: \"1f4c01ad-4be8-48bb-8440-94e2675aff11\") "
Jul 07 19:07:33.435755 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.435647    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-bundle\") pod \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") "
Jul 07 19:07:33.436157 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.436119    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-bundle" (OuterVolumeSpecName: "bundle") pod "1f4c01ad-4be8-48bb-8440-94e2675aff11" (UID: "1f4c01ad-4be8-48bb-8440-94e2675aff11"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:33.436288 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.436184    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-bundle" (OuterVolumeSpecName: "bundle") pod "b06ea888-7b96-4d67-8f83-24f14cf17d7b" (UID: "b06ea888-7b96-4d67-8f83-24f14cf17d7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:33.437649 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.437620    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06ea888-7b96-4d67-8f83-24f14cf17d7b-kube-api-access-4jg62" (OuterVolumeSpecName: "kube-api-access-4jg62") pod "b06ea888-7b96-4d67-8f83-24f14cf17d7b" (UID: "b06ea888-7b96-4d67-8f83-24f14cf17d7b"). InnerVolumeSpecName "kube-api-access-4jg62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:07:33.437767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.437710    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4c01ad-4be8-48bb-8440-94e2675aff11-kube-api-access-gmwd8" (OuterVolumeSpecName: "kube-api-access-gmwd8") pod "1f4c01ad-4be8-48bb-8440-94e2675aff11" (UID: "1f4c01ad-4be8-48bb-8440-94e2675aff11"). InnerVolumeSpecName "kube-api-access-gmwd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:07:33.441194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.441176    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-util" (OuterVolumeSpecName: "util") pod "1f4c01ad-4be8-48bb-8440-94e2675aff11" (UID: "1f4c01ad-4be8-48bb-8440-94e2675aff11"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:33.536185 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.536143    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-util\") pod \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\" (UID: \"b06ea888-7b96-4d67-8f83-24f14cf17d7b\") "
Jul 07 19:07:33.536401 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.536386    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmwd8\" (UniqueName: \"kubernetes.io/projected/1f4c01ad-4be8-48bb-8440-94e2675aff11-kube-api-access-gmwd8\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:33.536470 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.536405    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:33.536470 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.536417    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:33.536470 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.536429    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jg62\" (UniqueName: \"kubernetes.io/projected/b06ea888-7b96-4d67-8f83-24f14cf17d7b-kube-api-access-4jg62\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:33.536470 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.536442    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f4c01ad-4be8-48bb-8440-94e2675aff11-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:33.541661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.541641    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-util" (OuterVolumeSpecName: "util") pod "b06ea888-7b96-4d67-8f83-24f14cf17d7b" (UID: "b06ea888-7b96-4d67-8f83-24f14cf17d7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:07:33.636920 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:33.636891    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b06ea888-7b96-4d67-8f83-24f14cf17d7b-util\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:07:34.220007 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:34.219976    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8"
Jul 07 19:07:34.220007 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:34.220001    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8" event={"ID":"b06ea888-7b96-4d67-8f83-24f14cf17d7b","Type":"ContainerDied","Data":"0ceb788dd34ade20d7ebdaea68ce79e997a7717b8579d752026cba4bd449bcc4"}
Jul 07 19:07:34.220478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:34.220049    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ceb788dd34ade20d7ebdaea68ce79e997a7717b8579d752026cba4bd449bcc4"
Jul 07 19:07:34.221944 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:34.221916    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd" event={"ID":"1f4c01ad-4be8-48bb-8440-94e2675aff11","Type":"ContainerDied","Data":"8ccd482c1e17fd4110bdf1c1a2396b14ff90701ba8ea29cccd32337e0206c7a1"}
Jul 07 19:07:34.222047 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:34.221954    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd"
Jul 07 19:07:34.222047 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:34.221957    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ccd482c1e17fd4110bdf1c1a2396b14ff90701ba8ea29cccd32337e0206c7a1"
Jul 07 19:07:44.366604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366572    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"]
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366912    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366923    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366933    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366939    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366946    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366951    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366959    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366964    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366970    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366975    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366982    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366986    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366994    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.366999    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367011    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367016    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367023    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367027    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="util"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367033    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367038    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367045    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367052    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="pull"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367057    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367062    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="extract"
Jul 07 19:07:44.367099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367113    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b142a1-662e-4fbb-b354-04bdcd347145" containerName="extract"
Jul 07 19:07:44.367927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367122    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f4c01ad-4be8-48bb-8440-94e2675aff11" containerName="extract"
Jul 07 19:07:44.367927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367131    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06ea888-7b96-4d67-8f83-24f14cf17d7b" containerName="extract"
Jul 07 19:07:44.367927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.367139    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b" containerName="extract"
Jul 07 19:07:44.371920 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.371901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:44.374183 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.374164    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2p687\""
Jul 07 19:07:44.382189 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.382165    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"]
Jul 07 19:07:44.412117 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.412074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brdxt\" (UniqueName: \"kubernetes.io/projected/e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb-kube-api-access-brdxt\") pod \"authorino-operator-75cc8d5cb7-pfrwq\" (UID: \"e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:44.512736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.512698    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brdxt\" (UniqueName: \"kubernetes.io/projected/e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb-kube-api-access-brdxt\") pod \"authorino-operator-75cc8d5cb7-pfrwq\" (UID: \"e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:44.522591 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.522564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brdxt\" (UniqueName: \"kubernetes.io/projected/e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb-kube-api-access-brdxt\") pod \"authorino-operator-75cc8d5cb7-pfrwq\" (UID: \"e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:44.682930 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.682848    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:44.816179 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:44.816144    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"]
Jul 07 19:07:44.819433 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:44.819410    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a8fd64_af0c_4c73_ada2_9fcd9b127bdb.slice/crio-54c06b743b0b481f2f11e0e6cd2a606f0d5946c726235278640c3d54ecc5225a WatchSource:0}: Error finding container 54c06b743b0b481f2f11e0e6cd2a606f0d5946c726235278640c3d54ecc5225a: Status 404 returned error can't find the container with id 54c06b743b0b481f2f11e0e6cd2a606f0d5946c726235278640c3d54ecc5225a
Jul 07 19:07:45.279282 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.279248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq" event={"ID":"e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb","Type":"ContainerStarted","Data":"54c06b743b0b481f2f11e0e6cd2a606f0d5946c726235278640c3d54ecc5225a"}
Jul 07 19:07:45.897959 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.897925    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76954c7c97-2rmwv"]
Jul 07 19:07:45.901666 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.901641    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.912743 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.912719    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76954c7c97-2rmwv"]
Jul 07 19:07:45.926492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/617b5718-df2e-497c-9058-4feb02c67208-console-serving-cert\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.926641 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-service-ca\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.926641 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-console-config\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.926760 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-trusted-ca-bundle\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.926760 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/617b5718-df2e-497c-9058-4feb02c67208-console-oauth-config\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.926760 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6dg\" (UniqueName: \"kubernetes.io/projected/617b5718-df2e-497c-9058-4feb02c67208-kube-api-access-vz6dg\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:45.926760 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:45.926747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-oauth-serving-cert\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027398 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-oauth-serving-cert\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/617b5718-df2e-497c-9058-4feb02c67208-console-serving-cert\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-service-ca\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-console-config\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-trusted-ca-bundle\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/617b5718-df2e-497c-9058-4feb02c67208-console-oauth-config\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.027573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.027565    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6dg\" (UniqueName: \"kubernetes.io/projected/617b5718-df2e-497c-9058-4feb02c67208-kube-api-access-vz6dg\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.028274 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.028217    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-oauth-serving-cert\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.028274 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.028255    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-console-config\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.028568 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.028478    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-service-ca\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.028695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.028666    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/617b5718-df2e-497c-9058-4feb02c67208-trusted-ca-bundle\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.029982 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.029961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/617b5718-df2e-497c-9058-4feb02c67208-console-serving-cert\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.030079 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.030058    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/617b5718-df2e-497c-9058-4feb02c67208-console-oauth-config\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.038866 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.038838    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6dg\" (UniqueName: \"kubernetes.io/projected/617b5718-df2e-497c-9058-4feb02c67208-kube-api-access-vz6dg\") pod \"console-76954c7c97-2rmwv\" (UID: \"617b5718-df2e-497c-9058-4feb02c67208\") " pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:46.212980 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:46.212854    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:47.123377 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.123351    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76954c7c97-2rmwv"]
Jul 07 19:07:47.124841 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:47.124811    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617b5718_df2e_497c_9058_4feb02c67208.slice/crio-5600616847ee44ce97d3140bf5328678fbebd6044a3720f10f07bee281dbdf70 WatchSource:0}: Error finding container 5600616847ee44ce97d3140bf5328678fbebd6044a3720f10f07bee281dbdf70: Status 404 returned error can't find the container with id 5600616847ee44ce97d3140bf5328678fbebd6044a3720f10f07bee281dbdf70
Jul 07 19:07:47.277142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.277020    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"]
Jul 07 19:07:47.280544 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.280501    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:07:47.283078 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.283053    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 19:07:47.283211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.283064    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-66w5c\""
Jul 07 19:07:47.293255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.293221    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76954c7c97-2rmwv" event={"ID":"617b5718-df2e-497c-9058-4feb02c67208","Type":"ContainerStarted","Data":"eb247ccfcb80aaab3e1562dace733595514b7db9ed981b03c7993b880d4ce758"}
Jul 07 19:07:47.293367 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.293277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76954c7c97-2rmwv" event={"ID":"617b5718-df2e-497c-9058-4feb02c67208","Type":"ContainerStarted","Data":"5600616847ee44ce97d3140bf5328678fbebd6044a3720f10f07bee281dbdf70"}
Jul 07 19:07:47.294731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.294708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq" event={"ID":"e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb","Type":"ContainerStarted","Data":"a78d7a9776a70f71a807ab1f9fbdb7d5ba00a0786cd530539f424fb494271614"}
Jul 07 19:07:47.294848 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.294757    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:47.297820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.297800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"]
Jul 07 19:07:47.332021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.331969    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq" podStartSLOduration=1.108456057 podStartE2EDuration="3.331952265s" totalImagesPullingTime="2.223496208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:07:47.331186564 +0000 UTC m=+392.471560744" watchObservedRunningTime="2026-07-07 19:07:47.331952265 +0000 UTC m=+392.472326447"
Jul 07 19:07:47.339698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.339668    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfc79\" (UniqueName: \"kubernetes.io/projected/8f8052ac-7402-4ad5-ae87-d9a8d8216ba4-kube-api-access-bfc79\") pod \"dns-operator-controller-manager-864dd78c4c-tfrq5\" (UID: \"8f8052ac-7402-4ad5-ae87-d9a8d8216ba4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:07:47.358738 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.358674    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76954c7c97-2rmwv" podStartSLOduration=2.358659125 podStartE2EDuration="2.358659125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:07:47.3580867 +0000 UTC m=+392.498460902" watchObservedRunningTime="2026-07-07 19:07:47.358659125 +0000 UTC m=+392.499033304"
Jul 07 19:07:47.440700 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.440659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfc79\" (UniqueName: \"kubernetes.io/projected/8f8052ac-7402-4ad5-ae87-d9a8d8216ba4-kube-api-access-bfc79\") pod \"dns-operator-controller-manager-864dd78c4c-tfrq5\" (UID: \"8f8052ac-7402-4ad5-ae87-d9a8d8216ba4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:07:47.452922 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.452891    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfc79\" (UniqueName: \"kubernetes.io/projected/8f8052ac-7402-4ad5-ae87-d9a8d8216ba4-kube-api-access-bfc79\") pod \"dns-operator-controller-manager-864dd78c4c-tfrq5\" (UID: \"8f8052ac-7402-4ad5-ae87-d9a8d8216ba4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:07:47.591750 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.591723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:07:47.731692 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:47.731662    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"]
Jul 07 19:07:47.735154 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:47.735128    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8052ac_7402_4ad5_ae87_d9a8d8216ba4.slice/crio-1178b33e8b830c405fbde4b4da2bdea0cad8b3d62bda6e38c824cccf2f257681 WatchSource:0}: Error finding container 1178b33e8b830c405fbde4b4da2bdea0cad8b3d62bda6e38c824cccf2f257681: Status 404 returned error can't find the container with id 1178b33e8b830c405fbde4b4da2bdea0cad8b3d62bda6e38c824cccf2f257681
Jul 07 19:07:48.301414 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:48.301377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5" event={"ID":"8f8052ac-7402-4ad5-ae87-d9a8d8216ba4","Type":"ContainerStarted","Data":"1178b33e8b830c405fbde4b4da2bdea0cad8b3d62bda6e38c824cccf2f257681"}
Jul 07 19:07:50.313244 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:50.313210    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5" event={"ID":"8f8052ac-7402-4ad5-ae87-d9a8d8216ba4","Type":"ContainerStarted","Data":"1cc5e55817ab5337dc8ba0b0aee3f5f55f5a0806c3651c5cd44237db7c103a19"}
Jul 07 19:07:50.313663 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:50.313342    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:07:50.333383 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:50.333267    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5" podStartSLOduration=0.999530669 podStartE2EDuration="3.333252898s" totalImagesPullingTime="2.333722229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:07:50.332894917 +0000 UTC m=+395.473269097" watchObservedRunningTime="2026-07-07 19:07:50.333252898 +0000 UTC m=+395.473627077"
Jul 07 19:07:51.961645 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:51.961608    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"]
Jul 07 19:07:51.964169 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:51.964149    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:07:51.967049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:51.967032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-95w6d\""
Jul 07 19:07:51.977014 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:51.976991    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"]
Jul 07 19:07:52.079690 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:52.079652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzw4s\" (UniqueName: \"kubernetes.io/projected/f4da63f8-ce77-41b7-bbee-f2625eeaff71-kube-api-access-nzw4s\") pod \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" (UID: \"f4da63f8-ce77-41b7-bbee-f2625eeaff71\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:07:52.180780 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:52.180741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzw4s\" (UniqueName: \"kubernetes.io/projected/f4da63f8-ce77-41b7-bbee-f2625eeaff71-kube-api-access-nzw4s\") pod \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" (UID: \"f4da63f8-ce77-41b7-bbee-f2625eeaff71\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:07:52.191820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:52.191790    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzw4s\" (UniqueName: \"kubernetes.io/projected/f4da63f8-ce77-41b7-bbee-f2625eeaff71-kube-api-access-nzw4s\") pod \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" (UID: \"f4da63f8-ce77-41b7-bbee-f2625eeaff71\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:07:52.274468 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:52.274372    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:07:52.405436 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:52.405411    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"]
Jul 07 19:07:52.406949 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:52.406919    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4da63f8_ce77_41b7_bbee_f2625eeaff71.slice/crio-7090da9033956b34b17971ddedf022ad7eb57e0b9b190a25bf3d2f42b3ae3ac2 WatchSource:0}: Error finding container 7090da9033956b34b17971ddedf022ad7eb57e0b9b190a25bf3d2f42b3ae3ac2: Status 404 returned error can't find the container with id 7090da9033956b34b17971ddedf022ad7eb57e0b9b190a25bf3d2f42b3ae3ac2
Jul 07 19:07:53.330342 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:53.330289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv" event={"ID":"f4da63f8-ce77-41b7-bbee-f2625eeaff71","Type":"ContainerStarted","Data":"7090da9033956b34b17971ddedf022ad7eb57e0b9b190a25bf3d2f42b3ae3ac2"}
Jul 07 19:07:56.213865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.213765    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:56.213865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.213847    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:56.218646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.218624    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:56.348845 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.348810    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv" event={"ID":"f4da63f8-ce77-41b7-bbee-f2625eeaff71","Type":"ContainerStarted","Data":"ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa"}
Jul 07 19:07:56.349038 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.349021    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:07:56.352772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.352749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76954c7c97-2rmwv"
Jul 07 19:07:56.366978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.366927    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv" podStartSLOduration=1.8795048460000001 podStartE2EDuration="5.366914135s" totalImagesPullingTime="3.487409289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:07:56.36571012 +0000 UTC m=+401.506084313" watchObservedRunningTime="2026-07-07 19:07:56.366914135 +0000 UTC m=+401.507288364"
Jul 07 19:07:56.414166 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:56.414124    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bfc9659c-8lprq"]
Jul 07 19:07:57.961822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:57.961788    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"]
Jul 07 19:07:57.964143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:57.964125    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:57.966701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:57.966682    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8zk2w\""
Jul 07 19:07:57.980194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:57.980173    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"]
Jul 07 19:07:58.036917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.036891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea711b2-e950-4e54-8f86-15913a8b1b9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.037047 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.036947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bbt\" (UniqueName: \"kubernetes.io/projected/1ea711b2-e950-4e54-8f86-15913a8b1b9e-kube-api-access-d9bbt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.138316 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.138281    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea711b2-e950-4e54-8f86-15913a8b1b9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.138460 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.138339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bbt\" (UniqueName: \"kubernetes.io/projected/1ea711b2-e950-4e54-8f86-15913a8b1b9e-kube-api-access-d9bbt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.138676 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.138653    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea711b2-e950-4e54-8f86-15913a8b1b9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.147686 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.147667    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bbt\" (UniqueName: \"kubernetes.io/projected/1ea711b2-e950-4e54-8f86-15913a8b1b9e-kube-api-access-d9bbt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.273858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.273766    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:07:58.304142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.304111    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pfrwq"
Jul 07 19:07:58.453765 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:58.453738    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"]
Jul 07 19:07:58.454968 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:07:58.454931    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea711b2_e950_4e54_8f86_15913a8b1b9e.slice/crio-71e023f0a1723f411a936253bdc9200d46dd67b5c04dbe5b55a77ae5808414ab WatchSource:0}: Error finding container 71e023f0a1723f411a936253bdc9200d46dd67b5c04dbe5b55a77ae5808414ab: Status 404 returned error can't find the container with id 71e023f0a1723f411a936253bdc9200d46dd67b5c04dbe5b55a77ae5808414ab
Jul 07 19:07:59.371934 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:07:59.371899    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6" event={"ID":"1ea711b2-e950-4e54-8f86-15913a8b1b9e","Type":"ContainerStarted","Data":"71e023f0a1723f411a936253bdc9200d46dd67b5c04dbe5b55a77ae5808414ab"}
Jul 07 19:08:01.320140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:01.320112    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tfrq5"
Jul 07 19:08:06.412662 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:06.412620    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6" event={"ID":"1ea711b2-e950-4e54-8f86-15913a8b1b9e","Type":"ContainerStarted","Data":"aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d"}
Jul 07 19:08:06.413066 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:06.412743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:06.438010 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:06.437955    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6" podStartSLOduration=2.473140334 podStartE2EDuration="9.43793949s" totalImagesPullingTime="6.964799156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:06.435224743 +0000 UTC m=+411.575598924" watchObservedRunningTime="2026-07-07 19:08:06.43793949 +0000 UTC m=+411.578313669"
Jul 07 19:08:07.362844 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:07.362815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:08.299186 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.299151    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"]
Jul 07 19:08:08.301327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.301311    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.305374 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.305354    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jqsvg\""
Jul 07 19:08:08.305597 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.305581    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 19:08:08.306028 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.306014    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 19:08:08.314755 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.314731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"]
Jul 07 19:08:08.437017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.436986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7429c6f9-bb53-4db8-b130-a948088b4cf3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.437183 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.437040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkchs\" (UniqueName: \"kubernetes.io/projected/7429c6f9-bb53-4db8-b130-a948088b4cf3-kube-api-access-jkchs\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.437183 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.437102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7429c6f9-bb53-4db8-b130-a948088b4cf3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.538159 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.538118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkchs\" (UniqueName: \"kubernetes.io/projected/7429c6f9-bb53-4db8-b130-a948088b4cf3-kube-api-access-jkchs\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.538159 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.538162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7429c6f9-bb53-4db8-b130-a948088b4cf3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.538369 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.538225    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7429c6f9-bb53-4db8-b130-a948088b4cf3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.538962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.538943    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7429c6f9-bb53-4db8-b130-a948088b4cf3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.540648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.540624    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7429c6f9-bb53-4db8-b130-a948088b4cf3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.547049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.547024    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkchs\" (UniqueName: \"kubernetes.io/projected/7429c6f9-bb53-4db8-b130-a948088b4cf3-kube-api-access-jkchs\") pod \"kuadrant-console-plugin-66b5774985-qw64w\" (UID: \"7429c6f9-bb53-4db8-b130-a948088b4cf3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.610692 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.610674    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"
Jul 07 19:08:08.739779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:08.739755    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w"]
Jul 07 19:08:08.741706 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:08:08.741668    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7429c6f9_bb53_4db8_b130_a948088b4cf3.slice/crio-f4bfe280738471e9a8b62fe1d0b37dbac376fd7dbcc911e69e4f661128010084 WatchSource:0}: Error finding container f4bfe280738471e9a8b62fe1d0b37dbac376fd7dbcc911e69e4f661128010084: Status 404 returned error can't find the container with id f4bfe280738471e9a8b62fe1d0b37dbac376fd7dbcc911e69e4f661128010084
Jul 07 19:08:09.429733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:09.429698    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w" event={"ID":"7429c6f9-bb53-4db8-b130-a948088b4cf3","Type":"ContainerStarted","Data":"f4bfe280738471e9a8b62fe1d0b37dbac376fd7dbcc911e69e4f661128010084"}
Jul 07 19:08:17.421318 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:17.421289    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:19.235066 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.235031    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"]
Jul 07 19:08:19.235492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.235269    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" containerName="manager" containerID="cri-o://aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d" gracePeriod=2
Jul 07 19:08:19.247062 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.247024    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"]
Jul 07 19:08:19.250915 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:19.250884    2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1ea711b2-e950-4e54-8f86-15913a8b1b9e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\": pods \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:19.266444 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.266413    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"]
Jul 07 19:08:19.267015 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.266993    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" containerName="manager"
Jul 07 19:08:19.267122 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.267022    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" containerName="manager"
Jul 07 19:08:19.267122 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.267115    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" containerName="manager"
Jul 07 19:08:19.269704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.269683    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"]
Jul 07 19:08:19.269837 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.269818    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.269914 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.269870    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" containerName="manager" containerID="cri-o://ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa" gracePeriod=2
Jul 07 19:08:19.273911 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:19.273877    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:19.281641 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.281540    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"]
Jul 07 19:08:19.286228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.285468    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"]
Jul 07 19:08:19.292864 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.292823    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"]
Jul 07 19:08:19.293269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.293244    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" containerName="manager"
Jul 07 19:08:19.293269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.293267    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" containerName="manager"
Jul 07 19:08:19.293431 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.293377    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" containerName="manager"
Jul 07 19:08:19.296374 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.296354    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:19.313170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.313108    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"]
Jul 07 19:08:19.331887 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:19.331834    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:19.333843 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:19.333811    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:19.439151 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.439110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2b3f072-9c4f-4b5d-b25a-6d198f448388-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgnxl\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.439326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.439262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g592g\" (UniqueName: \"kubernetes.io/projected/c8e863af-7a41-480f-89a6-025a735e192b-kube-api-access-g592g\") pod \"limitador-operator-controller-manager-859d7b78bd-n7cw5\" (UID: \"c8e863af-7a41-480f-89a6-025a735e192b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:19.439326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.439310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrl2\" (UniqueName: \"kubernetes.io/projected/f2b3f072-9c4f-4b5d-b25a-6d198f448388-kube-api-access-kwrl2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgnxl\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.540204 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.540109    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g592g\" (UniqueName: \"kubernetes.io/projected/c8e863af-7a41-480f-89a6-025a735e192b-kube-api-access-g592g\") pod \"limitador-operator-controller-manager-859d7b78bd-n7cw5\" (UID: \"c8e863af-7a41-480f-89a6-025a735e192b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:19.540204 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.540171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrl2\" (UniqueName: \"kubernetes.io/projected/f2b3f072-9c4f-4b5d-b25a-6d198f448388-kube-api-access-kwrl2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgnxl\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.540425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.540249    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2b3f072-9c4f-4b5d-b25a-6d198f448388-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgnxl\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.540719 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.540696    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2b3f072-9c4f-4b5d-b25a-6d198f448388-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgnxl\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.550535 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.550488    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrl2\" (UniqueName: \"kubernetes.io/projected/f2b3f072-9c4f-4b5d-b25a-6d198f448388-kube-api-access-kwrl2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgnxl\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.551396 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.551369    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g592g\" (UniqueName: \"kubernetes.io/projected/c8e863af-7a41-480f-89a6-025a735e192b-kube-api-access-g592g\") pod \"limitador-operator-controller-manager-859d7b78bd-n7cw5\" (UID: \"c8e863af-7a41-480f-89a6-025a735e192b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:19.656415 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.656381    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:19.662556 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:19.662520    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:21.435371 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:21.435318    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65bfc9659c-8lprq" podUID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" containerName="console" containerID="cri-o://cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18" gracePeriod=15
Jul 07 19:08:29.217267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:29.217222    2569 patch_prober.go:28] interesting pod/console-65bfc9659c-8lprq container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body=
Jul 07 19:08:29.217719 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:29.217291    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-65bfc9659c-8lprq" podUID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused"
Jul 07 19:08:32.542463 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.540498    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:08:32.547861 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547615    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-config\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.547861 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547686    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-oauth-config\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.547861 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547726    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-service-ca\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.547861 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547777    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-serving-cert\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.547861 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547809    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-oauth-serving-cert\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.547861 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547844    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8pgh\" (UniqueName: \"kubernetes.io/projected/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-kube-api-access-c8pgh\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.548220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.547926    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-trusted-ca-bundle\") pod \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\" (UID: \"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9\") "
Jul 07 19:08:32.548220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.548054    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-config" (OuterVolumeSpecName: "console-config") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:08:32.548970 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.548773    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.549448 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.549188    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:08:32.549448 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.549382    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:08:32.549750 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.549727    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:08:32.550479 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.550419    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:32.551438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.551417    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:08:32.554045 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.554008    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:08:32.554141 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.554108    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-kube-api-access-c8pgh" (OuterVolumeSpecName: "kube-api-access-c8pgh") pod "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" (UID: "1dbf5104-ae75-4ac5-9eea-bc73a211dfc9"). InnerVolumeSpecName "kube-api-access-c8pgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:08:32.567459 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.567435    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:32.571832 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.571803    2569 generic.go:356] "Generic (PLEG): container finished" podID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" containerID="cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18" exitCode=0
Jul 07 19:08:32.572044 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.571845    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bfc9659c-8lprq" event={"ID":"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9","Type":"ContainerDied","Data":"cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18"}
Jul 07 19:08:32.572152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.571875    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bfc9659c-8lprq"
Jul 07 19:08:32.572152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.572096    2569 scope.go:117] "RemoveContainer" containerID="cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18"
Jul 07 19:08:32.572270 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.572079    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bfc9659c-8lprq" event={"ID":"1dbf5104-ae75-4ac5-9eea-bc73a211dfc9","Type":"ContainerDied","Data":"0b1e810be6e67f0c12fbdc70a8dd7453a74ba69484da2a54e6060c41e8a6c02e"}
Jul 07 19:08:32.573775 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.573698    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" containerID="aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d" exitCode=0
Jul 07 19:08:32.573775 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.573750    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:32.576302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.576275    2569 generic.go:356] "Generic (PLEG): container finished" podID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" containerID="ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa" exitCode=0
Jul 07 19:08:32.576410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.576309    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:32.578006 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.577980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w" event={"ID":"7429c6f9-bb53-4db8-b130-a948088b4cf3","Type":"ContainerStarted","Data":"a76036461caf78d39e31dd28a0951e45ca307370058d196836e4b8da5c3b211a"}
Jul 07 19:08:32.582594 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.582579    2569 scope.go:117] "RemoveContainer" containerID="cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18"
Jul 07 19:08:32.582838 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.582819    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18\": container with ID starting with cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18 not found: ID does not exist" containerID="cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18"
Jul 07 19:08:32.582894 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.582846    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18"} err="failed to get container status \"cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18\": rpc error: code = NotFound desc = could not find container \"cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18\": container with ID starting with cd3783f6e00627528574451d379070d8cfb537e7354271cb8b08db0127a55f18 not found: ID does not exist"
Jul 07 19:08:32.582894 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.582862    2569 scope.go:117] "RemoveContainer" containerID="aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d"
Jul 07 19:08:32.590651 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.590636    2569 scope.go:117] "RemoveContainer" containerID="aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d"
Jul 07 19:08:32.590886 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.590870    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d\": container with ID starting with aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d not found: ID does not exist" containerID="aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d"
Jul 07 19:08:32.590960 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.590891    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d"} err="failed to get container status \"aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d\": rpc error: code = NotFound desc = could not find container \"aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d\": container with ID starting with aa23348d7954069252cfa1d62608b5f711e620e777b1727c6b004b5b000b333d not found: ID does not exist"
Jul 07 19:08:32.590960 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.590905    2569 scope.go:117] "RemoveContainer" containerID="ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa"
Jul 07 19:08:32.598360 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.598346    2569 scope.go:117] "RemoveContainer" containerID="ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa"
Jul 07 19:08:32.598641 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.598622    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa\": container with ID starting with ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa not found: ID does not exist" containerID="ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa"
Jul 07 19:08:32.598701 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.598652    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa"} err="failed to get container status \"ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa\": rpc error: code = NotFound desc = could not find container \"ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa\": container with ID starting with ca10f49c9d47e66287e030cba59138a806448868d8d11e3e60974b36303a86fa not found: ID does not exist"
Jul 07 19:08:32.611933 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.611859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"]
Jul 07 19:08:32.615279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.615203    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"]
Jul 07 19:08:32.616117 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:08:32.616083    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e863af_7a41_480f_89a6_025a735e192b.slice/crio-3e7ad78f1201fb80442302ec4acd360268049838a1de656cf17c08cf2ee46321 WatchSource:0}: Error finding container 3e7ad78f1201fb80442302ec4acd360268049838a1de656cf17c08cf2ee46321: Status 404 returned error can't find the container with id 3e7ad78f1201fb80442302ec4acd360268049838a1de656cf17c08cf2ee46321
Jul 07 19:08:32.619227 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.618924    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:32.621021 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.620989    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:32.621958 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:08:32.621930    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b3f072_9c4f_4b5d_b25a_6d198f448388.slice/crio-72a6438f6bea92135809ead3dedad9158a9afeb1a3d49443dd562ce869bd2955 WatchSource:0}: Error finding container 72a6438f6bea92135809ead3dedad9158a9afeb1a3d49443dd562ce869bd2955: Status 404 returned error can't find the container with id 72a6438f6bea92135809ead3dedad9158a9afeb1a3d49443dd562ce869bd2955
Jul 07 19:08:32.645975 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.645934    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qw64w" podStartSLOduration=0.951915949 podStartE2EDuration="24.645918416s" totalImagesPullingTime="23.694002467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:32.644973168 +0000 UTC m=+437.785347351" watchObservedRunningTime="2026-07-07 19:08:32.645918416 +0000 UTC m=+437.786292593"
Jul 07 19:08:32.649103 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649083    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzw4s\" (UniqueName: \"kubernetes.io/projected/f4da63f8-ce77-41b7-bbee-f2625eeaff71-kube-api-access-nzw4s\") pod \"f4da63f8-ce77-41b7-bbee-f2625eeaff71\" (UID: \"f4da63f8-ce77-41b7-bbee-f2625eeaff71\") "
Jul 07 19:08:32.649194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649122    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9bbt\" (UniqueName: \"kubernetes.io/projected/1ea711b2-e950-4e54-8f86-15913a8b1b9e-kube-api-access-d9bbt\") pod \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") "
Jul 07 19:08:32.649194 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649154    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea711b2-e950-4e54-8f86-15913a8b1b9e-extensions-socket-volume\") pod \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\" (UID: \"1ea711b2-e950-4e54-8f86-15913a8b1b9e\") "
Jul 07 19:08:32.649587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649519    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8pgh\" (UniqueName: \"kubernetes.io/projected/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-kube-api-access-c8pgh\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.649587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649543    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-trusted-ca-bundle\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.649587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649557    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-oauth-config\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.649587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649569    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.649587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649582    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-console-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.649832 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649593    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9-oauth-serving-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.649832 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.649535    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea711b2-e950-4e54-8f86-15913a8b1b9e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ea711b2-e950-4e54-8f86-15913a8b1b9e" (UID: "1ea711b2-e950-4e54-8f86-15913a8b1b9e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:08:32.651067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.651048    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea711b2-e950-4e54-8f86-15913a8b1b9e-kube-api-access-d9bbt" (OuterVolumeSpecName: "kube-api-access-d9bbt") pod "1ea711b2-e950-4e54-8f86-15913a8b1b9e" (UID: "1ea711b2-e950-4e54-8f86-15913a8b1b9e"). InnerVolumeSpecName "kube-api-access-d9bbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:08:32.651110 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.651076    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4da63f8-ce77-41b7-bbee-f2625eeaff71-kube-api-access-nzw4s" (OuterVolumeSpecName: "kube-api-access-nzw4s") pod "f4da63f8-ce77-41b7-bbee-f2625eeaff71" (UID: "f4da63f8-ce77-41b7-bbee-f2625eeaff71"). InnerVolumeSpecName "kube-api-access-nzw4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:08:32.689491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.689466    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bfc9659c-8lprq"]
Jul 07 19:08:32.695253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.695228    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65bfc9659c-8lprq"]
Jul 07 19:08:32.750608 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.750576    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea711b2-e950-4e54-8f86-15913a8b1b9e-extensions-socket-volume\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.750608 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.750604    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzw4s\" (UniqueName: \"kubernetes.io/projected/f4da63f8-ce77-41b7-bbee-f2625eeaff71-kube-api-access-nzw4s\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.750608 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:32.750615    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9bbt\" (UniqueName: \"kubernetes.io/projected/1ea711b2-e950-4e54-8f86-15913a8b1b9e-kube-api-access-d9bbt\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:32.884836 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.884803    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:32.886786 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.886756    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:32.889653 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.889632    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2ncr6\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2ncr6"
Jul 07 19:08:32.891483 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:32.891462    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8v6dv\" is forbidden: User \"system:node:ip-10-0-133-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-243.ec2.internal' and this object" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8v6dv"
Jul 07 19:08:33.496440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.496406    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" path="/var/lib/kubelet/pods/1dbf5104-ae75-4ac5-9eea-bc73a211dfc9/volumes"
Jul 07 19:08:33.496785 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.496772    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea711b2-e950-4e54-8f86-15913a8b1b9e" path="/var/lib/kubelet/pods/1ea711b2-e950-4e54-8f86-15913a8b1b9e/volumes"
Jul 07 19:08:33.497073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.497061    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4da63f8-ce77-41b7-bbee-f2625eeaff71" path="/var/lib/kubelet/pods/f4da63f8-ce77-41b7-bbee-f2625eeaff71/volumes"
Jul 07 19:08:33.586220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.586183    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5" event={"ID":"c8e863af-7a41-480f-89a6-025a735e192b","Type":"ContainerStarted","Data":"e09cc9c19c65738aaef9ac2ad4d1f5e505caf8e57e1f63770282d619f317ca09"}
Jul 07 19:08:33.586704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.586251    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:33.586704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.586273    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5" event={"ID":"c8e863af-7a41-480f-89a6-025a735e192b","Type":"ContainerStarted","Data":"3e7ad78f1201fb80442302ec4acd360268049838a1de656cf17c08cf2ee46321"}
Jul 07 19:08:33.589570 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.589541    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl" event={"ID":"f2b3f072-9c4f-4b5d-b25a-6d198f448388","Type":"ContainerStarted","Data":"35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e"}
Jul 07 19:08:33.589682 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.589590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl" event={"ID":"f2b3f072-9c4f-4b5d-b25a-6d198f448388","Type":"ContainerStarted","Data":"72a6438f6bea92135809ead3dedad9158a9afeb1a3d49443dd562ce869bd2955"}
Jul 07 19:08:33.589733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.589697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:33.606817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.606769    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5" podStartSLOduration=14.606753999 podStartE2EDuration="14.606753999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:33.606021812 +0000 UTC m=+438.746395992" watchObservedRunningTime="2026-07-07 19:08:33.606753999 +0000 UTC m=+438.747128179"
Jul 07 19:08:33.660023 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:33.659940    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl" podStartSLOduration=14.65992545 podStartE2EDuration="14.65992545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:33.659078721 +0000 UTC m=+438.799452913" watchObservedRunningTime="2026-07-07 19:08:33.65992545 +0000 UTC m=+438.800299692"
Jul 07 19:08:37.226208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.226126    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"]
Jul 07 19:08:37.226638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.226299    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl" podUID="f2b3f072-9c4f-4b5d-b25a-6d198f448388" containerName="manager" containerID="cri-o://35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e" gracePeriod=10
Jul 07 19:08:37.228298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.228274    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:37.500762 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.500702    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:37.590458 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.590427    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwrl2\" (UniqueName: \"kubernetes.io/projected/f2b3f072-9c4f-4b5d-b25a-6d198f448388-kube-api-access-kwrl2\") pod \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") "
Jul 07 19:08:37.590626 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.590476    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2b3f072-9c4f-4b5d-b25a-6d198f448388-extensions-socket-volume\") pod \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\" (UID: \"f2b3f072-9c4f-4b5d-b25a-6d198f448388\") "
Jul 07 19:08:37.591020 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.590917    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2b3f072-9c4f-4b5d-b25a-6d198f448388-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2b3f072-9c4f-4b5d-b25a-6d198f448388" (UID: "f2b3f072-9c4f-4b5d-b25a-6d198f448388"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:08:37.592518 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.592484    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b3f072-9c4f-4b5d-b25a-6d198f448388-kube-api-access-kwrl2" (OuterVolumeSpecName: "kube-api-access-kwrl2") pod "f2b3f072-9c4f-4b5d-b25a-6d198f448388" (UID: "f2b3f072-9c4f-4b5d-b25a-6d198f448388"). InnerVolumeSpecName "kube-api-access-kwrl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:08:37.615718 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.615693    2569 generic.go:356] "Generic (PLEG): container finished" podID="f2b3f072-9c4f-4b5d-b25a-6d198f448388" containerID="35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e" exitCode=0
Jul 07 19:08:37.615809 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.615732    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"
Jul 07 19:08:37.615809 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.615780    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl" event={"ID":"f2b3f072-9c4f-4b5d-b25a-6d198f448388","Type":"ContainerDied","Data":"35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e"}
Jul 07 19:08:37.615883 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.615820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl" event={"ID":"f2b3f072-9c4f-4b5d-b25a-6d198f448388","Type":"ContainerDied","Data":"72a6438f6bea92135809ead3dedad9158a9afeb1a3d49443dd562ce869bd2955"}
Jul 07 19:08:37.615883 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.615841    2569 scope.go:117] "RemoveContainer" containerID="35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e"
Jul 07 19:08:37.625889 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.625871    2569 scope.go:117] "RemoveContainer" containerID="35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e"
Jul 07 19:08:37.626138 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:08:37.626121    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e\": container with ID starting with 35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e not found: ID does not exist" containerID="35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e"
Jul 07 19:08:37.626185 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.626144    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e"} err="failed to get container status \"35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e\": rpc error: code = NotFound desc = could not find container \"35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e\": container with ID starting with 35c72747ddb54982e385a04cc782d59f731957396bc6dedd770add2a997d966e not found: ID does not exist"
Jul 07 19:08:37.650462 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.650437    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"]
Jul 07 19:08:37.657914 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.657889    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgnxl"]
Jul 07 19:08:37.691541 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.691498    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwrl2\" (UniqueName: \"kubernetes.io/projected/f2b3f072-9c4f-4b5d-b25a-6d198f448388-kube-api-access-kwrl2\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:37.691541 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.691536    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2b3f072-9c4f-4b5d-b25a-6d198f448388-extensions-socket-volume\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:08:37.705834 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.705811    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"]
Jul 07 19:08:37.706235 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.706218    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b3f072-9c4f-4b5d-b25a-6d198f448388" containerName="manager"
Jul 07 19:08:37.706235 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.706240    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b3f072-9c4f-4b5d-b25a-6d198f448388" containerName="manager"
Jul 07 19:08:37.706339 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.706267    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" containerName="console"
Jul 07 19:08:37.706339 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.706276    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" containerName="console"
Jul 07 19:08:37.706410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.706364    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2b3f072-9c4f-4b5d-b25a-6d198f448388" containerName="manager"
Jul 07 19:08:37.706410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.706376    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbf5104-ae75-4ac5-9eea-bc73a211dfc9" containerName="console"
Jul 07 19:08:37.728283 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.728259    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:37.731010 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.730989    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8zk2w\""
Jul 07 19:08:37.731877 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.731855    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"]
Jul 07 19:08:37.792324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.792247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m68xl\" (UniqueName: \"kubernetes.io/projected/f14848ed-6c54-4fc8-9d36-f6806139d871-kube-api-access-m68xl\") pod \"kuadrant-operator-controller-manager-86878c769f-cr7t5\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:37.792457 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.792323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f14848ed-6c54-4fc8-9d36-f6806139d871-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cr7t5\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:37.893192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.893156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f14848ed-6c54-4fc8-9d36-f6806139d871-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cr7t5\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:37.893357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.893222    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m68xl\" (UniqueName: \"kubernetes.io/projected/f14848ed-6c54-4fc8-9d36-f6806139d871-kube-api-access-m68xl\") pod \"kuadrant-operator-controller-manager-86878c769f-cr7t5\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:37.893561 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.893542    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f14848ed-6c54-4fc8-9d36-f6806139d871-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cr7t5\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:37.913963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:37.913935    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m68xl\" (UniqueName: \"kubernetes.io/projected/f14848ed-6c54-4fc8-9d36-f6806139d871-kube-api-access-m68xl\") pod \"kuadrant-operator-controller-manager-86878c769f-cr7t5\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:38.040143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:38.040109    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:38.181814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:38.181793    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"]
Jul 07 19:08:38.184114 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:08:38.184083    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14848ed_6c54_4fc8_9d36_f6806139d871.slice/crio-5f6988baea6046c1c40f3f973e51cc995ece71e88cda300bb779ce46aa181b3e WatchSource:0}: Error finding container 5f6988baea6046c1c40f3f973e51cc995ece71e88cda300bb779ce46aa181b3e: Status 404 returned error can't find the container with id 5f6988baea6046c1c40f3f973e51cc995ece71e88cda300bb779ce46aa181b3e
Jul 07 19:08:38.623422 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:38.623391    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5" event={"ID":"f14848ed-6c54-4fc8-9d36-f6806139d871","Type":"ContainerStarted","Data":"07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab"}
Jul 07 19:08:38.623887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:38.623436    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5" event={"ID":"f14848ed-6c54-4fc8-9d36-f6806139d871","Type":"ContainerStarted","Data":"5f6988baea6046c1c40f3f973e51cc995ece71e88cda300bb779ce46aa181b3e"}
Jul 07 19:08:38.623887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:38.623485    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:08:38.697663 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:38.697609    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5" podStartSLOduration=1.697594707 podStartE2EDuration="1.697594707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:38.694888867 +0000 UTC m=+443.835263048" watchObservedRunningTime="2026-07-07 19:08:38.697594707 +0000 UTC m=+443.837968932"
Jul 07 19:08:39.491877 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:39.491845    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2b3f072-9c4f-4b5d-b25a-6d198f448388" path="/var/lib/kubelet/pods/f2b3f072-9c4f-4b5d-b25a-6d198f448388/volumes"
Jul 07 19:08:44.597362 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:44.597331    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7cw5"
Jul 07 19:08:49.632234 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:08:49.632205    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:09:10.741080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.741043    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:10.743564 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.743543    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:10.746588 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.746570    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 19:09:10.763898 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.763874    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:10.849173 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.849141    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:10.890070 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.890039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkckx\" (UniqueName: \"kubernetes.io/projected/0d8b5d55-234a-45dc-af21-0640687a1268-kube-api-access-lkckx\") pod \"limitador-limitador-64c94fd64f-g59mt\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:10.890243 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.890114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d8b5d55-234a-45dc-af21-0640687a1268-config-file\") pod \"limitador-limitador-64c94fd64f-g59mt\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:10.991454 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.991364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d8b5d55-234a-45dc-af21-0640687a1268-config-file\") pod \"limitador-limitador-64c94fd64f-g59mt\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:10.991662 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.991454    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkckx\" (UniqueName: \"kubernetes.io/projected/0d8b5d55-234a-45dc-af21-0640687a1268-kube-api-access-lkckx\") pod \"limitador-limitador-64c94fd64f-g59mt\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:10.992027 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:10.992005    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d8b5d55-234a-45dc-af21-0640687a1268-config-file\") pod \"limitador-limitador-64c94fd64f-g59mt\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:11.002142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:11.002116    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkckx\" (UniqueName: \"kubernetes.io/projected/0d8b5d55-234a-45dc-af21-0640687a1268-kube-api-access-lkckx\") pod \"limitador-limitador-64c94fd64f-g59mt\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:11.054266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:11.054233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:11.217266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:11.217233    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:11.218412 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:11.218384    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8b5d55_234a_45dc_af21_0640687a1268.slice/crio-bdf30c6b17090d60aad564f91a8be1bc7208938f829326fc2d871142ef1e6512 WatchSource:0}: Error finding container bdf30c6b17090d60aad564f91a8be1bc7208938f829326fc2d871142ef1e6512: Status 404 returned error can't find the container with id bdf30c6b17090d60aad564f91a8be1bc7208938f829326fc2d871142ef1e6512
Jul 07 19:09:11.801322 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:11.801292    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt" event={"ID":"0d8b5d55-234a-45dc-af21-0640687a1268","Type":"ContainerStarted","Data":"bdf30c6b17090d60aad564f91a8be1bc7208938f829326fc2d871142ef1e6512"}
Jul 07 19:09:12.094501 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.094465    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hbz6v"]
Jul 07 19:09:12.097247 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.097210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:12.101643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.101329    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxc8p\""
Jul 07 19:09:12.121321 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.121288    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hbz6v"]
Jul 07 19:09:12.202891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.202855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pzc\" (UniqueName: \"kubernetes.io/projected/23953505-6760-4b62-821d-a8836583ffa7-kube-api-access-c8pzc\") pod \"authorino-75d556bd77-hbz6v\" (UID: \"23953505-6760-4b62-821d-a8836583ffa7\") " pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:12.303733 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.303691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pzc\" (UniqueName: \"kubernetes.io/projected/23953505-6760-4b62-821d-a8836583ffa7-kube-api-access-c8pzc\") pod \"authorino-75d556bd77-hbz6v\" (UID: \"23953505-6760-4b62-821d-a8836583ffa7\") " pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:12.316639 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.316606    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pzc\" (UniqueName: \"kubernetes.io/projected/23953505-6760-4b62-821d-a8836583ffa7-kube-api-access-c8pzc\") pod \"authorino-75d556bd77-hbz6v\" (UID: \"23953505-6760-4b62-821d-a8836583ffa7\") " pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:12.410302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.410220    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:12.587884 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.587811    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hbz6v"]
Jul 07 19:09:12.590676 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:12.590644    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23953505_6760_4b62_821d_a8836583ffa7.slice/crio-8fd53da92aead70f3986c0d077a06cbf34fcc2aedee488b01eada7600cc27991 WatchSource:0}: Error finding container 8fd53da92aead70f3986c0d077a06cbf34fcc2aedee488b01eada7600cc27991: Status 404 returned error can't find the container with id 8fd53da92aead70f3986c0d077a06cbf34fcc2aedee488b01eada7600cc27991
Jul 07 19:09:12.808893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:12.808809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hbz6v" event={"ID":"23953505-6760-4b62-821d-a8836583ffa7","Type":"ContainerStarted","Data":"8fd53da92aead70f3986c0d077a06cbf34fcc2aedee488b01eada7600cc27991"}
Jul 07 19:09:14.830254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:14.830211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt" event={"ID":"0d8b5d55-234a-45dc-af21-0640687a1268","Type":"ContainerStarted","Data":"51af7c96b6bbea248ae92e7946e203cbfd3a72988b5b0bc8ff5823c9884006bd"}
Jul 07 19:09:14.830710 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:14.830284    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:14.860844 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:14.860776    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt" podStartSLOduration=1.776995004 podStartE2EDuration="4.860758413s" totalImagesPullingTime="3.083763409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:14.857826472 +0000 UTC m=+479.998200664" watchObservedRunningTime="2026-07-07 19:09:14.860758413 +0000 UTC m=+480.001132635"
Jul 07 19:09:16.844266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:16.844229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hbz6v" event={"ID":"23953505-6760-4b62-821d-a8836583ffa7","Type":"ContainerStarted","Data":"700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee"}
Jul 07 19:09:16.868398 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:16.868340    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hbz6v" podStartSLOduration=1.186652404 podStartE2EDuration="4.868318985s" totalImagesPullingTime="3.681666581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:16.865874523 +0000 UTC m=+482.006248704" watchObservedRunningTime="2026-07-07 19:09:16.868318985 +0000 UTC m=+482.008693165"
Jul 07 19:09:25.839065 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:25.839033    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:26.369147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.369106    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:26.369337 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.369297    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt" podUID="0d8b5d55-234a-45dc-af21-0640687a1268" containerName="limitador" containerID="cri-o://51af7c96b6bbea248ae92e7946e203cbfd3a72988b5b0bc8ff5823c9884006bd" gracePeriod=30
Jul 07 19:09:26.900792 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.900765    2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8b5d55-234a-45dc-af21-0640687a1268" containerID="51af7c96b6bbea248ae92e7946e203cbfd3a72988b5b0bc8ff5823c9884006bd" exitCode=0
Jul 07 19:09:26.901127 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.900835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt" event={"ID":"0d8b5d55-234a-45dc-af21-0640687a1268","Type":"ContainerDied","Data":"51af7c96b6bbea248ae92e7946e203cbfd3a72988b5b0bc8ff5823c9884006bd"}
Jul 07 19:09:26.916846 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.916824    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:26.929697 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.929671    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkckx\" (UniqueName: \"kubernetes.io/projected/0d8b5d55-234a-45dc-af21-0640687a1268-kube-api-access-lkckx\") pod \"0d8b5d55-234a-45dc-af21-0640687a1268\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") "
Jul 07 19:09:26.929848 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.929739    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d8b5d55-234a-45dc-af21-0640687a1268-config-file\") pod \"0d8b5d55-234a-45dc-af21-0640687a1268\" (UID: \"0d8b5d55-234a-45dc-af21-0640687a1268\") "
Jul 07 19:09:26.930062 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.930043    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d8b5d55-234a-45dc-af21-0640687a1268-config-file" (OuterVolumeSpecName: "config-file") pod "0d8b5d55-234a-45dc-af21-0640687a1268" (UID: "0d8b5d55-234a-45dc-af21-0640687a1268"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:09:26.931759 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:26.931736    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8b5d55-234a-45dc-af21-0640687a1268-kube-api-access-lkckx" (OuterVolumeSpecName: "kube-api-access-lkckx") pod "0d8b5d55-234a-45dc-af21-0640687a1268" (UID: "0d8b5d55-234a-45dc-af21-0640687a1268"). InnerVolumeSpecName "kube-api-access-lkckx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:09:27.031061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.031023    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkckx\" (UniqueName: \"kubernetes.io/projected/0d8b5d55-234a-45dc-af21-0640687a1268-kube-api-access-lkckx\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:09:27.031061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.031053    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0d8b5d55-234a-45dc-af21-0640687a1268-config-file\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:09:27.907743 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.907716    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt"
Jul 07 19:09:27.908178 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.907715    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g59mt" event={"ID":"0d8b5d55-234a-45dc-af21-0640687a1268","Type":"ContainerDied","Data":"bdf30c6b17090d60aad564f91a8be1bc7208938f829326fc2d871142ef1e6512"}
Jul 07 19:09:27.908178 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.907849    2569 scope.go:117] "RemoveContainer" containerID="51af7c96b6bbea248ae92e7946e203cbfd3a72988b5b0bc8ff5823c9884006bd"
Jul 07 19:09:27.930787 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.930753    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:27.937836 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:27.937808    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g59mt"]
Jul 07 19:09:29.491171 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:29.491138    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8b5d55-234a-45dc-af21-0640687a1268" path="/var/lib/kubelet/pods/0d8b5d55-234a-45dc-af21-0640687a1268/volumes"
Jul 07 19:09:32.577247 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.577212    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"]
Jul 07 19:09:32.577641 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.577566    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8b5d55-234a-45dc-af21-0640687a1268" containerName="limitador"
Jul 07 19:09:32.577641 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.577578    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8b5d55-234a-45dc-af21-0640687a1268" containerName="limitador"
Jul 07 19:09:32.577718 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.577646    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8b5d55-234a-45dc-af21-0640687a1268" containerName="limitador"
Jul 07 19:09:32.581945 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.581929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.584499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.584478    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 19:09:32.584655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.584578    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dkrm6\""
Jul 07 19:09:32.585270 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.585252    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 07 19:09:32.585351 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.585268    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 19:09:32.594088 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.593235    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"]
Jul 07 19:09:32.682555 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.682489    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgkcp\" (UniqueName: \"kubernetes.io/projected/2f8c9859-0f3d-4894-b022-ea76602dde61-kube-api-access-hgkcp\") pod \"postgres-69fb4594cf-r2njx\" (UID: \"2f8c9859-0f3d-4894-b022-ea76602dde61\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.682714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.682584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f8c9859-0f3d-4894-b022-ea76602dde61-data\") pod \"postgres-69fb4594cf-r2njx\" (UID: \"2f8c9859-0f3d-4894-b022-ea76602dde61\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.783350 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.783312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgkcp\" (UniqueName: \"kubernetes.io/projected/2f8c9859-0f3d-4894-b022-ea76602dde61-kube-api-access-hgkcp\") pod \"postgres-69fb4594cf-r2njx\" (UID: \"2f8c9859-0f3d-4894-b022-ea76602dde61\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.783635 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.783371    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f8c9859-0f3d-4894-b022-ea76602dde61-data\") pod \"postgres-69fb4594cf-r2njx\" (UID: \"2f8c9859-0f3d-4894-b022-ea76602dde61\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.783894 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.783871    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f8c9859-0f3d-4894-b022-ea76602dde61-data\") pod \"postgres-69fb4594cf-r2njx\" (UID: \"2f8c9859-0f3d-4894-b022-ea76602dde61\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.793104 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.793082    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgkcp\" (UniqueName: \"kubernetes.io/projected/2f8c9859-0f3d-4894-b022-ea76602dde61-kube-api-access-hgkcp\") pod \"postgres-69fb4594cf-r2njx\" (UID: \"2f8c9859-0f3d-4894-b022-ea76602dde61\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:32.895288 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:32.895254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:33.047744 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:33.047710    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"]
Jul 07 19:09:33.050536 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:33.050498    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8c9859_0f3d_4894_b022_ea76602dde61.slice/crio-df5b9db69e2312abf5b95719ae975734d3a11239b1dba0441477c10cec1db7ab WatchSource:0}: Error finding container df5b9db69e2312abf5b95719ae975734d3a11239b1dba0441477c10cec1db7ab: Status 404 returned error can't find the container with id df5b9db69e2312abf5b95719ae975734d3a11239b1dba0441477c10cec1db7ab
Jul 07 19:09:33.944526 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:33.944470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx" event={"ID":"2f8c9859-0f3d-4894-b022-ea76602dde61","Type":"ContainerStarted","Data":"df5b9db69e2312abf5b95719ae975734d3a11239b1dba0441477c10cec1db7ab"}
Jul 07 19:09:38.974178 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:38.974135    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx" event={"ID":"2f8c9859-0f3d-4894-b022-ea76602dde61","Type":"ContainerStarted","Data":"a13e9f06397a5b777978f966ea619635718253aa6d9294d8c02928f271dd1a12"}
Jul 07 19:09:38.974602 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:38.974207    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:38.997079 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:38.997025    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx" podStartSLOduration=2.008403998 podStartE2EDuration="6.997007055s" totalImagesPullingTime="4.988603057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:38.993668026 +0000 UTC m=+504.134042207" watchObservedRunningTime="2026-07-07 19:09:38.997007055 +0000 UTC m=+504.137381240"
Jul 07 19:09:45.008558 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.008523    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r2njx"
Jul 07 19:09:45.599767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.599732    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msh8h"]
Jul 07 19:09:45.606031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.606005    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:45.621097 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.621071    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msh8h"]
Jul 07 19:09:45.695359 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.695327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/41dd0c81-4cac-40b7-9dca-6a21a033e040-kube-api-access-nkk78\") pod \"authorino-5d4b67c446-msh8h\" (UID: \"41dd0c81-4cac-40b7-9dca-6a21a033e040\") " pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:45.796048 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.796009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/41dd0c81-4cac-40b7-9dca-6a21a033e040-kube-api-access-nkk78\") pod \"authorino-5d4b67c446-msh8h\" (UID: \"41dd0c81-4cac-40b7-9dca-6a21a033e040\") " pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:45.806731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.806706    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/41dd0c81-4cac-40b7-9dca-6a21a033e040-kube-api-access-nkk78\") pod \"authorino-5d4b67c446-msh8h\" (UID: \"41dd0c81-4cac-40b7-9dca-6a21a033e040\") " pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:45.848666 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.848632    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msh8h"]
Jul 07 19:09:45.848901 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.848888    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:45.892368 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.891833    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f77444dc-4dcm2"]
Jul 07 19:09:45.897048 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.897021    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:45.923661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.923609    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f77444dc-4dcm2"]
Jul 07 19:09:45.998157 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:45.998128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq8sq\" (UniqueName: \"kubernetes.io/projected/7bf481a8-fc22-4340-a08b-502f56ad4a1b-kube-api-access-kq8sq\") pod \"authorino-6f77444dc-4dcm2\" (UID: \"7bf481a8-fc22-4340-a08b-502f56ad4a1b\") " pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:46.008652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.004385    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msh8h"]
Jul 07 19:09:46.015684 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.015648    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-msh8h" event={"ID":"41dd0c81-4cac-40b7-9dca-6a21a033e040","Type":"ContainerStarted","Data":"1092a04120265b54bba39007d9816d655cbe0294fe677630b2368e3a00f10e8c"}
Jul 07 19:09:46.098944 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.098909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq8sq\" (UniqueName: \"kubernetes.io/projected/7bf481a8-fc22-4340-a08b-502f56ad4a1b-kube-api-access-kq8sq\") pod \"authorino-6f77444dc-4dcm2\" (UID: \"7bf481a8-fc22-4340-a08b-502f56ad4a1b\") " pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:46.116409 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.116343    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq8sq\" (UniqueName: \"kubernetes.io/projected/7bf481a8-fc22-4340-a08b-502f56ad4a1b-kube-api-access-kq8sq\") pod \"authorino-6f77444dc-4dcm2\" (UID: \"7bf481a8-fc22-4340-a08b-502f56ad4a1b\") " pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:46.159716 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.159682    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f77444dc-4dcm2"]
Jul 07 19:09:46.159932 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.159922    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:46.212156 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.212126    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dd955588c-k9829"]
Jul 07 19:09:46.219117 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.219093    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.222648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.222395    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 19:09:46.240210 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.240186    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd955588c-k9829"]
Jul 07 19:09:46.301747 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.301714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89jz\" (UniqueName: \"kubernetes.io/projected/9bcff7c6-6081-48c9-91f3-d750f72cdf85-kube-api-access-f89jz\") pod \"authorino-5dd955588c-k9829\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") " pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.301911 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.301779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bcff7c6-6081-48c9-91f3-d750f72cdf85-tls-cert\") pod \"authorino-5dd955588c-k9829\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") " pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.324864 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.324836    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f77444dc-4dcm2"]
Jul 07 19:09:46.325858 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:46.325828    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bf481a8_fc22_4340_a08b_502f56ad4a1b.slice/crio-165d57dc6581e6f74dcfcdd6bb5027e69723123fc3e1ca105a60d93f6b11cb83 WatchSource:0}: Error finding container 165d57dc6581e6f74dcfcdd6bb5027e69723123fc3e1ca105a60d93f6b11cb83: Status 404 returned error can't find the container with id 165d57dc6581e6f74dcfcdd6bb5027e69723123fc3e1ca105a60d93f6b11cb83
Jul 07 19:09:46.402413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.402325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f89jz\" (UniqueName: \"kubernetes.io/projected/9bcff7c6-6081-48c9-91f3-d750f72cdf85-kube-api-access-f89jz\") pod \"authorino-5dd955588c-k9829\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") " pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.402586 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.402411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bcff7c6-6081-48c9-91f3-d750f72cdf85-tls-cert\") pod \"authorino-5dd955588c-k9829\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") " pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.404826 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.404797    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bcff7c6-6081-48c9-91f3-d750f72cdf85-tls-cert\") pod \"authorino-5dd955588c-k9829\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") " pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.416104 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.416078    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89jz\" (UniqueName: \"kubernetes.io/projected/9bcff7c6-6081-48c9-91f3-d750f72cdf85-kube-api-access-f89jz\") pod \"authorino-5dd955588c-k9829\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") " pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.531159 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.531139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:09:46.683051 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:46.683003    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd955588c-k9829"]
Jul 07 19:09:46.685284 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:46.685255    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bcff7c6_6081_48c9_91f3_d750f72cdf85.slice/crio-5c69964a2c1cfbaf18d50187b59e80854019f170dec7985456760efae21f3ed9 WatchSource:0}: Error finding container 5c69964a2c1cfbaf18d50187b59e80854019f170dec7985456760efae21f3ed9: Status 404 returned error can't find the container with id 5c69964a2c1cfbaf18d50187b59e80854019f170dec7985456760efae21f3ed9
Jul 07 19:09:47.022160 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.022079    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-msh8h" event={"ID":"41dd0c81-4cac-40b7-9dca-6a21a033e040","Type":"ContainerStarted","Data":"63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f"}
Jul 07 19:09:47.022652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.022161    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-msh8h" podUID="41dd0c81-4cac-40b7-9dca-6a21a033e040" containerName="authorino" containerID="cri-o://63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f" gracePeriod=30
Jul 07 19:09:47.023704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.023679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f77444dc-4dcm2" event={"ID":"7bf481a8-fc22-4340-a08b-502f56ad4a1b","Type":"ContainerStarted","Data":"c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361"}
Jul 07 19:09:47.023834 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.023714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f77444dc-4dcm2" event={"ID":"7bf481a8-fc22-4340-a08b-502f56ad4a1b","Type":"ContainerStarted","Data":"165d57dc6581e6f74dcfcdd6bb5027e69723123fc3e1ca105a60d93f6b11cb83"}
Jul 07 19:09:47.023834 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.023713    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6f77444dc-4dcm2" podUID="7bf481a8-fc22-4340-a08b-502f56ad4a1b" containerName="authorino" containerID="cri-o://c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361" gracePeriod=30
Jul 07 19:09:47.025011 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.024980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd955588c-k9829" event={"ID":"9bcff7c6-6081-48c9-91f3-d750f72cdf85","Type":"ContainerStarted","Data":"5c69964a2c1cfbaf18d50187b59e80854019f170dec7985456760efae21f3ed9"}
Jul 07 19:09:47.070659 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.070606    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-msh8h" podStartSLOduration=1.6035863830000001 podStartE2EDuration="2.070592995s" totalImagesPullingTime="467.006612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:47.068198106 +0000 UTC m=+512.208572285" watchObservedRunningTime="2026-07-07 19:09:47.070592995 +0000 UTC m=+512.210967224"
Jul 07 19:09:47.117788 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.117743    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f77444dc-4dcm2" podStartSLOduration=1.674021045 podStartE2EDuration="2.117722693s" totalImagesPullingTime="443.701648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:47.117092905 +0000 UTC m=+512.257467084" watchObservedRunningTime="2026-07-07 19:09:47.117722693 +0000 UTC m=+512.258096873"
Jul 07 19:09:47.306824 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.306797    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:47.316271 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.316249    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:47.410216 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.410189    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/41dd0c81-4cac-40b7-9dca-6a21a033e040-kube-api-access-nkk78\") pod \"41dd0c81-4cac-40b7-9dca-6a21a033e040\" (UID: \"41dd0c81-4cac-40b7-9dca-6a21a033e040\") "
Jul 07 19:09:47.410364 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.410304    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq8sq\" (UniqueName: \"kubernetes.io/projected/7bf481a8-fc22-4340-a08b-502f56ad4a1b-kube-api-access-kq8sq\") pod \"7bf481a8-fc22-4340-a08b-502f56ad4a1b\" (UID: \"7bf481a8-fc22-4340-a08b-502f56ad4a1b\") "
Jul 07 19:09:47.412101 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.412066    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41dd0c81-4cac-40b7-9dca-6a21a033e040-kube-api-access-nkk78" (OuterVolumeSpecName: "kube-api-access-nkk78") pod "41dd0c81-4cac-40b7-9dca-6a21a033e040" (UID: "41dd0c81-4cac-40b7-9dca-6a21a033e040"). InnerVolumeSpecName "kube-api-access-nkk78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:09:47.412244 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.412225    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bf481a8-fc22-4340-a08b-502f56ad4a1b-kube-api-access-kq8sq" (OuterVolumeSpecName: "kube-api-access-kq8sq") pod "7bf481a8-fc22-4340-a08b-502f56ad4a1b" (UID: "7bf481a8-fc22-4340-a08b-502f56ad4a1b"). InnerVolumeSpecName "kube-api-access-kq8sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:09:47.511578 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.511553    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq8sq\" (UniqueName: \"kubernetes.io/projected/7bf481a8-fc22-4340-a08b-502f56ad4a1b-kube-api-access-kq8sq\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:09:47.511578 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:47.511577    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/41dd0c81-4cac-40b7-9dca-6a21a033e040-kube-api-access-nkk78\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:09:48.031184 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.031151    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd955588c-k9829" event={"ID":"9bcff7c6-6081-48c9-91f3-d750f72cdf85","Type":"ContainerStarted","Data":"649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d"}
Jul 07 19:09:48.032289 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.032264    2569 generic.go:356] "Generic (PLEG): container finished" podID="41dd0c81-4cac-40b7-9dca-6a21a033e040" containerID="63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f" exitCode=0
Jul 07 19:09:48.032385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.032299    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msh8h"
Jul 07 19:09:48.032385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.032336    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-msh8h" event={"ID":"41dd0c81-4cac-40b7-9dca-6a21a033e040","Type":"ContainerDied","Data":"63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f"}
Jul 07 19:09:48.032385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.032369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-msh8h" event={"ID":"41dd0c81-4cac-40b7-9dca-6a21a033e040","Type":"ContainerDied","Data":"1092a04120265b54bba39007d9816d655cbe0294fe677630b2368e3a00f10e8c"}
Jul 07 19:09:48.032543 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.032387    2569 scope.go:117] "RemoveContainer" containerID="63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f"
Jul 07 19:09:48.033612 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.033589    2569 generic.go:356] "Generic (PLEG): container finished" podID="7bf481a8-fc22-4340-a08b-502f56ad4a1b" containerID="c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361" exitCode=0
Jul 07 19:09:48.033716 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.033622    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f77444dc-4dcm2"
Jul 07 19:09:48.033716 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.033667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f77444dc-4dcm2" event={"ID":"7bf481a8-fc22-4340-a08b-502f56ad4a1b","Type":"ContainerDied","Data":"c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361"}
Jul 07 19:09:48.033716 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.033702    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f77444dc-4dcm2" event={"ID":"7bf481a8-fc22-4340-a08b-502f56ad4a1b","Type":"ContainerDied","Data":"165d57dc6581e6f74dcfcdd6bb5027e69723123fc3e1ca105a60d93f6b11cb83"}
Jul 07 19:09:48.041244 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.041229    2569 scope.go:117] "RemoveContainer" containerID="63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f"
Jul 07 19:09:48.041499 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:09:48.041477    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f\": container with ID starting with 63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f not found: ID does not exist" containerID="63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f"
Jul 07 19:09:48.041623 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.041521    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f"} err="failed to get container status \"63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f\": rpc error: code = NotFound desc = could not find container \"63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f\": container with ID starting with 63fedfefed6adb333a89d4328b6961fa66ddfdd2018ee4fc195bef5454a6441f not found: ID does not exist"
Jul 07 19:09:48.041623 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.041541    2569 scope.go:117] "RemoveContainer" containerID="c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361"
Jul 07 19:09:48.049242 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.049222    2569 scope.go:117] "RemoveContainer" containerID="c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361"
Jul 07 19:09:48.049495 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:09:48.049478    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361\": container with ID starting with c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361 not found: ID does not exist" containerID="c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361"
Jul 07 19:09:48.049563 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.049521    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361"} err="failed to get container status \"c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361\": rpc error: code = NotFound desc = could not find container \"c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361\": container with ID starting with c69383b2944413538f677ff48f4d6c3d949621efacef781737a3b1d168006361 not found: ID does not exist"
Jul 07 19:09:48.075593 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.075503    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dd955588c-k9829" podStartSLOduration=1.669626139 podStartE2EDuration="2.075490358s" totalImagesPullingTime="405.864219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:48.073788093 +0000 UTC m=+513.214162272" watchObservedRunningTime="2026-07-07 19:09:48.075490358 +0000 UTC m=+513.215864538"
Jul 07 19:09:48.106332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.106307    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msh8h"]
Jul 07 19:09:48.119239 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.119208    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msh8h"]
Jul 07 19:09:48.136067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.136040    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hbz6v"]
Jul 07 19:09:48.136218 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.136197    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hbz6v" podUID="23953505-6760-4b62-821d-a8836583ffa7" containerName="authorino" containerID="cri-o://700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee" gracePeriod=30
Jul 07 19:09:48.140199 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.140169    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f77444dc-4dcm2"]
Jul 07 19:09:48.160315 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.160286    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f77444dc-4dcm2"]
Jul 07 19:09:48.418906 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.418881    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:48.521239 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.521206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8pzc\" (UniqueName: \"kubernetes.io/projected/23953505-6760-4b62-821d-a8836583ffa7-kube-api-access-c8pzc\") pod \"23953505-6760-4b62-821d-a8836583ffa7\" (UID: \"23953505-6760-4b62-821d-a8836583ffa7\") "
Jul 07 19:09:48.523632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.523605    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23953505-6760-4b62-821d-a8836583ffa7-kube-api-access-c8pzc" (OuterVolumeSpecName: "kube-api-access-c8pzc") pod "23953505-6760-4b62-821d-a8836583ffa7" (UID: "23953505-6760-4b62-821d-a8836583ffa7"). InnerVolumeSpecName "kube-api-access-c8pzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:09:48.622573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:48.622536    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8pzc\" (UniqueName: \"kubernetes.io/projected/23953505-6760-4b62-821d-a8836583ffa7-kube-api-access-c8pzc\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:09:49.040140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.040104    2569 generic.go:356] "Generic (PLEG): container finished" podID="23953505-6760-4b62-821d-a8836583ffa7" containerID="700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee" exitCode=0
Jul 07 19:09:49.040650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.040150    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hbz6v"
Jul 07 19:09:49.040650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.040190    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hbz6v" event={"ID":"23953505-6760-4b62-821d-a8836583ffa7","Type":"ContainerDied","Data":"700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee"}
Jul 07 19:09:49.040650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.040226    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hbz6v" event={"ID":"23953505-6760-4b62-821d-a8836583ffa7","Type":"ContainerDied","Data":"8fd53da92aead70f3986c0d077a06cbf34fcc2aedee488b01eada7600cc27991"}
Jul 07 19:09:49.040650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.040244    2569 scope.go:117] "RemoveContainer" containerID="700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee"
Jul 07 19:09:49.052380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.052361    2569 scope.go:117] "RemoveContainer" containerID="700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee"
Jul 07 19:09:49.052977 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:09:49.052955    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee\": container with ID starting with 700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee not found: ID does not exist" containerID="700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee"
Jul 07 19:09:49.053069 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.052984    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee"} err="failed to get container status \"700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee\": rpc error: code = NotFound desc = could not find container \"700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee\": container with ID starting with 700c9abc7c25882a676fe2c9cb2ee87368bc1ea206933a63e2108fdf556919ee not found: ID does not exist"
Jul 07 19:09:49.071516 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.071486    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hbz6v"]
Jul 07 19:09:49.080646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.080626    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hbz6v"]
Jul 07 19:09:49.491668 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.491638    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23953505-6760-4b62-821d-a8836583ffa7" path="/var/lib/kubelet/pods/23953505-6760-4b62-821d-a8836583ffa7/volumes"
Jul 07 19:09:49.491963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.491951    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41dd0c81-4cac-40b7-9dca-6a21a033e040" path="/var/lib/kubelet/pods/41dd0c81-4cac-40b7-9dca-6a21a033e040/volumes"
Jul 07 19:09:49.492223 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:49.492212    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bf481a8-fc22-4340-a08b-502f56ad4a1b" path="/var/lib/kubelet/pods/7bf481a8-fc22-4340-a08b-502f56ad4a1b/volumes"
Jul 07 19:09:52.752226 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752190    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-588758469c-jxfgx"]
Jul 07 19:09:52.752640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752591    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bf481a8-fc22-4340-a08b-502f56ad4a1b" containerName="authorino"
Jul 07 19:09:52.752640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752604    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bf481a8-fc22-4340-a08b-502f56ad4a1b" containerName="authorino"
Jul 07 19:09:52.752640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752620    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41dd0c81-4cac-40b7-9dca-6a21a033e040" containerName="authorino"
Jul 07 19:09:52.752640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752625    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="41dd0c81-4cac-40b7-9dca-6a21a033e040" containerName="authorino"
Jul 07 19:09:52.752640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752637    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23953505-6760-4b62-821d-a8836583ffa7" containerName="authorino"
Jul 07 19:09:52.752640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752643    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="23953505-6760-4b62-821d-a8836583ffa7" containerName="authorino"
Jul 07 19:09:52.752850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752696    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bf481a8-fc22-4340-a08b-502f56ad4a1b" containerName="authorino"
Jul 07 19:09:52.752850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752705    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="41dd0c81-4cac-40b7-9dca-6a21a033e040" containerName="authorino"
Jul 07 19:09:52.752850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.752713    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="23953505-6760-4b62-821d-a8836583ffa7" containerName="authorino"
Jul 07 19:09:52.768998 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.768966    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-588758469c-jxfgx"]
Jul 07 19:09:52.769157 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.769078    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:52.781453 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.781434    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 19:09:52.781624 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.781567    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6xdqh\""
Jul 07 19:09:52.782039 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.782023    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 19:09:52.862111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.862075    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-webhook-cert\") pod \"maas-controller-588758469c-jxfgx\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") " pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:52.862277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.862172    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msd7x\" (UniqueName: \"kubernetes.io/projected/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-kube-api-access-msd7x\") pod \"maas-controller-588758469c-jxfgx\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") " pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:52.932677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.932649    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-wf4ds"]
Jul 07 19:09:52.935102 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.935084    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:52.949643 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.949618    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-wf4ds"]
Jul 07 19:09:52.962854 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.962829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-webhook-cert\") pod \"maas-controller-588758469c-jxfgx\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") " pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:52.963011 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.962886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msd7x\" (UniqueName: \"kubernetes.io/projected/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-kube-api-access-msd7x\") pod \"maas-controller-588758469c-jxfgx\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") " pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:52.965350 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.965329    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-webhook-cert\") pod \"maas-controller-588758469c-jxfgx\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") " pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:52.972675 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:52.972651    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msd7x\" (UniqueName: \"kubernetes.io/projected/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-kube-api-access-msd7x\") pod \"maas-controller-588758469c-jxfgx\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") " pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:53.063326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.063258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8915477-136f-4697-98c5-835102483e4b-webhook-cert\") pod \"maas-controller-d4f86c5fb-wf4ds\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") " pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.063326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.063303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgcrq\" (UniqueName: \"kubernetes.io/projected/f8915477-136f-4697-98c5-835102483e4b-kube-api-access-xgcrq\") pod \"maas-controller-d4f86c5fb-wf4ds\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") " pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.079574 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.079552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:53.164142 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.164114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8915477-136f-4697-98c5-835102483e4b-webhook-cert\") pod \"maas-controller-d4f86c5fb-wf4ds\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") " pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.164278 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.164194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgcrq\" (UniqueName: \"kubernetes.io/projected/f8915477-136f-4697-98c5-835102483e4b-kube-api-access-xgcrq\") pod \"maas-controller-d4f86c5fb-wf4ds\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") " pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.167656 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.167632    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8915477-136f-4697-98c5-835102483e4b-webhook-cert\") pod \"maas-controller-d4f86c5fb-wf4ds\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") " pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.173628 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.173607    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgcrq\" (UniqueName: \"kubernetes.io/projected/f8915477-136f-4697-98c5-835102483e4b-kube-api-access-xgcrq\") pod \"maas-controller-d4f86c5fb-wf4ds\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") " pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.215124 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.215098    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-588758469c-jxfgx"]
Jul 07 19:09:53.216829 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:53.216793    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e53321b_40ce_4a79_a5e2_4bc3e33af41d.slice/crio-723d2554e7114e4c93a8a7403fb7745cfba6bab54c467f80234c72a995e0b3f0 WatchSource:0}: Error finding container 723d2554e7114e4c93a8a7403fb7745cfba6bab54c467f80234c72a995e0b3f0: Status 404 returned error can't find the container with id 723d2554e7114e4c93a8a7403fb7745cfba6bab54c467f80234c72a995e0b3f0
Jul 07 19:09:53.252353 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.252329    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:53.391130 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:53.391101    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-wf4ds"]
Jul 07 19:09:53.392560 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:09:53.392532    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8915477_136f_4697_98c5_835102483e4b.slice/crio-a2c160ac062783a1c00dc5858839fea89d906845cf682876fd141220df2d86c2 WatchSource:0}: Error finding container a2c160ac062783a1c00dc5858839fea89d906845cf682876fd141220df2d86c2: Status 404 returned error can't find the container with id a2c160ac062783a1c00dc5858839fea89d906845cf682876fd141220df2d86c2
Jul 07 19:09:54.080182 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:54.080138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588758469c-jxfgx" event={"ID":"7e53321b-40ce-4a79-a5e2-4bc3e33af41d","Type":"ContainerStarted","Data":"723d2554e7114e4c93a8a7403fb7745cfba6bab54c467f80234c72a995e0b3f0"}
Jul 07 19:09:54.081897 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:54.081823    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds" event={"ID":"f8915477-136f-4697-98c5-835102483e4b","Type":"ContainerStarted","Data":"a2c160ac062783a1c00dc5858839fea89d906845cf682876fd141220df2d86c2"}
Jul 07 19:09:56.096767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:56.096680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588758469c-jxfgx" event={"ID":"7e53321b-40ce-4a79-a5e2-4bc3e33af41d","Type":"ContainerStarted","Data":"a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17"}
Jul 07 19:09:56.096767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:56.096749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:09:56.098190 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:56.098163    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds" event={"ID":"f8915477-136f-4697-98c5-835102483e4b","Type":"ContainerStarted","Data":"b6707a4378059556e523046b563f05d801bb2383be0551ec67ac7b148a56ab8e"}
Jul 07 19:09:56.098289 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:56.098275    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:09:56.136433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:56.136389    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-588758469c-jxfgx" podStartSLOduration=1.488835866 podStartE2EDuration="4.136374616s" totalImagesPullingTime="2.64753875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:56.13361344 +0000 UTC m=+521.273987620" watchObservedRunningTime="2026-07-07 19:09:56.136374616 +0000 UTC m=+521.276748825"
Jul 07 19:09:56.159985 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:09:56.159934    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds" podStartSLOduration=1.698327522 podStartE2EDuration="4.159916405s" totalImagesPullingTime="2.461588883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:56.159573414 +0000 UTC m=+521.299947596" watchObservedRunningTime="2026-07-07 19:09:56.159916405 +0000 UTC m=+521.300290588"
Jul 07 19:10:07.109652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.109581    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:10:07.109652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.109643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:10:07.191144 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.191111    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-588758469c-jxfgx"]
Jul 07 19:10:07.191329 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.191312    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-588758469c-jxfgx" podUID="7e53321b-40ce-4a79-a5e2-4bc3e33af41d" containerName="manager" containerID="cri-o://a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17" gracePeriod=30
Jul 07 19:10:07.437986 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.437957    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:10:07.497596 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.497566    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msd7x\" (UniqueName: \"kubernetes.io/projected/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-kube-api-access-msd7x\") pod \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") "
Jul 07 19:10:07.499725 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.499691    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-kube-api-access-msd7x" (OuterVolumeSpecName: "kube-api-access-msd7x") pod "7e53321b-40ce-4a79-a5e2-4bc3e33af41d" (UID: "7e53321b-40ce-4a79-a5e2-4bc3e33af41d"). InnerVolumeSpecName "kube-api-access-msd7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:07.598426 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.598403    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-webhook-cert\") pod \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\" (UID: \"7e53321b-40ce-4a79-a5e2-4bc3e33af41d\") "
Jul 07 19:10:07.598576 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.598567    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msd7x\" (UniqueName: \"kubernetes.io/projected/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-kube-api-access-msd7x\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:10:07.600387 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.600366    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7e53321b-40ce-4a79-a5e2-4bc3e33af41d" (UID: "7e53321b-40ce-4a79-a5e2-4bc3e33af41d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:10:07.699031 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:07.698958    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e53321b-40ce-4a79-a5e2-4bc3e33af41d-webhook-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:10:08.167261 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.167226    2569 generic.go:356] "Generic (PLEG): container finished" podID="7e53321b-40ce-4a79-a5e2-4bc3e33af41d" containerID="a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17" exitCode=0
Jul 07 19:10:08.167732 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.167298    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588758469c-jxfgx"
Jul 07 19:10:08.167732 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.167310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588758469c-jxfgx" event={"ID":"7e53321b-40ce-4a79-a5e2-4bc3e33af41d","Type":"ContainerDied","Data":"a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17"}
Jul 07 19:10:08.167732 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.167366    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588758469c-jxfgx" event={"ID":"7e53321b-40ce-4a79-a5e2-4bc3e33af41d","Type":"ContainerDied","Data":"723d2554e7114e4c93a8a7403fb7745cfba6bab54c467f80234c72a995e0b3f0"}
Jul 07 19:10:08.167732 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.167397    2569 scope.go:117] "RemoveContainer" containerID="a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17"
Jul 07 19:10:08.176533 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.176500    2569 scope.go:117] "RemoveContainer" containerID="a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17"
Jul 07 19:10:08.176784 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:10:08.176765    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17\": container with ID starting with a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17 not found: ID does not exist" containerID="a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17"
Jul 07 19:10:08.176844 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.176793    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17"} err="failed to get container status \"a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17\": rpc error: code = NotFound desc = could not find container \"a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17\": container with ID starting with a479890b698cb732879fe693952cf3365d4a2b841cd3ed2eb28ce6e6496aed17 not found: ID does not exist"
Jul 07 19:10:08.200402 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.200377    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-588758469c-jxfgx"]
Jul 07 19:10:08.203203 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:08.203183    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-588758469c-jxfgx"]
Jul 07 19:10:09.491251 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:09.491207    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e53321b-40ce-4a79-a5e2-4bc3e33af41d" path="/var/lib/kubelet/pods/7e53321b-40ce-4a79-a5e2-4bc3e33af41d/volumes"
Jul 07 19:10:28.151213 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.151168    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"]
Jul 07 19:10:28.151685 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.151550    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e53321b-40ce-4a79-a5e2-4bc3e33af41d" containerName="manager"
Jul 07 19:10:28.151685 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.151566    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e53321b-40ce-4a79-a5e2-4bc3e33af41d" containerName="manager"
Jul 07 19:10:28.151685 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.151654    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e53321b-40ce-4a79-a5e2-4bc3e33af41d" containerName="manager"
Jul 07 19:10:28.156285 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.156269    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.158919 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.158897    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 07 19:10:28.212016 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.211982    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"]
Jul 07 19:10:28.263004 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.262972    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13ef97e-80ca-46c7-beba-8ea1ddc038df-openshift-service-ca\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.263168 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.263028    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m24pf\" (UniqueName: \"kubernetes.io/projected/c13ef97e-80ca-46c7-beba-8ea1ddc038df-kube-api-access-m24pf\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.263168 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.263113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c13ef97e-80ca-46c7-beba-8ea1ddc038df-maas-api-tls\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.364370 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.364338    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m24pf\" (UniqueName: \"kubernetes.io/projected/c13ef97e-80ca-46c7-beba-8ea1ddc038df-kube-api-access-m24pf\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.364560 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.364389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c13ef97e-80ca-46c7-beba-8ea1ddc038df-maas-api-tls\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.364560 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.364423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13ef97e-80ca-46c7-beba-8ea1ddc038df-openshift-service-ca\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.365028 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.365011    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c13ef97e-80ca-46c7-beba-8ea1ddc038df-openshift-service-ca\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.366820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.366800    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c13ef97e-80ca-46c7-beba-8ea1ddc038df-maas-api-tls\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.374216 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.374193    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m24pf\" (UniqueName: \"kubernetes.io/projected/c13ef97e-80ca-46c7-beba-8ea1ddc038df-kube-api-access-m24pf\") pod \"maas-api-74f44fbddb-wk5dv\" (UID: \"c13ef97e-80ca-46c7-beba-8ea1ddc038df\") " pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.466878 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.466799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:28.614499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.614462    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"]
Jul 07 19:10:28.615833 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:10:28.615807    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13ef97e_80ca_46c7_beba_8ea1ddc038df.slice/crio-9bddacebe17deff8ec906874a7be45c1ad3a680c116622798e493e545bd73dc4 WatchSource:0}: Error finding container 9bddacebe17deff8ec906874a7be45c1ad3a680c116622798e493e545bd73dc4: Status 404 returned error can't find the container with id 9bddacebe17deff8ec906874a7be45c1ad3a680c116622798e493e545bd73dc4
Jul 07 19:10:28.933670 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.933638    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g2rh2"]
Jul 07 19:10:28.936586 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.936568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:28.939805 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.939785    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v9b7n\""
Jul 07 19:10:28.939909 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.939786    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 19:10:28.951590 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.951567    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g2rh2"]
Jul 07 19:10:28.969994 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.969970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74caba65-af6a-4dca-906c-d2bf6d07d912-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g2rh2\" (UID: \"74caba65-af6a-4dca-906c-d2bf6d07d912\") " pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:28.970119 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:28.970039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j66rc\" (UniqueName: \"kubernetes.io/projected/74caba65-af6a-4dca-906c-d2bf6d07d912-kube-api-access-j66rc\") pod \"payload-pre-processing-7964457696-g2rh2\" (UID: \"74caba65-af6a-4dca-906c-d2bf6d07d912\") " pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:29.051390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.051348    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-f4rw6"]
Jul 07 19:10:29.053988 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.053959    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.070699 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.070668    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-f4rw6"]
Jul 07 19:10:29.070850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.070695    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j66rc\" (UniqueName: \"kubernetes.io/projected/74caba65-af6a-4dca-906c-d2bf6d07d912-kube-api-access-j66rc\") pod \"payload-pre-processing-7964457696-g2rh2\" (UID: \"74caba65-af6a-4dca-906c-d2bf6d07d912\") " pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:29.070850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.070786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74caba65-af6a-4dca-906c-d2bf6d07d912-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g2rh2\" (UID: \"74caba65-af6a-4dca-906c-d2bf6d07d912\") " pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:29.071466 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.071444    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74caba65-af6a-4dca-906c-d2bf6d07d912-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g2rh2\" (UID: \"74caba65-af6a-4dca-906c-d2bf6d07d912\") " pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:29.079345 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.079324    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j66rc\" (UniqueName: \"kubernetes.io/projected/74caba65-af6a-4dca-906c-d2bf6d07d912-kube-api-access-j66rc\") pod \"payload-pre-processing-7964457696-g2rh2\" (UID: \"74caba65-af6a-4dca-906c-d2bf6d07d912\") " pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:29.171654 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.171626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/7209660b-2463-45e3-a9e7-56f5eadebaee-kube-api-access-q8bth\") pod \"payload-processing-58f86c7798-f4rw6\" (UID: \"7209660b-2463-45e3-a9e7-56f5eadebaee\") " pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.172036 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.171684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7209660b-2463-45e3-a9e7-56f5eadebaee-plugins-config-volume\") pod \"payload-processing-58f86c7798-f4rw6\" (UID: \"7209660b-2463-45e3-a9e7-56f5eadebaee\") " pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.247678 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.247605    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:29.272826 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.272790    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/7209660b-2463-45e3-a9e7-56f5eadebaee-kube-api-access-q8bth\") pod \"payload-processing-58f86c7798-f4rw6\" (UID: \"7209660b-2463-45e3-a9e7-56f5eadebaee\") " pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.272936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.272861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7209660b-2463-45e3-a9e7-56f5eadebaee-plugins-config-volume\") pod \"payload-processing-58f86c7798-f4rw6\" (UID: \"7209660b-2463-45e3-a9e7-56f5eadebaee\") " pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.273687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.273662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7209660b-2463-45e3-a9e7-56f5eadebaee-plugins-config-volume\") pod \"payload-processing-58f86c7798-f4rw6\" (UID: \"7209660b-2463-45e3-a9e7-56f5eadebaee\") " pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.280767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.280742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8bth\" (UniqueName: \"kubernetes.io/projected/7209660b-2463-45e3-a9e7-56f5eadebaee-kube-api-access-q8bth\") pod \"payload-processing-58f86c7798-f4rw6\" (UID: \"7209660b-2463-45e3-a9e7-56f5eadebaee\") " pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.294580 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.294535    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv" event={"ID":"c13ef97e-80ca-46c7-beba-8ea1ddc038df","Type":"ContainerStarted","Data":"9bddacebe17deff8ec906874a7be45c1ad3a680c116622798e493e545bd73dc4"}
Jul 07 19:10:29.365238 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.365205    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:29.397277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.392175    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g2rh2"]
Jul 07 19:10:29.400537 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:10:29.400492    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74caba65_af6a_4dca_906c_d2bf6d07d912.slice/crio-530ada319219f48e0b2df826b44a3aff83c1cd689e09e97ef6aca07b33259528 WatchSource:0}: Error finding container 530ada319219f48e0b2df826b44a3aff83c1cd689e09e97ef6aca07b33259528: Status 404 returned error can't find the container with id 530ada319219f48e0b2df826b44a3aff83c1cd689e09e97ef6aca07b33259528
Jul 07 19:10:29.510915 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:29.510892    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-f4rw6"]
Jul 07 19:10:29.513545 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:10:29.513497    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7209660b_2463_45e3_a9e7_56f5eadebaee.slice/crio-216fe0d97b5d27f40ff933133e0ac37cfd3d4601e88e148431524764e12f1a88 WatchSource:0}: Error finding container 216fe0d97b5d27f40ff933133e0ac37cfd3d4601e88e148431524764e12f1a88: Status 404 returned error can't find the container with id 216fe0d97b5d27f40ff933133e0ac37cfd3d4601e88e148431524764e12f1a88
Jul 07 19:10:30.304639 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:30.304591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6" event={"ID":"7209660b-2463-45e3-a9e7-56f5eadebaee","Type":"ContainerStarted","Data":"216fe0d97b5d27f40ff933133e0ac37cfd3d4601e88e148431524764e12f1a88"}
Jul 07 19:10:30.306423 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:30.306390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2" event={"ID":"74caba65-af6a-4dca-906c-d2bf6d07d912","Type":"ContainerStarted","Data":"530ada319219f48e0b2df826b44a3aff83c1cd689e09e97ef6aca07b33259528"}
Jul 07 19:10:31.318469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:31.318449    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:10:31.337839 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:31.337781    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2" podStartSLOduration=1.518052522 podStartE2EDuration="3.337759577s" totalImagesPullingTime="1.819707055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:31.333817182 +0000 UTC m=+556.474191364" watchObservedRunningTime="2026-07-07 19:10:31.337759577 +0000 UTC m=+556.478133757"
Jul 07 19:10:32.324852 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.324816    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6" event={"ID":"7209660b-2463-45e3-a9e7-56f5eadebaee","Type":"ContainerStarted","Data":"e8ad9466110d0469bb42972f74fef5e8446b8e551f04323aa31a21abfa8ad7c1"}
Jul 07 19:10:32.325439 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.324926    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:32.326423 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.326403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2" event={"ID":"74caba65-af6a-4dca-906c-d2bf6d07d912","Type":"ContainerStarted","Data":"9ca5c418e6f102baa4f353c622238d33d183abb618afcfdde5955ec4167a3df2"}
Jul 07 19:10:32.327838 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.327814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv" event={"ID":"c13ef97e-80ca-46c7-beba-8ea1ddc038df","Type":"ContainerStarted","Data":"4b649b64010857c1a7d3de8765a2ad3d438f8df66d1ac827ff4ca0ac2b53950f"}
Jul 07 19:10:32.327957 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.327882    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:32.345711 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.345660    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6" podStartSLOduration=1.637685883 podStartE2EDuration="3.3456425s" totalImagesPullingTime="1.707956617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:32.343658734 +0000 UTC m=+557.484032926" watchObservedRunningTime="2026-07-07 19:10:32.3456425 +0000 UTC m=+557.486016681"
Jul 07 19:10:32.364716 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:32.364675    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv" podStartSLOduration=1.7596564639999999 podStartE2EDuration="4.364661585s" totalImagesPullingTime="2.605005121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:32.36275313 +0000 UTC m=+557.503127312" watchObservedRunningTime="2026-07-07 19:10:32.364661585 +0000 UTC m=+557.505035765"
Jul 07 19:10:38.340246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:38.340217    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74f44fbddb-wk5dv"
Jul 07 19:10:43.336033 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:43.336005    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-f4rw6"
Jul 07 19:10:43.336488 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:10:43.336073    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-g2rh2"
Jul 07 19:12:37.399463 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.399427    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cb9686f66-zvnxf"]
Jul 07 19:12:37.402377 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.402355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.411528 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.411478    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cb9686f66-zvnxf"]
Jul 07 19:12:37.502492 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.502457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qclrv\" (UniqueName: \"kubernetes.io/projected/50e7ae66-cb6f-4684-92b8-8eb0502abfc1-kube-api-access-qclrv\") pod \"authorino-cb9686f66-zvnxf\" (UID: \"50e7ae66-cb6f-4684-92b8-8eb0502abfc1\") " pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.502667 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.502630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50e7ae66-cb6f-4684-92b8-8eb0502abfc1-tls-cert\") pod \"authorino-cb9686f66-zvnxf\" (UID: \"50e7ae66-cb6f-4684-92b8-8eb0502abfc1\") " pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.603564 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.603494    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50e7ae66-cb6f-4684-92b8-8eb0502abfc1-tls-cert\") pod \"authorino-cb9686f66-zvnxf\" (UID: \"50e7ae66-cb6f-4684-92b8-8eb0502abfc1\") " pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.603564 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.603573    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qclrv\" (UniqueName: \"kubernetes.io/projected/50e7ae66-cb6f-4684-92b8-8eb0502abfc1-kube-api-access-qclrv\") pod \"authorino-cb9686f66-zvnxf\" (UID: \"50e7ae66-cb6f-4684-92b8-8eb0502abfc1\") " pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.606018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.605999    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50e7ae66-cb6f-4684-92b8-8eb0502abfc1-tls-cert\") pod \"authorino-cb9686f66-zvnxf\" (UID: \"50e7ae66-cb6f-4684-92b8-8eb0502abfc1\") " pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.612400 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.612375    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qclrv\" (UniqueName: \"kubernetes.io/projected/50e7ae66-cb6f-4684-92b8-8eb0502abfc1-kube-api-access-qclrv\") pod \"authorino-cb9686f66-zvnxf\" (UID: \"50e7ae66-cb6f-4684-92b8-8eb0502abfc1\") " pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.713040 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.712960    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb9686f66-zvnxf"
Jul 07 19:12:37.856617 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.856584    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cb9686f66-zvnxf"]
Jul 07 19:12:37.858011 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:12:37.857983    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50e7ae66_cb6f_4684_92b8_8eb0502abfc1.slice/crio-8e6f5f73d8ef0cd7525d862ab893f39514a8d518d893b9037f9913f92ffe0dbe WatchSource:0}: Error finding container 8e6f5f73d8ef0cd7525d862ab893f39514a8d518d893b9037f9913f92ffe0dbe: Status 404 returned error can't find the container with id 8e6f5f73d8ef0cd7525d862ab893f39514a8d518d893b9037f9913f92ffe0dbe
Jul 07 19:12:37.859278 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:37.859259    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:12:38.010094 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:38.010008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cb9686f66-zvnxf" event={"ID":"50e7ae66-cb6f-4684-92b8-8eb0502abfc1","Type":"ContainerStarted","Data":"8e6f5f73d8ef0cd7525d862ab893f39514a8d518d893b9037f9913f92ffe0dbe"}
Jul 07 19:12:39.020442 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.020402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cb9686f66-zvnxf" event={"ID":"50e7ae66-cb6f-4684-92b8-8eb0502abfc1","Type":"ContainerStarted","Data":"5066e290ac221733688aefa3a03502bb7c32093976053f931a4a8ee008de5577"}
Jul 07 19:12:39.056820 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.056750    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cb9686f66-zvnxf" podStartSLOduration=1.573359545 podStartE2EDuration="2.056729485s" totalImagesPullingTime="483.36994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:12:39.055933861 +0000 UTC m=+684.196308042" watchObservedRunningTime="2026-07-07 19:12:39.056729485 +0000 UTC m=+684.197103665"
Jul 07 19:12:39.100343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.100303    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dd955588c-k9829"]
Jul 07 19:12:39.100761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.100701    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5dd955588c-k9829" podUID="9bcff7c6-6081-48c9-91f3-d750f72cdf85" containerName="authorino" containerID="cri-o://649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d" gracePeriod=30
Jul 07 19:12:39.384706 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.384678    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:12:39.521245 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.521206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bcff7c6-6081-48c9-91f3-d750f72cdf85-tls-cert\") pod \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") "
Jul 07 19:12:39.521423 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.521274    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f89jz\" (UniqueName: \"kubernetes.io/projected/9bcff7c6-6081-48c9-91f3-d750f72cdf85-kube-api-access-f89jz\") pod \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\" (UID: \"9bcff7c6-6081-48c9-91f3-d750f72cdf85\") "
Jul 07 19:12:39.523337 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.523304    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcff7c6-6081-48c9-91f3-d750f72cdf85-kube-api-access-f89jz" (OuterVolumeSpecName: "kube-api-access-f89jz") pod "9bcff7c6-6081-48c9-91f3-d750f72cdf85" (UID: "9bcff7c6-6081-48c9-91f3-d750f72cdf85"). InnerVolumeSpecName "kube-api-access-f89jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:12:39.533283 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.533239    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcff7c6-6081-48c9-91f3-d750f72cdf85-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9bcff7c6-6081-48c9-91f3-d750f72cdf85" (UID: "9bcff7c6-6081-48c9-91f3-d750f72cdf85"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:12:39.623057 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.623017    2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bcff7c6-6081-48c9-91f3-d750f72cdf85-tls-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:12:39.623214 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:39.623060    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f89jz\" (UniqueName: \"kubernetes.io/projected/9bcff7c6-6081-48c9-91f3-d750f72cdf85-kube-api-access-f89jz\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:12:40.028199 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.028118    2569 generic.go:356] "Generic (PLEG): container finished" podID="9bcff7c6-6081-48c9-91f3-d750f72cdf85" containerID="649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d" exitCode=0
Jul 07 19:12:40.028199 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.028187    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd955588c-k9829"
Jul 07 19:12:40.028703 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.028194    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd955588c-k9829" event={"ID":"9bcff7c6-6081-48c9-91f3-d750f72cdf85","Type":"ContainerDied","Data":"649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d"}
Jul 07 19:12:40.028703 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.028240    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd955588c-k9829" event={"ID":"9bcff7c6-6081-48c9-91f3-d750f72cdf85","Type":"ContainerDied","Data":"5c69964a2c1cfbaf18d50187b59e80854019f170dec7985456760efae21f3ed9"}
Jul 07 19:12:40.028703 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.028257    2569 scope.go:117] "RemoveContainer" containerID="649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d"
Jul 07 19:12:40.042712 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.042370    2569 scope.go:117] "RemoveContainer" containerID="649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d"
Jul 07 19:12:40.043078 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:12:40.043048    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d\": container with ID starting with 649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d not found: ID does not exist" containerID="649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d"
Jul 07 19:12:40.043181 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.043088    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d"} err="failed to get container status \"649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d\": rpc error: code = NotFound desc = could not find container \"649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d\": container with ID starting with 649b22a028f357d58b41c6b62e70f968394cd10f34121d5d86e11da7c641987d not found: ID does not exist"
Jul 07 19:12:40.064374 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.064330    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dd955588c-k9829"]
Jul 07 19:12:40.066720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:40.066698    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dd955588c-k9829"]
Jul 07 19:12:41.492473 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:12:41.492439    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bcff7c6-6081-48c9-91f3-d750f72cdf85" path="/var/lib/kubelet/pods/9bcff7c6-6081-48c9-91f3-d750f72cdf85/volumes"
Jul 07 19:13:50.296662 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.296628    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-wf4ds"]
Jul 07 19:13:50.297240 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.296840    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds" podUID="f8915477-136f-4697-98c5-835102483e4b" containerName="manager" containerID="cri-o://b6707a4378059556e523046b563f05d801bb2383be0551ec67ac7b148a56ab8e" gracePeriod=30
Jul 07 19:13:50.439465 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.439427    2569 generic.go:356] "Generic (PLEG): container finished" podID="f8915477-136f-4697-98c5-835102483e4b" containerID="b6707a4378059556e523046b563f05d801bb2383be0551ec67ac7b148a56ab8e" exitCode=0
Jul 07 19:13:50.439672 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.439466    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds" event={"ID":"f8915477-136f-4697-98c5-835102483e4b","Type":"ContainerDied","Data":"b6707a4378059556e523046b563f05d801bb2383be0551ec67ac7b148a56ab8e"}
Jul 07 19:13:50.553459 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.553398    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:13:50.643812 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.643778    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8915477-136f-4697-98c5-835102483e4b-webhook-cert\") pod \"f8915477-136f-4697-98c5-835102483e4b\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") "
Jul 07 19:13:50.643972 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.643827    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgcrq\" (UniqueName: \"kubernetes.io/projected/f8915477-136f-4697-98c5-835102483e4b-kube-api-access-xgcrq\") pod \"f8915477-136f-4697-98c5-835102483e4b\" (UID: \"f8915477-136f-4697-98c5-835102483e4b\") "
Jul 07 19:13:50.646084 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.646048    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8915477-136f-4697-98c5-835102483e4b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f8915477-136f-4697-98c5-835102483e4b" (UID: "f8915477-136f-4697-98c5-835102483e4b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:13:50.646307 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.646281    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8915477-136f-4697-98c5-835102483e4b-kube-api-access-xgcrq" (OuterVolumeSpecName: "kube-api-access-xgcrq") pod "f8915477-136f-4697-98c5-835102483e4b" (UID: "f8915477-136f-4697-98c5-835102483e4b"). InnerVolumeSpecName "kube-api-access-xgcrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:13:50.744764 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.744715    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8915477-136f-4697-98c5-835102483e4b-webhook-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:13:50.744764 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:50.744758    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgcrq\" (UniqueName: \"kubernetes.io/projected/f8915477-136f-4697-98c5-835102483e4b-kube-api-access-xgcrq\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:13:51.446497 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:51.446467    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds"
Jul 07 19:13:51.446978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:51.446466    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f86c5fb-wf4ds" event={"ID":"f8915477-136f-4697-98c5-835102483e4b","Type":"ContainerDied","Data":"a2c160ac062783a1c00dc5858839fea89d906845cf682876fd141220df2d86c2"}
Jul 07 19:13:51.446978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:51.446605    2569 scope.go:117] "RemoveContainer" containerID="b6707a4378059556e523046b563f05d801bb2383be0551ec67ac7b148a56ab8e"
Jul 07 19:13:51.469796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:51.469762    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-wf4ds"]
Jul 07 19:13:51.474948 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:51.474926    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-wf4ds"]
Jul 07 19:13:51.491486 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:51.491458    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8915477-136f-4697-98c5-835102483e4b" path="/var/lib/kubelet/pods/f8915477-136f-4697-98c5-835102483e4b/volumes"
Jul 07 19:13:52.256104 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256068    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-jzd89"]
Jul 07 19:13:52.256713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256688    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8915477-136f-4697-98c5-835102483e4b" containerName="manager"
Jul 07 19:13:52.256713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256712    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8915477-136f-4697-98c5-835102483e4b" containerName="manager"
Jul 07 19:13:52.256908 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256734    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcff7c6-6081-48c9-91f3-d750f72cdf85" containerName="authorino"
Jul 07 19:13:52.256908 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256767    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcff7c6-6081-48c9-91f3-d750f72cdf85" containerName="authorino"
Jul 07 19:13:52.256908 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256849    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8915477-136f-4697-98c5-835102483e4b" containerName="manager"
Jul 07 19:13:52.256908 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.256862    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bcff7c6-6081-48c9-91f3-d750f72cdf85" containerName="authorino"
Jul 07 19:13:52.259469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.259453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.262222 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.262196    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 19:13:52.263018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.263004    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 19:13:52.263096 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.263049    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6xdqh\""
Jul 07 19:13:52.268775 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.268753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-jzd89"]
Jul 07 19:13:52.358842 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.358807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77228910-616f-4759-886f-c05a8dd66050-webhook-cert\") pod \"maas-controller-d4f86c5fb-jzd89\" (UID: \"77228910-616f-4759-886f-c05a8dd66050\") " pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.359019 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.358884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv4vh\" (UniqueName: \"kubernetes.io/projected/77228910-616f-4759-886f-c05a8dd66050-kube-api-access-xv4vh\") pod \"maas-controller-d4f86c5fb-jzd89\" (UID: \"77228910-616f-4759-886f-c05a8dd66050\") " pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.459254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.459219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77228910-616f-4759-886f-c05a8dd66050-webhook-cert\") pod \"maas-controller-d4f86c5fb-jzd89\" (UID: \"77228910-616f-4759-886f-c05a8dd66050\") " pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.459656 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.459315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv4vh\" (UniqueName: \"kubernetes.io/projected/77228910-616f-4759-886f-c05a8dd66050-kube-api-access-xv4vh\") pod \"maas-controller-d4f86c5fb-jzd89\" (UID: \"77228910-616f-4759-886f-c05a8dd66050\") " pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.461636 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.461617    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77228910-616f-4759-886f-c05a8dd66050-webhook-cert\") pod \"maas-controller-d4f86c5fb-jzd89\" (UID: \"77228910-616f-4759-886f-c05a8dd66050\") " pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.469638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.469615    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv4vh\" (UniqueName: \"kubernetes.io/projected/77228910-616f-4759-886f-c05a8dd66050-kube-api-access-xv4vh\") pod \"maas-controller-d4f86c5fb-jzd89\" (UID: \"77228910-616f-4759-886f-c05a8dd66050\") " pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.569978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.569891    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:52.709725 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:52.709695    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4f86c5fb-jzd89"]
Jul 07 19:13:52.710787 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:13:52.710758    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77228910_616f_4759_886f_c05a8dd66050.slice/crio-3f9a1ff5826393472680eefeea9c74b6e54b02a23278be06a63f85f88bd22a92 WatchSource:0}: Error finding container 3f9a1ff5826393472680eefeea9c74b6e54b02a23278be06a63f85f88bd22a92: Status 404 returned error can't find the container with id 3f9a1ff5826393472680eefeea9c74b6e54b02a23278be06a63f85f88bd22a92
Jul 07 19:13:53.467214 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:53.467178    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f86c5fb-jzd89" event={"ID":"77228910-616f-4759-886f-c05a8dd66050","Type":"ContainerStarted","Data":"8035c23976d53e6e0ab58ba2841dc1d031d8d278ba6e20ba9b3a0c81e6808940"}
Jul 07 19:13:53.467597 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:53.467240    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4f86c5fb-jzd89" event={"ID":"77228910-616f-4759-886f-c05a8dd66050","Type":"ContainerStarted","Data":"3f9a1ff5826393472680eefeea9c74b6e54b02a23278be06a63f85f88bd22a92"}
Jul 07 19:13:53.467597 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:53.467271    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:13:53.486823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:13:53.486763    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4f86c5fb-jzd89" podStartSLOduration=1.112873793 podStartE2EDuration="1.48674368s" totalImagesPullingTime="373.869887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:13:53.484655629 +0000 UTC m=+758.625029809" watchObservedRunningTime="2026-07-07 19:13:53.48674368 +0000 UTC m=+758.627117863"
Jul 07 19:14:04.478888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:14:04.478856    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4f86c5fb-jzd89"
Jul 07 19:15:00.141591 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.141555    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"]
Jul 07 19:15:00.144748 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.144732    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:15:00.147768 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.147750    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:15:00.155071 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.155039    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"]
Jul 07 19:15:00.272314 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.272277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phl58\" (UniqueName: \"kubernetes.io/projected/e0303af0-2bfb-4de9-b892-d5d0d24ea63b-kube-api-access-phl58\") pod \"maas-api-key-cleanup-29724195-nmpmw\" (UID: \"e0303af0-2bfb-4de9-b892-d5d0d24ea63b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:15:00.373589 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.373555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phl58\" (UniqueName: \"kubernetes.io/projected/e0303af0-2bfb-4de9-b892-d5d0d24ea63b-kube-api-access-phl58\") pod \"maas-api-key-cleanup-29724195-nmpmw\" (UID: \"e0303af0-2bfb-4de9-b892-d5d0d24ea63b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:15:00.382813 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.382789    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phl58\" (UniqueName: \"kubernetes.io/projected/e0303af0-2bfb-4de9-b892-d5d0d24ea63b-kube-api-access-phl58\") pod \"maas-api-key-cleanup-29724195-nmpmw\" (UID: \"e0303af0-2bfb-4de9-b892-d5d0d24ea63b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:15:00.457124 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.457048    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:15:00.589286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.589255    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"]
Jul 07 19:15:00.590973 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:15:00.590949    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0303af0_2bfb_4de9_b892_d5d0d24ea63b.slice/crio-7dcc66ea8f6363ffcc16813c2f00553fb67be47dab67c7b6503fb2db95703b45 WatchSource:0}: Error finding container 7dcc66ea8f6363ffcc16813c2f00553fb67be47dab67c7b6503fb2db95703b45: Status 404 returned error can't find the container with id 7dcc66ea8f6363ffcc16813c2f00553fb67be47dab67c7b6503fb2db95703b45
Jul 07 19:15:00.842269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:00.842232    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw" event={"ID":"e0303af0-2bfb-4de9-b892-d5d0d24ea63b","Type":"ContainerStarted","Data":"7dcc66ea8f6363ffcc16813c2f00553fb67be47dab67c7b6503fb2db95703b45"}
Jul 07 19:15:03.865116 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:03.865073    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw" event={"ID":"e0303af0-2bfb-4de9-b892-d5d0d24ea63b","Type":"ContainerStarted","Data":"ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4"}
Jul 07 19:15:03.886164 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:15:03.886114    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw" podStartSLOduration=1.7680916469999999 podStartE2EDuration="3.886100096s" totalImagesPullingTime="2.118008449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:03.884303741 +0000 UTC m=+829.024677924" watchObservedRunningTime="2026-07-07 19:15:03.886100096 +0000 UTC m=+829.026474274"
Jul 07 19:16:00.011531 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:00.011475    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"]
Jul 07 19:16:00.012050 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:00.011745    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw" podUID="e0303af0-2bfb-4de9-b892-d5d0d24ea63b" containerName="cleanup" containerID="cri-o://ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4" gracePeriod=30
Jul 07 19:16:30.193480 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.193456    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:16:30.260846 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.260814    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phl58\" (UniqueName: \"kubernetes.io/projected/e0303af0-2bfb-4de9-b892-d5d0d24ea63b-kube-api-access-phl58\") pod \"e0303af0-2bfb-4de9-b892-d5d0d24ea63b\" (UID: \"e0303af0-2bfb-4de9-b892-d5d0d24ea63b\") "
Jul 07 19:16:30.263023 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.262994    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0303af0-2bfb-4de9-b892-d5d0d24ea63b-kube-api-access-phl58" (OuterVolumeSpecName: "kube-api-access-phl58") pod "e0303af0-2bfb-4de9-b892-d5d0d24ea63b" (UID: "e0303af0-2bfb-4de9-b892-d5d0d24ea63b"). InnerVolumeSpecName "kube-api-access-phl58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:16:30.343606 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.343569    2569 generic.go:356] "Generic (PLEG): container finished" podID="e0303af0-2bfb-4de9-b892-d5d0d24ea63b" containerID="ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4" exitCode=137
Jul 07 19:16:30.343784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.343617    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"
Jul 07 19:16:30.343784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.343655    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw" event={"ID":"e0303af0-2bfb-4de9-b892-d5d0d24ea63b","Type":"ContainerDied","Data":"ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4"}
Jul 07 19:16:30.343784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.343735    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw" event={"ID":"e0303af0-2bfb-4de9-b892-d5d0d24ea63b","Type":"ContainerDied","Data":"7dcc66ea8f6363ffcc16813c2f00553fb67be47dab67c7b6503fb2db95703b45"}
Jul 07 19:16:30.343784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.343757    2569 scope.go:117] "RemoveContainer" containerID="ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4"
Jul 07 19:16:30.352813 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.352797    2569 scope.go:117] "RemoveContainer" containerID="ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4"
Jul 07 19:16:30.353041 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:16:30.353024    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4\": container with ID starting with ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4 not found: ID does not exist" containerID="ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4"
Jul 07 19:16:30.353086 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.353048    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4"} err="failed to get container status \"ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4\": rpc error: code = NotFound desc = could not find container \"ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4\": container with ID starting with ab2aed88b6fb7d5803ee87a270dc9e7d4d7920a5c4bca81f4c452c5cd06404c4 not found: ID does not exist"
Jul 07 19:16:30.361859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.361839    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phl58\" (UniqueName: \"kubernetes.io/projected/e0303af0-2bfb-4de9-b892-d5d0d24ea63b-kube-api-access-phl58\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:16:30.368118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.368098    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"]
Jul 07 19:16:30.372480 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:30.372457    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724195-nmpmw"]
Jul 07 19:16:31.491080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:16:31.491045    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0303af0-2bfb-4de9-b892-d5d0d24ea63b" path="/var/lib/kubelet/pods/e0303af0-2bfb-4de9-b892-d5d0d24ea63b/volumes"
Jul 07 19:18:36.382584 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:36.382547    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"]
Jul 07 19:18:36.383209 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:36.382919    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5" podUID="f14848ed-6c54-4fc8-9d36-f6806139d871" containerName="manager" containerID="cri-o://07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab" gracePeriod=10
Jul 07 19:18:40.243294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.243267    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:18:40.413738 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.413707    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f14848ed-6c54-4fc8-9d36-f6806139d871-extensions-socket-volume\") pod \"f14848ed-6c54-4fc8-9d36-f6806139d871\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") "
Jul 07 19:18:40.413946 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.413750    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m68xl\" (UniqueName: \"kubernetes.io/projected/f14848ed-6c54-4fc8-9d36-f6806139d871-kube-api-access-m68xl\") pod \"f14848ed-6c54-4fc8-9d36-f6806139d871\" (UID: \"f14848ed-6c54-4fc8-9d36-f6806139d871\") "
Jul 07 19:18:40.414160 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.414136    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14848ed-6c54-4fc8-9d36-f6806139d871-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f14848ed-6c54-4fc8-9d36-f6806139d871" (UID: "f14848ed-6c54-4fc8-9d36-f6806139d871"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:40.415865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.415838    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14848ed-6c54-4fc8-9d36-f6806139d871-kube-api-access-m68xl" (OuterVolumeSpecName: "kube-api-access-m68xl") pod "f14848ed-6c54-4fc8-9d36-f6806139d871" (UID: "f14848ed-6c54-4fc8-9d36-f6806139d871"). InnerVolumeSpecName "kube-api-access-m68xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:40.514600 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.514561    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f14848ed-6c54-4fc8-9d36-f6806139d871-extensions-socket-volume\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:18:40.514600 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:40.514590    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m68xl\" (UniqueName: \"kubernetes.io/projected/f14848ed-6c54-4fc8-9d36-f6806139d871-kube-api-access-m68xl\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:18:41.071690 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.071652    2569 generic.go:356] "Generic (PLEG): container finished" podID="f14848ed-6c54-4fc8-9d36-f6806139d871" containerID="07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab" exitCode=0
Jul 07 19:18:41.071867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.071698    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"
Jul 07 19:18:41.071867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.071733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5" event={"ID":"f14848ed-6c54-4fc8-9d36-f6806139d871","Type":"ContainerDied","Data":"07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab"}
Jul 07 19:18:41.071867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.071786    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5" event={"ID":"f14848ed-6c54-4fc8-9d36-f6806139d871","Type":"ContainerDied","Data":"5f6988baea6046c1c40f3f973e51cc995ece71e88cda300bb779ce46aa181b3e"}
Jul 07 19:18:41.071867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.071807    2569 scope.go:117] "RemoveContainer" containerID="07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab"
Jul 07 19:18:41.082798 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.082781    2569 scope.go:117] "RemoveContainer" containerID="07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab"
Jul 07 19:18:41.083118 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:18:41.083089    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab\": container with ID starting with 07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab not found: ID does not exist" containerID="07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab"
Jul 07 19:18:41.083230 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.083128    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab"} err="failed to get container status \"07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab\": rpc error: code = NotFound desc = could not find container \"07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab\": container with ID starting with 07ccfc84d53f33d2b99672f407cc9d0de1b9fd43da039c43461f9934ac5eeaab not found: ID does not exist"
Jul 07 19:18:41.099077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.099047    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"]
Jul 07 19:18:41.103100 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.103074    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cr7t5"]
Jul 07 19:18:41.492373 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:18:41.492339    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14848ed-6c54-4fc8-9d36-f6806139d871" path="/var/lib/kubelet/pods/f14848ed-6c54-4fc8-9d36-f6806139d871/volumes"
Jul 07 19:19:37.568882 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.568838    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"]
Jul 07 19:19:37.569499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.569479    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0303af0-2bfb-4de9-b892-d5d0d24ea63b" containerName="cleanup"
Jul 07 19:19:37.569499 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.569501    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0303af0-2bfb-4de9-b892-d5d0d24ea63b" containerName="cleanup"
Jul 07 19:19:37.569687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.569538    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14848ed-6c54-4fc8-9d36-f6806139d871" containerName="manager"
Jul 07 19:19:37.569687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.569547    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14848ed-6c54-4fc8-9d36-f6806139d871" containerName="manager"
Jul 07 19:19:37.569687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.569660    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0303af0-2bfb-4de9-b892-d5d0d24ea63b" containerName="cleanup"
Jul 07 19:19:37.569687 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.569675    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14848ed-6c54-4fc8-9d36-f6806139d871" containerName="manager"
Jul 07 19:19:37.573900 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.573878    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.576634 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.576601    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8zk2w\""
Jul 07 19:19:37.587243 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.587216    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"]
Jul 07 19:19:37.705841 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.705806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb7fa44b-3640-4831-98c0-dde6ef6ab593-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xzklz\" (UID: \"eb7fa44b-3640-4831-98c0-dde6ef6ab593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.706020 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.705856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrsrz\" (UniqueName: \"kubernetes.io/projected/eb7fa44b-3640-4831-98c0-dde6ef6ab593-kube-api-access-wrsrz\") pod \"kuadrant-operator-controller-manager-86878c769f-xzklz\" (UID: \"eb7fa44b-3640-4831-98c0-dde6ef6ab593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.807355 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.807324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb7fa44b-3640-4831-98c0-dde6ef6ab593-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xzklz\" (UID: \"eb7fa44b-3640-4831-98c0-dde6ef6ab593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.807547 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.807366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrsrz\" (UniqueName: \"kubernetes.io/projected/eb7fa44b-3640-4831-98c0-dde6ef6ab593-kube-api-access-wrsrz\") pod \"kuadrant-operator-controller-manager-86878c769f-xzklz\" (UID: \"eb7fa44b-3640-4831-98c0-dde6ef6ab593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.807761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.807742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb7fa44b-3640-4831-98c0-dde6ef6ab593-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xzklz\" (UID: \"eb7fa44b-3640-4831-98c0-dde6ef6ab593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.837668 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.837637    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrsrz\" (UniqueName: \"kubernetes.io/projected/eb7fa44b-3640-4831-98c0-dde6ef6ab593-kube-api-access-wrsrz\") pod \"kuadrant-operator-controller-manager-86878c769f-xzklz\" (UID: \"eb7fa44b-3640-4831-98c0-dde6ef6ab593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:37.885075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:37.885045    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:38.036274 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:38.036237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"]
Jul 07 19:19:38.036818 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:19:38.036796    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7fa44b_3640_4831_98c0_dde6ef6ab593.slice/crio-f7595ea68a6934da31fb0c5115a8f92c2a912d177e1b40fa74100797837ee463 WatchSource:0}: Error finding container f7595ea68a6934da31fb0c5115a8f92c2a912d177e1b40fa74100797837ee463: Status 404 returned error can't find the container with id f7595ea68a6934da31fb0c5115a8f92c2a912d177e1b40fa74100797837ee463
Jul 07 19:19:38.385429 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:38.385329    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz" event={"ID":"eb7fa44b-3640-4831-98c0-dde6ef6ab593","Type":"ContainerStarted","Data":"520968873fb335ba7ad6225bbe29607ef1e3ca01ba1c616dc412e273382b935e"}
Jul 07 19:19:38.385630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:38.385430    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:19:38.385630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:38.385459    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz" event={"ID":"eb7fa44b-3640-4831-98c0-dde6ef6ab593","Type":"ContainerStarted","Data":"f7595ea68a6934da31fb0c5115a8f92c2a912d177e1b40fa74100797837ee463"}
Jul 07 19:19:38.421121 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:38.421070    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz" podStartSLOduration=1.421053344 podStartE2EDuration="1.421053344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:38.419537178 +0000 UTC m=+1103.559911359" watchObservedRunningTime="2026-07-07 19:19:38.421053344 +0000 UTC m=+1103.561427578"
Jul 07 19:19:49.393407 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:19:49.393372    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xzklz"
Jul 07 19:25:59.724604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.724565    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"]
Jul 07 19:25:59.730435 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.730410    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.737169 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.737143    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:25:59.737421 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.737233    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dc7aed73-openshift-default-dockercfg-m4tls\""
Jul 07 19:25:59.800371 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-socket\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0dc994f-858f-47c8-abc0-1fe75577594a-istiod-ca-cert\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-token\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-data\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-credential-socket\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-envoy\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800625    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-podinfo\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-certs\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.800818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.800715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xkc\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-kube-api-access-s9xkc\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.813576 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.813499    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"]
Jul 07 19:25:59.901889 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.901854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-certs\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.901904    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xkc\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-kube-api-access-s9xkc\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-socket\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0dc994f-858f-47c8-abc0-1fe75577594a-istiod-ca-cert\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-token\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-data\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-credential-socket\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902431 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-envoy\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902431 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902304    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-certs\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902431 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902388    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-socket\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902656 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902634    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-data\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902666    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-credential-socket\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-podinfo\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.902875 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.902859    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0dc994f-858f-47c8-abc0-1fe75577594a-istiod-ca-cert\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.904531 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.904495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-envoy\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.904775 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.904754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-podinfo\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.912122 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.912101    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-token\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:25:59.912242 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:25:59.912224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xkc\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-kube-api-access-s9xkc\") pod \"e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") " pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:00.044093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:00.044012    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:00.191807 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:00.191777    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"]
Jul 07 19:26:00.193396 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:26:00.193373    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0dc994f_858f_47c8_abc0_1fe75577594a.slice/crio-6bceaf318fd02bdde0c5e4e4bc76b0f3a20a26a9a13ec4cfe21d0a5a2a581783 WatchSource:0}: Error finding container 6bceaf318fd02bdde0c5e4e4bc76b0f3a20a26a9a13ec4cfe21d0a5a2a581783: Status 404 returned error can't find the container with id 6bceaf318fd02bdde0c5e4e4bc76b0f3a20a26a9a13ec4cfe21d0a5a2a581783
Jul 07 19:26:00.195490 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:00.195473    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:26:00.521452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:00.521418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" event={"ID":"e0dc994f-858f-47c8-abc0-1fe75577594a","Type":"ContainerStarted","Data":"6bceaf318fd02bdde0c5e4e4bc76b0f3a20a26a9a13ec4cfe21d0a5a2a581783"}
Jul 07 19:26:01.017199 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.017046    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"]
Jul 07 19:26:01.020945 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.020920    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.026745 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.026720    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dc7aed73-serving-cert\""
Jul 07 19:26:01.027548 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.027502    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:26:01.035931 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.035859    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"]
Jul 07 19:26:01.115913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.115871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0101234-72a7-4102-ae6a-35c0756e06f8-openshift-service-ca\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.116095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.115927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c29lk\" (UniqueName: \"kubernetes.io/projected/f0101234-72a7-4102-ae6a-35c0756e06f8-kube-api-access-c29lk\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.116095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.116004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.216571 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.216540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.216765 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.216668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0101234-72a7-4102-ae6a-35c0756e06f8-openshift-service-ca\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.216765 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:01.216677    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-serving-cert: secret "maas-api-e2e-ait-dc7aed73-serving-cert" not found
Jul 07 19:26:01.216765 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.216701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c29lk\" (UniqueName: \"kubernetes.io/projected/f0101234-72a7-4102-ae6a-35c0756e06f8-kube-api-access-c29lk\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.216765 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:01.216745    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls podName:f0101234-72a7-4102-ae6a-35c0756e06f8 nodeName:}" failed. No retries permitted until 2026-07-07 19:26:01.716723828 +0000 UTC m=+1486.857097991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls") pod "maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" (UID: "f0101234-72a7-4102-ae6a-35c0756e06f8") : secret "maas-api-e2e-ait-dc7aed73-serving-cert" not found
Jul 07 19:26:01.217456 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.217430    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0101234-72a7-4102-ae6a-35c0756e06f8-openshift-service-ca\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.227444 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.227415    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c29lk\" (UniqueName: \"kubernetes.io/projected/f0101234-72a7-4102-ae6a-35c0756e06f8-kube-api-access-c29lk\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.722193 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.722101    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.724963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.724933    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls\") pod \"maas-api-e2e-ait-dc7aed73-d98767969-rwnx4\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:01.938212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:01.938171    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:03.002922 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.002883    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:03.003301 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.002977    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:03.003301 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.003024    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:03.091984 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.091952    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"]
Jul 07 19:26:03.097911 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:26:03.097884    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0101234_72a7_4102_ae6a_35c0756e06f8.slice/crio-50a6656830ecbf588571869f58e2ccc4ef8122763649ecd0273fff86463360ee WatchSource:0}: Error finding container 50a6656830ecbf588571869f58e2ccc4ef8122763649ecd0273fff86463360ee: Status 404 returned error can't find the container with id 50a6656830ecbf588571869f58e2ccc4ef8122763649ecd0273fff86463360ee
Jul 07 19:26:03.540951 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.540909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" event={"ID":"f0101234-72a7-4102-ae6a-35c0756e06f8","Type":"ContainerStarted","Data":"50a6656830ecbf588571869f58e2ccc4ef8122763649ecd0273fff86463360ee"}
Jul 07 19:26:03.542600 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.542568    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" event={"ID":"e0dc994f-858f-47c8-abc0-1fe75577594a","Type":"ContainerStarted","Data":"998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48"}
Jul 07 19:26:03.590844 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:03.590787    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" podStartSLOduration=1.783809432 podStartE2EDuration="4.590766286s" totalImagesPullingTime="2.806956854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:03.588913746 +0000 UTC m=+1488.729287924" watchObservedRunningTime="2026-07-07 19:26:03.590766286 +0000 UTC m=+1488.731140466"
Jul 07 19:26:04.044474 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.044379    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:04.050021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.049993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:04.550181 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.550144    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" event={"ID":"f0101234-72a7-4102-ae6a-35c0756e06f8","Type":"ContainerStarted","Data":"5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644"}
Jul 07 19:26:04.550359 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.550230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:04.550406 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.550360    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:04.551198 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.551180    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:04.581383 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:04.581336    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" podStartSLOduration=4.087651022 podStartE2EDuration="4.581316725s" totalImagesPullingTime="493.665703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:04.577882386 +0000 UTC m=+1489.718256566" watchObservedRunningTime="2026-07-07 19:26:04.581316725 +0000 UTC m=+1489.721690907"
Jul 07 19:26:06.149425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.149382    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"]
Jul 07 19:26:06.489869 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.489784    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"]
Jul 07 19:26:06.562147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.562078    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" podUID="f0101234-72a7-4102-ae6a-35c0756e06f8" containerName="maas-api" containerID="cri-o://5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644" gracePeriod=30
Jul 07 19:26:06.562147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.562129    2569 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" secret="" err="secret \"e2e-ait-dc7aed73-openshift-default-dockercfg-m4tls\" not found"
Jul 07 19:26:06.819361 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.819334    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:06.872851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.872822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls\") pod \"f0101234-72a7-4102-ae6a-35c0756e06f8\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") "
Jul 07 19:26:06.873045 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.872886    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0101234-72a7-4102-ae6a-35c0756e06f8-openshift-service-ca\") pod \"f0101234-72a7-4102-ae6a-35c0756e06f8\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") "
Jul 07 19:26:06.873045 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.872939    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c29lk\" (UniqueName: \"kubernetes.io/projected/f0101234-72a7-4102-ae6a-35c0756e06f8-kube-api-access-c29lk\") pod \"f0101234-72a7-4102-ae6a-35c0756e06f8\" (UID: \"f0101234-72a7-4102-ae6a-35c0756e06f8\") "
Jul 07 19:26:06.873324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.873283    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0101234-72a7-4102-ae6a-35c0756e06f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0101234-72a7-4102-ae6a-35c0756e06f8" (UID: "f0101234-72a7-4102-ae6a-35c0756e06f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:26:06.875100 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.875073    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0101234-72a7-4102-ae6a-35c0756e06f8-kube-api-access-c29lk" (OuterVolumeSpecName: "kube-api-access-c29lk") pod "f0101234-72a7-4102-ae6a-35c0756e06f8" (UID: "f0101234-72a7-4102-ae6a-35c0756e06f8"). InnerVolumeSpecName "kube-api-access-c29lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:06.875183 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.875160    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0101234-72a7-4102-ae6a-35c0756e06f8" (UID: "f0101234-72a7-4102-ae6a-35c0756e06f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:26:06.973773 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.973740    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c29lk\" (UniqueName: \"kubernetes.io/projected/f0101234-72a7-4102-ae6a-35c0756e06f8-kube-api-access-c29lk\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:06.973773 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.973769    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0101234-72a7-4102-ae6a-35c0756e06f8-maas-api-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:06.973773 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:06.973778    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0101234-72a7-4102-ae6a-35c0756e06f8-openshift-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:07.568396 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.568365    2569 generic.go:356] "Generic (PLEG): container finished" podID="f0101234-72a7-4102-ae6a-35c0756e06f8" containerID="5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644" exitCode=0
Jul 07 19:26:07.568857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.568424    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"
Jul 07 19:26:07.568857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.568461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" event={"ID":"f0101234-72a7-4102-ae6a-35c0756e06f8","Type":"ContainerDied","Data":"5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644"}
Jul 07 19:26:07.568857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.568529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4" event={"ID":"f0101234-72a7-4102-ae6a-35c0756e06f8","Type":"ContainerDied","Data":"50a6656830ecbf588571869f58e2ccc4ef8122763649ecd0273fff86463360ee"}
Jul 07 19:26:07.568857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.568543    2569 scope.go:117] "RemoveContainer" containerID="5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644"
Jul 07 19:26:07.568857 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.568674    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" podUID="e0dc994f-858f-47c8-abc0-1fe75577594a" containerName="istio-proxy" containerID="cri-o://998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48" gracePeriod=30
Jul 07 19:26:07.577478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.577451    2569 scope.go:117] "RemoveContainer" containerID="5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644"
Jul 07 19:26:07.577776 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:07.577753    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644\": container with ID starting with 5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644 not found: ID does not exist" containerID="5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644"
Jul 07 19:26:07.577878 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.577781    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644"} err="failed to get container status \"5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644\": rpc error: code = NotFound desc = could not find container \"5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644\": container with ID starting with 5917231fcd42e47998bd9d5020bf4f8603120a64cdb455e3c9474314719a9644 not found: ID does not exist"
Jul 07 19:26:07.594474 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.594445    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"]
Jul 07 19:26:07.599727 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:07.599700    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc7aed73-d98767969-rwnx4"]
Jul 07 19:26:09.498265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:09.498227    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0101234-72a7-4102-ae6a-35c0756e06f8" path="/var/lib/kubelet/pods/f0101234-72a7-4102-ae6a-35c0756e06f8/volumes"
Jul 07 19:26:12.779393 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.779105    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"]
Jul 07 19:26:12.779854 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.779549    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0101234-72a7-4102-ae6a-35c0756e06f8" containerName="maas-api"
Jul 07 19:26:12.779854 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.779565    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0101234-72a7-4102-ae6a-35c0756e06f8" containerName="maas-api"
Jul 07 19:26:12.779854 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.779640    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0101234-72a7-4102-ae6a-35c0756e06f8" containerName="maas-api"
Jul 07 19:26:12.783017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.782993    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.785939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.785913    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fc967d36-openshift-default-dockercfg-bhdtb\""
Jul 07 19:26:12.801460 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.801384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"]
Jul 07 19:26:12.842771 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.842745    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:12.934094 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934063    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-socket\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934108    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-token\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934135    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xkc\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-kube-api-access-s9xkc\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934170    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-data\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934208    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-podinfo\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934261    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-credential-socket\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934320    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-certs\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934342    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:12.934604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934352    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-envoy\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934412    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0dc994f-858f-47c8-abc0-1fe75577594a-istiod-ca-cert\") pod \"e0dc994f-858f-47c8-abc0-1fe75577594a\" (UID: \"e0dc994f-858f-47c8-abc0-1fe75577594a\") "
Jul 07 19:26:12.934604 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934493    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:12.934974 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934892    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:12.935060 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.934919    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:12.935060 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-socket\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935171 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-data\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef7990-69b2-47aa-ad22-e279cb24500b-istiod-ca-cert\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-certs\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935338 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935306    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-token\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935394 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-credential-socket\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935451 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-envoy\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935451 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935418    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0dc994f-858f-47c8-abc0-1fe75577594a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:26:12.935451 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-podinfo\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935645 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlq4c\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-kube-api-access-dlq4c\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:12.935722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935700    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:12.935779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935727    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:12.935779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935742    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:12.935779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935756    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:12.935779 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.935770    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0dc994f-858f-47c8-abc0-1fe75577594a-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:12.936975 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.936919    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:12.937153 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.937129    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:12.937373 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.937350    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:26:12.937493 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:12.937479    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-kube-api-access-s9xkc" (OuterVolumeSpecName: "kube-api-access-s9xkc") pod "e0dc994f-858f-47c8-abc0-1fe75577594a" (UID: "e0dc994f-858f-47c8-abc0-1fe75577594a"). InnerVolumeSpecName "kube-api-access-s9xkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:13.036485 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef7990-69b2-47aa-ad22-e279cb24500b-istiod-ca-cert\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.036702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-certs\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.036702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036539    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-token\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.036702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036586    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-credential-socket\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.036702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-envoy\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.036702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036644    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-podinfo\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.036702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlq4c\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-kube-api-access-dlq4c\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036755    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-socket\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036780    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-data\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036818    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036833    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036846    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xkc\" (UniqueName: \"kubernetes.io/projected/e0dc994f-858f-47c8-abc0-1fe75577594a-kube-api-access-s9xkc\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.036859    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0dc994f-858f-47c8-abc0-1fe75577594a-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:13.037049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.037031    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-credential-socket\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.037297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-certs\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.037332    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-data\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.037444    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-socket\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.037929 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.037907    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef7990-69b2-47aa-ad22-e279cb24500b-istiod-ca-cert\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.039234 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.039213    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-podinfo\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.039321 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.039290    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-envoy\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.045267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.045246    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-token\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.045267 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.045261    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlq4c\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-kube-api-access-dlq4c\") pod \"e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") " pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.095642 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.095548    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:13.247360 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.247324    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"]
Jul 07 19:26:13.248662 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:26:13.248621    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ef7990_69b2_47aa_ad22_e279cb24500b.slice/crio-1350f5989d817917cef23212e3f8ac4693d7330a8de96ac2edc1bd713dce8225 WatchSource:0}: Error finding container 1350f5989d817917cef23212e3f8ac4693d7330a8de96ac2edc1bd713dce8225: Status 404 returned error can't find the container with id 1350f5989d817917cef23212e3f8ac4693d7330a8de96ac2edc1bd713dce8225
Jul 07 19:26:13.251615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.251584    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:13.251681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.251657    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:13.251719 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.251686    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:13.608714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.608674    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" event={"ID":"a7ef7990-69b2-47aa-ad22-e279cb24500b","Type":"ContainerStarted","Data":"4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e"}
Jul 07 19:26:13.608881 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.608736    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" event={"ID":"a7ef7990-69b2-47aa-ad22-e279cb24500b","Type":"ContainerStarted","Data":"1350f5989d817917cef23212e3f8ac4693d7330a8de96ac2edc1bd713dce8225"}
Jul 07 19:26:13.610185 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.610158    2569 generic.go:356] "Generic (PLEG): container finished" podID="e0dc994f-858f-47c8-abc0-1fe75577594a" containerID="998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48" exitCode=0
Jul 07 19:26:13.610315 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.610204    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"
Jul 07 19:26:13.610315 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.610241    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" event={"ID":"e0dc994f-858f-47c8-abc0-1fe75577594a","Type":"ContainerDied","Data":"998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48"}
Jul 07 19:26:13.610315 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.610290    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56" event={"ID":"e0dc994f-858f-47c8-abc0-1fe75577594a","Type":"ContainerDied","Data":"6bceaf318fd02bdde0c5e4e4bc76b0f3a20a26a9a13ec4cfe21d0a5a2a581783"}
Jul 07 19:26:13.610315 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.610313    2569 scope.go:117] "RemoveContainer" containerID="998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48"
Jul 07 19:26:13.619873 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.619850    2569 scope.go:117] "RemoveContainer" containerID="998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48"
Jul 07 19:26:13.620183 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:13.620159    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48\": container with ID starting with 998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48 not found: ID does not exist" containerID="998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48"
Jul 07 19:26:13.620275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.620189    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48"} err="failed to get container status \"998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48\": rpc error: code = NotFound desc = could not find container \"998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48\": container with ID starting with 998f16914a9dc1699dc81dbe2dcc2b97b8006f9c1229a253c87ada3aa107ac48 not found: ID does not exist"
Jul 07 19:26:13.636675 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.636615    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" podStartSLOduration=1.636594723 podStartE2EDuration="1.636594723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:13.632725835 +0000 UTC m=+1498.773100015" watchObservedRunningTime="2026-07-07 19:26:13.636594723 +0000 UTC m=+1498.776968904"
Jul 07 19:26:13.649285 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.649251    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"]
Jul 07 19:26:13.652996 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:13.652969    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dc7aed73-openshift-default-78fb488699-hxv56"]
Jul 07 19:26:14.096243 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.096210    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:14.101289 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.101256    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:14.231475 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.231442    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"]
Jul 07 19:26:14.231892 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.231877    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0dc994f-858f-47c8-abc0-1fe75577594a" containerName="istio-proxy"
Jul 07 19:26:14.231937 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.231893    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dc994f-858f-47c8-abc0-1fe75577594a" containerName="istio-proxy"
Jul 07 19:26:14.231971 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.231960    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0dc994f-858f-47c8-abc0-1fe75577594a" containerName="istio-proxy"
Jul 07 19:26:14.236298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.236272    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.239044 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.239018    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fc967d36-serving-cert\""
Jul 07 19:26:14.239548 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.239533    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:26:14.254912 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.254885    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"]
Jul 07 19:26:14.350921 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.350833    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36523b91-02c3-45e6-b04a-2b2724484123-maas-api-tls\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.350921 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.350889    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszsv\" (UniqueName: \"kubernetes.io/projected/36523b91-02c3-45e6-b04a-2b2724484123-kube-api-access-pszsv\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.351118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.350947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36523b91-02c3-45e6-b04a-2b2724484123-openshift-service-ca\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.451846 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.451811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszsv\" (UniqueName: \"kubernetes.io/projected/36523b91-02c3-45e6-b04a-2b2724484123-kube-api-access-pszsv\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.452027 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.451861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36523b91-02c3-45e6-b04a-2b2724484123-openshift-service-ca\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.452027 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.451916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36523b91-02c3-45e6-b04a-2b2724484123-maas-api-tls\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.452586 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.452565    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36523b91-02c3-45e6-b04a-2b2724484123-openshift-service-ca\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.454335 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.454313    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36523b91-02c3-45e6-b04a-2b2724484123-maas-api-tls\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.474332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.474299    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszsv\" (UniqueName: \"kubernetes.io/projected/36523b91-02c3-45e6-b04a-2b2724484123-kube-api-access-pszsv\") pod \"maas-api-e2e-ait-fc967d36-567946f58f-fgrsl\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.548334 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.548297    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:14.618822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.618735    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:14.619780 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.619757    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:14.711684 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:14.711657    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"]
Jul 07 19:26:14.712993 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:26:14.712967    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36523b91_02c3_45e6_b04a_2b2724484123.slice/crio-87dbda784d13a055eb0cea45f2a8b2fec4ac0151aa06f15dc86f78f55b4a7891 WatchSource:0}: Error finding container 87dbda784d13a055eb0cea45f2a8b2fec4ac0151aa06f15dc86f78f55b4a7891: Status 404 returned error can't find the container with id 87dbda784d13a055eb0cea45f2a8b2fec4ac0151aa06f15dc86f78f55b4a7891
Jul 07 19:26:15.493490 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:15.493463    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0dc994f-858f-47c8-abc0-1fe75577594a" path="/var/lib/kubelet/pods/e0dc994f-858f-47c8-abc0-1fe75577594a/volumes"
Jul 07 19:26:15.625859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:15.625826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl" event={"ID":"36523b91-02c3-45e6-b04a-2b2724484123","Type":"ContainerStarted","Data":"2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0"}
Jul 07 19:26:15.625859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:15.625875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl" event={"ID":"36523b91-02c3-45e6-b04a-2b2724484123","Type":"ContainerStarted","Data":"87dbda784d13a055eb0cea45f2a8b2fec4ac0151aa06f15dc86f78f55b4a7891"}
Jul 07 19:26:15.626128 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:15.625901    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:15.653858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:15.653796    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl" podStartSLOduration=1.282517242 podStartE2EDuration="1.65377297s" totalImagesPullingTime="371.255728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:15.652836676 +0000 UTC m=+1500.793210896" watchObservedRunningTime="2026-07-07 19:26:15.65377297 +0000 UTC m=+1500.794147147"
Jul 07 19:26:19.594332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:19.594269    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"]
Jul 07 19:26:19.594819 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:19.594477    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl" podUID="36523b91-02c3-45e6-b04a-2b2724484123" containerName="maas-api" containerID="cri-o://2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0" gracePeriod=30
Jul 07 19:26:19.845731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:19.845670    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:20.004068 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.004037    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36523b91-02c3-45e6-b04a-2b2724484123-openshift-service-ca\") pod \"36523b91-02c3-45e6-b04a-2b2724484123\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") "
Jul 07 19:26:20.004238 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.004097    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36523b91-02c3-45e6-b04a-2b2724484123-maas-api-tls\") pod \"36523b91-02c3-45e6-b04a-2b2724484123\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") "
Jul 07 19:26:20.004238 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.004127    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pszsv\" (UniqueName: \"kubernetes.io/projected/36523b91-02c3-45e6-b04a-2b2724484123-kube-api-access-pszsv\") pod \"36523b91-02c3-45e6-b04a-2b2724484123\" (UID: \"36523b91-02c3-45e6-b04a-2b2724484123\") "
Jul 07 19:26:20.004432 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.004410    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36523b91-02c3-45e6-b04a-2b2724484123-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36523b91-02c3-45e6-b04a-2b2724484123" (UID: "36523b91-02c3-45e6-b04a-2b2724484123"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:26:20.006215 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.006187    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36523b91-02c3-45e6-b04a-2b2724484123-kube-api-access-pszsv" (OuterVolumeSpecName: "kube-api-access-pszsv") pod "36523b91-02c3-45e6-b04a-2b2724484123" (UID: "36523b91-02c3-45e6-b04a-2b2724484123"). InnerVolumeSpecName "kube-api-access-pszsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:20.006215 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.006195    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36523b91-02c3-45e6-b04a-2b2724484123-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36523b91-02c3-45e6-b04a-2b2724484123" (UID: "36523b91-02c3-45e6-b04a-2b2724484123"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:26:20.105640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.105549    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36523b91-02c3-45e6-b04a-2b2724484123-openshift-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:20.105640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.105581    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36523b91-02c3-45e6-b04a-2b2724484123-maas-api-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:20.105640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.105591    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pszsv\" (UniqueName: \"kubernetes.io/projected/36523b91-02c3-45e6-b04a-2b2724484123-kube-api-access-pszsv\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:20.660589 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.660551    2569 generic.go:356] "Generic (PLEG): container finished" podID="36523b91-02c3-45e6-b04a-2b2724484123" containerID="2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0" exitCode=0
Jul 07 19:26:20.661083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.660597    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl" event={"ID":"36523b91-02c3-45e6-b04a-2b2724484123","Type":"ContainerDied","Data":"2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0"}
Jul 07 19:26:20.661083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.660639    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl" event={"ID":"36523b91-02c3-45e6-b04a-2b2724484123","Type":"ContainerDied","Data":"87dbda784d13a055eb0cea45f2a8b2fec4ac0151aa06f15dc86f78f55b4a7891"}
Jul 07 19:26:20.661083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.660659    2569 scope.go:117] "RemoveContainer" containerID="2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0"
Jul 07 19:26:20.661083 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.660601    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"
Jul 07 19:26:20.671212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.671194    2569 scope.go:117] "RemoveContainer" containerID="2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0"
Jul 07 19:26:20.671457 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:20.671439    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0\": container with ID starting with 2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0 not found: ID does not exist" containerID="2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0"
Jul 07 19:26:20.671503 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.671465    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0"} err="failed to get container status \"2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0\": rpc error: code = NotFound desc = could not find container \"2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0\": container with ID starting with 2d90389d06aa72ebf7c92114b7b8ce8c9845d231ed123d6106ec080503eafdf0 not found: ID does not exist"
Jul 07 19:26:20.690780 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.690749    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"]
Jul 07 19:26:20.696095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:20.696073    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc967d36-567946f58f-fgrsl"]
Jul 07 19:26:21.492739 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:21.492703    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36523b91-02c3-45e6-b04a-2b2724484123" path="/var/lib/kubelet/pods/36523b91-02c3-45e6-b04a-2b2724484123/volumes"
Jul 07 19:26:25.110667 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:25.110633    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"]
Jul 07 19:26:25.111075 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:25.110838    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" podUID="a7ef7990-69b2-47aa-ad22-e279cb24500b" containerName="istio-proxy" containerID="cri-o://4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e" gracePeriod=30
Jul 07 19:26:29.620856 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:29.620813    2569 patch_prober.go:28] interesting pod/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:26:29.621226 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:29.620885    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" podUID="a7ef7990-69b2-47aa-ad22-e279cb24500b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:26:30.374562 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.374490    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:30.394269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394240    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-podinfo\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394415 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394289    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef7990-69b2-47aa-ad22-e279cb24500b-istiod-ca-cert\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394415 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394322    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-socket\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394487 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394428    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-credential-socket\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394545 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394483    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-certs\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394594 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394560    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-token\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394588    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlq4c\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-kube-api-access-dlq4c\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394595    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:30.394653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394636    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-data\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394783 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394668    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-envoy\") pod \"a7ef7990-69b2-47aa-ad22-e279cb24500b\" (UID: \"a7ef7990-69b2-47aa-ad22-e279cb24500b\") "
Jul 07 19:26:30.394783 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394710    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:30.394893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394793    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:30.394893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394835    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7ef7990-69b2-47aa-ad22-e279cb24500b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:26:30.394993 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394970    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ef7990-69b2-47aa-ad22-e279cb24500b-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.394993 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.394987    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.395080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.395006    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.395080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.395026    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.395080 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.395065    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:30.396537 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.396490    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:26:30.396697 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.396678    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:30.397143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.397123    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:30.397254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.397141    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-kube-api-access-dlq4c" (OuterVolumeSpecName: "kube-api-access-dlq4c") pod "a7ef7990-69b2-47aa-ad22-e279cb24500b" (UID: "a7ef7990-69b2-47aa-ad22-e279cb24500b"). InnerVolumeSpecName "kube-api-access-dlq4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:30.496294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.496256    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.496294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.496288    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.496294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.496298    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlq4c\" (UniqueName: \"kubernetes.io/projected/a7ef7990-69b2-47aa-ad22-e279cb24500b-kube-api-access-dlq4c\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.496294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.496309    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.496616 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.496318    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ef7990-69b2-47aa-ad22-e279cb24500b-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:30.721240 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.721146    2569 generic.go:356] "Generic (PLEG): container finished" podID="a7ef7990-69b2-47aa-ad22-e279cb24500b" containerID="4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e" exitCode=0
Jul 07 19:26:30.721240 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.721194    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"
Jul 07 19:26:30.721830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.721240    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" event={"ID":"a7ef7990-69b2-47aa-ad22-e279cb24500b","Type":"ContainerDied","Data":"4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e"}
Jul 07 19:26:30.721830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.721302    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb" event={"ID":"a7ef7990-69b2-47aa-ad22-e279cb24500b","Type":"ContainerDied","Data":"1350f5989d817917cef23212e3f8ac4693d7330a8de96ac2edc1bd713dce8225"}
Jul 07 19:26:30.721830 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.721332    2569 scope.go:117] "RemoveContainer" containerID="4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e"
Jul 07 19:26:30.731104 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.731080    2569 scope.go:117] "RemoveContainer" containerID="4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e"
Jul 07 19:26:30.731387 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:30.731370    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e\": container with ID starting with 4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e not found: ID does not exist" containerID="4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e"
Jul 07 19:26:30.731438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.731401    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e"} err="failed to get container status \"4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e\": rpc error: code = NotFound desc = could not find container \"4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e\": container with ID starting with 4e742faa3ab5c3c8941e97ba28aa31e3f1e9fee6ed83ac396d2eee41406bf28e not found: ID does not exist"
Jul 07 19:26:30.745246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.745216    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"]
Jul 07 19:26:30.749584 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:30.749557    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fc967d36-openshift-default-7476bd9b4c-7qjmb"]
Jul 07 19:26:31.492270 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.492237    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7ef7990-69b2-47aa-ad22-e279cb24500b" path="/var/lib/kubelet/pods/a7ef7990-69b2-47aa-ad22-e279cb24500b/volumes"
Jul 07 19:26:31.892005 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.891976    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"]
Jul 07 19:26:31.892410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.892397    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ef7990-69b2-47aa-ad22-e279cb24500b" containerName="istio-proxy"
Jul 07 19:26:31.892452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.892412    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ef7990-69b2-47aa-ad22-e279cb24500b" containerName="istio-proxy"
Jul 07 19:26:31.892452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.892423    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36523b91-02c3-45e6-b04a-2b2724484123" containerName="maas-api"
Jul 07 19:26:31.892452 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.892429    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="36523b91-02c3-45e6-b04a-2b2724484123" containerName="maas-api"
Jul 07 19:26:31.892570 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.892530    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7ef7990-69b2-47aa-ad22-e279cb24500b" containerName="istio-proxy"
Jul 07 19:26:31.892570 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.892540    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="36523b91-02c3-45e6-b04a-2b2724484123" containerName="maas-api"
Jul 07 19:26:31.902354 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.902328    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.904818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.904791    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:26:31.905018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.904791    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2dce9ec4-openshift-default-dockercfg-d72jz\""
Jul 07 19:26:31.909867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.909843    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ea7e86-0925-4a12-8246-b576b569617b-istiod-ca-cert\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910155 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ea7e86-0925-4a12-8246-b576b569617b-istio-podinfo\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5qf\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-kube-api-access-9z5qf\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-certs\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-istio-token\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-data\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-socket\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-credential-socket\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-envoy\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:31.910939 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:31.910831    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"]
Jul 07 19:26:32.012032 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.011996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-credential-socket\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012032 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-envoy\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ea7e86-0925-4a12-8246-b576b569617b-istiod-ca-cert\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012128    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ea7e86-0925-4a12-8246-b576b569617b-istio-podinfo\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5qf\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-kube-api-access-9z5qf\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-certs\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-istio-token\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012259    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-data\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012649 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-socket\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012649 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012429    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-credential-socket\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012752 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012730    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-socket\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012807 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012780    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-certs\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012807 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012793    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-data\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.012986 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.012968    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ea7e86-0925-4a12-8246-b576b569617b-istiod-ca-cert\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.014913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.014891    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-envoy\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.015224 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.015203    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ea7e86-0925-4a12-8246-b576b569617b-istio-podinfo\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.020351 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.020329    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-istio-token\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.020727 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.020709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5qf\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-kube-api-access-9z5qf\") pod \"e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") " pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.215932 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.215832    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:32.368936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.368904    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"]
Jul 07 19:26:32.370344 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:26:32.370318    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ea7e86_0925_4a12_8246_b576b569617b.slice/crio-be2d07a176f5e7af74fffb2c03a2c3242f3d5640dd9d4f0e9d1865f6b34c94f7 WatchSource:0}: Error finding container be2d07a176f5e7af74fffb2c03a2c3242f3d5640dd9d4f0e9d1865f6b34c94f7: Status 404 returned error can't find the container with id be2d07a176f5e7af74fffb2c03a2c3242f3d5640dd9d4f0e9d1865f6b34c94f7
Jul 07 19:26:32.372573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.372537    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:32.372679 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.372660    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:32.372767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.372726    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:26:32.737067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.737031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc" event={"ID":"20ea7e86-0925-4a12-8246-b576b569617b","Type":"ContainerStarted","Data":"71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3"}
Jul 07 19:26:32.737287 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.737096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc" event={"ID":"20ea7e86-0925-4a12-8246-b576b569617b","Type":"ContainerStarted","Data":"be2d07a176f5e7af74fffb2c03a2c3242f3d5640dd9d4f0e9d1865f6b34c94f7"}
Jul 07 19:26:32.758234 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:32.758185    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc" podStartSLOduration=1.758168854 podStartE2EDuration="1.758168854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:32.756755931 +0000 UTC m=+1517.897130113" watchObservedRunningTime="2026-07-07 19:26:32.758168854 +0000 UTC m=+1517.898543100"
Jul 07 19:26:33.216345 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.216313    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:33.221785 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.221760    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:33.306455 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.306416    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"]
Jul 07 19:26:33.310955 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.310928    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.313439 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.313406    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2dce9ec4-serving-cert\""
Jul 07 19:26:33.313602 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.313572    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:26:33.321613 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.321576    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"]
Jul 07 19:26:33.323580 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.323555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.323699 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.323684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d17580-8ccb-4797-bec4-cae48fbea852-openshift-service-ca\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.323774 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.323728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4x46\" (UniqueName: \"kubernetes.io/projected/21d17580-8ccb-4797-bec4-cae48fbea852-kube-api-access-v4x46\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.425108 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.425069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d17580-8ccb-4797-bec4-cae48fbea852-openshift-service-ca\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.425108 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.425111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4x46\" (UniqueName: \"kubernetes.io/projected/21d17580-8ccb-4797-bec4-cae48fbea852-kube-api-access-v4x46\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.425330 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.425190    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.425330 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:33.425301    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-serving-cert: secret "maas-api-e2e-derive-2dce9ec4-serving-cert" not found
Jul 07 19:26:33.425397 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:33.425375    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls podName:21d17580-8ccb-4797-bec4-cae48fbea852 nodeName:}" failed. No retries permitted until 2026-07-07 19:26:33.925352369 +0000 UTC m=+1519.065726541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls") pod "maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" (UID: "21d17580-8ccb-4797-bec4-cae48fbea852") : secret "maas-api-e2e-derive-2dce9ec4-serving-cert" not found
Jul 07 19:26:33.425834 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.425815    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d17580-8ccb-4797-bec4-cae48fbea852-openshift-service-ca\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.435008 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.434983    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4x46\" (UniqueName: \"kubernetes.io/projected/21d17580-8ccb-4797-bec4-cae48fbea852-kube-api-access-v4x46\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.743393 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.743361    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:33.744481 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.744461    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:33.929602 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.929566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:33.931992 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:33.931971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls\") pod \"maas-api-e2e-derive-2dce9ec4-589b857c55-578bj\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:34.224425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:34.224391    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:34.375722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:34.375686    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"]
Jul 07 19:26:34.376950 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:26:34.376920    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d17580_8ccb_4797_bec4_cae48fbea852.slice/crio-98792db4828f3c4b6357999741b5b2423f42790bf1d76611394ce7bd070c5725 WatchSource:0}: Error finding container 98792db4828f3c4b6357999741b5b2423f42790bf1d76611394ce7bd070c5725: Status 404 returned error can't find the container with id 98792db4828f3c4b6357999741b5b2423f42790bf1d76611394ce7bd070c5725
Jul 07 19:26:34.750839 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:34.750806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" event={"ID":"21d17580-8ccb-4797-bec4-cae48fbea852","Type":"ContainerStarted","Data":"98792db4828f3c4b6357999741b5b2423f42790bf1d76611394ce7bd070c5725"}
Jul 07 19:26:35.758371 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:35.758332    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" event={"ID":"21d17580-8ccb-4797-bec4-cae48fbea852","Type":"ContainerStarted","Data":"039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251"}
Jul 07 19:26:35.758822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:35.758651    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:35.784671 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:35.784621    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" podStartSLOduration=2.4333337950000002 podStartE2EDuration="2.784606087s" totalImagesPullingTime="351.272292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:26:35.783379421 +0000 UTC m=+1520.923753601" watchObservedRunningTime="2026-07-07 19:26:35.784606087 +0000 UTC m=+1520.924980266"
Jul 07 19:26:37.640702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:37.640645    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"]
Jul 07 19:26:37.641333 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:37.641258    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc" podUID="20ea7e86-0925-4a12-8246-b576b569617b" containerName="istio-proxy" containerID="cri-o://71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3" gracePeriod=30
Jul 07 19:26:37.956192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:37.956102    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"]
Jul 07 19:26:37.972881 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:37.972832    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" podUID="21d17580-8ccb-4797-bec4-cae48fbea852" containerName="maas-api" containerID="cri-o://039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251" gracePeriod=30
Jul 07 19:26:38.271380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.271346    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:38.275773 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.275747    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d17580-8ccb-4797-bec4-cae48fbea852-openshift-service-ca\") pod \"21d17580-8ccb-4797-bec4-cae48fbea852\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") "
Jul 07 19:26:38.275927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.275805    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls\") pod \"21d17580-8ccb-4797-bec4-cae48fbea852\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") "
Jul 07 19:26:38.275927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.275912    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4x46\" (UniqueName: \"kubernetes.io/projected/21d17580-8ccb-4797-bec4-cae48fbea852-kube-api-access-v4x46\") pod \"21d17580-8ccb-4797-bec4-cae48fbea852\" (UID: \"21d17580-8ccb-4797-bec4-cae48fbea852\") "
Jul 07 19:26:38.276076 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.276054    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21d17580-8ccb-4797-bec4-cae48fbea852-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21d17580-8ccb-4797-bec4-cae48fbea852" (UID: "21d17580-8ccb-4797-bec4-cae48fbea852"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:26:38.276229 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.276213    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21d17580-8ccb-4797-bec4-cae48fbea852-openshift-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:38.277923 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.277900    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21d17580-8ccb-4797-bec4-cae48fbea852-kube-api-access-v4x46" (OuterVolumeSpecName: "kube-api-access-v4x46") pod "21d17580-8ccb-4797-bec4-cae48fbea852" (UID: "21d17580-8ccb-4797-bec4-cae48fbea852"). InnerVolumeSpecName "kube-api-access-v4x46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:38.277923 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.277903    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21d17580-8ccb-4797-bec4-cae48fbea852" (UID: "21d17580-8ccb-4797-bec4-cae48fbea852"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:26:38.376632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.376595    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4x46\" (UniqueName: \"kubernetes.io/projected/21d17580-8ccb-4797-bec4-cae48fbea852-kube-api-access-v4x46\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:38.376632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.376631    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21d17580-8ccb-4797-bec4-cae48fbea852-maas-api-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:38.778347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.778317    2569 generic.go:356] "Generic (PLEG): container finished" podID="21d17580-8ccb-4797-bec4-cae48fbea852" containerID="039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251" exitCode=0
Jul 07 19:26:38.778803 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.778368    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"
Jul 07 19:26:38.778803 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.778371    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" event={"ID":"21d17580-8ccb-4797-bec4-cae48fbea852","Type":"ContainerDied","Data":"039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251"}
Jul 07 19:26:38.778803 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.778492    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj" event={"ID":"21d17580-8ccb-4797-bec4-cae48fbea852","Type":"ContainerDied","Data":"98792db4828f3c4b6357999741b5b2423f42790bf1d76611394ce7bd070c5725"}
Jul 07 19:26:38.778803 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.778533    2569 scope.go:117] "RemoveContainer" containerID="039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251"
Jul 07 19:26:38.788133 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.788116    2569 scope.go:117] "RemoveContainer" containerID="039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251"
Jul 07 19:26:38.788394 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:38.788376    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251\": container with ID starting with 039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251 not found: ID does not exist" containerID="039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251"
Jul 07 19:26:38.788439 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.788404    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251"} err="failed to get container status \"039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251\": rpc error: code = NotFound desc = could not find container \"039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251\": container with ID starting with 039e81d33c1061411782be60642e5c4b79ded7b67f931c7c171e5e72628c7251 not found: ID does not exist"
Jul 07 19:26:38.801644 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.801621    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"]
Jul 07 19:26:38.806026 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:38.806005    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2dce9ec4-589b857c55-578bj"]
Jul 07 19:26:39.491476 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:39.491441    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21d17580-8ccb-4797-bec4-cae48fbea852" path="/var/lib/kubelet/pods/21d17580-8ccb-4797-bec4-cae48fbea852/volumes"
Jul 07 19:26:44.101814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.101785    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:44.127980 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.127955    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z5qf\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-kube-api-access-9z5qf\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.127989    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-socket\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128019    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-certs\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128036    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-credential-socket\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128055    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-istio-token\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128087    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-envoy\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128366 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-data\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128366 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128179    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ea7e86-0925-4a12-8246-b576b569617b-istio-podinfo\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128366 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128212    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ea7e86-0925-4a12-8246-b576b569617b-istiod-ca-cert\") pod \"20ea7e86-0925-4a12-8246-b576b569617b\" (UID: \"20ea7e86-0925-4a12-8246-b576b569617b\") "
Jul 07 19:26:44.128366 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128323    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:44.128366 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128340    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:44.128366 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128350    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:44.128766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128601    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.128766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128621    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.128766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128636    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.128937 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.128787    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ea7e86-0925-4a12-8246-b576b569617b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:26:44.129337 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.129305    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-data" (OuterVolumeSpecName: "istio-data") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:44.131095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.130979    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-kube-api-access-9z5qf" (OuterVolumeSpecName: "kube-api-access-9z5qf") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "kube-api-access-9z5qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:44.131095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.131022    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-istio-token" (OuterVolumeSpecName: "istio-token") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:26:44.131095 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.131086    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20ea7e86-0925-4a12-8246-b576b569617b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:26:44.131297 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.131141    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20ea7e86-0925-4a12-8246-b576b569617b" (UID: "20ea7e86-0925-4a12-8246-b576b569617b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:26:44.229471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.229380    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.229471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.229408    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ea7e86-0925-4a12-8246-b576b569617b-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.229471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.229417    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ea7e86-0925-4a12-8246-b576b569617b-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.229471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.229426    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z5qf\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-kube-api-access-9z5qf\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.229471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.229435    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ea7e86-0925-4a12-8246-b576b569617b-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.229471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.229444    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ea7e86-0925-4a12-8246-b576b569617b-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:26:44.818277 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.818235    2569 generic.go:356] "Generic (PLEG): container finished" podID="20ea7e86-0925-4a12-8246-b576b569617b" containerID="71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3" exitCode=0
Jul 07 19:26:44.818498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.818286    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"
Jul 07 19:26:44.818498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.818313    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc" event={"ID":"20ea7e86-0925-4a12-8246-b576b569617b","Type":"ContainerDied","Data":"71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3"}
Jul 07 19:26:44.818498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.818367    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc" event={"ID":"20ea7e86-0925-4a12-8246-b576b569617b","Type":"ContainerDied","Data":"be2d07a176f5e7af74fffb2c03a2c3242f3d5640dd9d4f0e9d1865f6b34c94f7"}
Jul 07 19:26:44.818498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.818388    2569 scope.go:117] "RemoveContainer" containerID="71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3"
Jul 07 19:26:44.828800 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.828784    2569 scope.go:117] "RemoveContainer" containerID="71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3"
Jul 07 19:26:44.829096 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:26:44.829078    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3\": container with ID starting with 71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3 not found: ID does not exist" containerID="71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3"
Jul 07 19:26:44.829151 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.829105    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3"} err="failed to get container status \"71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3\": rpc error: code = NotFound desc = could not find container \"71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3\": container with ID starting with 71ae346f65e4929bde30337811fb57ea0c8a475e9142e71fc93da8b02710fdc3 not found: ID does not exist"
Jul 07 19:26:44.841010 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.840963    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"]
Jul 07 19:26:44.844311 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:44.844289    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2dce9ec4-openshift-default-68d8895c5-dwnsc"]
Jul 07 19:26:45.491989 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:26:45.491952    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ea7e86-0925-4a12-8246-b576b569617b" path="/var/lib/kubelet/pods/20ea7e86-0925-4a12-8246-b576b569617b/volumes"
Jul 07 19:28:22.889262 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889224    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"]
Jul 07 19:28:22.889708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889616    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20ea7e86-0925-4a12-8246-b576b569617b" containerName="istio-proxy"
Jul 07 19:28:22.889708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889627    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="20ea7e86-0925-4a12-8246-b576b569617b" containerName="istio-proxy"
Jul 07 19:28:22.889708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889654    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21d17580-8ccb-4797-bec4-cae48fbea852" containerName="maas-api"
Jul 07 19:28:22.889708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889659    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="21d17580-8ccb-4797-bec4-cae48fbea852" containerName="maas-api"
Jul 07 19:28:22.889858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889718    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="21d17580-8ccb-4797-bec4-cae48fbea852" containerName="maas-api"
Jul 07 19:28:22.889858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.889729    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="20ea7e86-0925-4a12-8246-b576b569617b" containerName="istio-proxy"
Jul 07 19:28:22.891927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.891911    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.896629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.896144    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e415bfc6-openshift-default-dockercfg-4c4jz\""
Jul 07 19:28:22.896629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.896360    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:28:22.914890 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.914784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-envoy\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.914890 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.914858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-credential-socket\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.914918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-token\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.914983    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-socket\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.915021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-data\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.915068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv295\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-kube-api-access-gv295\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.915096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-certs\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.915118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea279791-4da2-451e-8604-9c2c46ac16a7-istiod-ca-cert\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.915364 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.915177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-podinfo\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:22.921969 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:22.921942    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"]
Jul 07 19:28:23.016089 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-podinfo\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016089 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-envoy\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016317 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-credential-socket\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016317 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-token\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-socket\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-data\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016489 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv295\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-kube-api-access-gv295\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016489 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-certs\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016489 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea279791-4da2-451e-8604-9c2c46ac16a7-istiod-ca-cert\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016689 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016533    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-credential-socket\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016740    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-socket\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016824 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016768    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-data\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.016980 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.016961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-certs\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.017361 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.017340    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea279791-4da2-451e-8604-9c2c46ac16a7-istiod-ca-cert\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.018429 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.018410    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-envoy\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.018731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.018713    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-podinfo\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.024748 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.024726    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-token\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.025018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.025000    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv295\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-kube-api-access-gv295\") pod \"e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") " pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.206178 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.206091    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:23.353009 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.352984    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"]
Jul 07 19:28:23.354459 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:28:23.354427    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea279791_4da2_451e_8604_9c2c46ac16a7.slice/crio-cfd6c8d37b220d3ab6a981249f70731afd55cc61c73634881439b4dd4107f47c WatchSource:0}: Error finding container cfd6c8d37b220d3ab6a981249f70731afd55cc61c73634881439b4dd4107f47c: Status 404 returned error can't find the container with id cfd6c8d37b220d3ab6a981249f70731afd55cc61c73634881439b4dd4107f47c
Jul 07 19:28:23.356605 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.356571    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:28:23.356689 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.356639    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:28:23.356730 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.356686    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:28:23.363740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:23.363715    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" event={"ID":"ea279791-4da2-451e-8604-9c2c46ac16a7","Type":"ContainerStarted","Data":"cfd6c8d37b220d3ab6a981249f70731afd55cc61c73634881439b4dd4107f47c"}
Jul 07 19:28:24.371201 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:24.371168    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" event={"ID":"ea279791-4da2-451e-8604-9c2c46ac16a7","Type":"ContainerStarted","Data":"2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"}
Jul 07 19:28:24.395430 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:24.395379    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" podStartSLOduration=2.395362249 podStartE2EDuration="2.395362249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:28:24.392746326 +0000 UTC m=+1629.533120519" watchObservedRunningTime="2026-07-07 19:28:24.395362249 +0000 UTC m=+1629.535736429"
Jul 07 19:28:25.206521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:25.206476    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:25.211541 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:25.211500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:25.376431 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:25.376396    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:25.377438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:25.377419    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:26.755373 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.755338    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"]
Jul 07 19:28:26.757889 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.757873    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.762331 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.762312    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e415bfc6-serving-cert\""
Jul 07 19:28:26.762458 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.762417    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:28:26.776714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.776685    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"]
Jul 07 19:28:26.851894 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.851856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-openshift-service-ca\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.852077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.851913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhkpn\" (UniqueName: \"kubernetes.io/projected/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-kube-api-access-mhkpn\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.852077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.852010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.952918 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.952876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.953120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.952940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-openshift-service-ca\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.953120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.952984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhkpn\" (UniqueName: \"kubernetes.io/projected/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-kube-api-access-mhkpn\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.953120 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:28:26.953028    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-serving-cert: secret "maas-api-e2e-mt-e415bfc6-serving-cert" not found
Jul 07 19:28:26.953120 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:28:26.953101    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls podName:ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb nodeName:}" failed. No retries permitted until 2026-07-07 19:28:27.453085902 +0000 UTC m=+1632.593460060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls") pod "maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" (UID: "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb") : secret "maas-api-e2e-mt-e415bfc6-serving-cert" not found
Jul 07 19:28:26.953702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.953677    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-openshift-service-ca\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:26.965605 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:26.965580    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhkpn\" (UniqueName: \"kubernetes.io/projected/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-kube-api-access-mhkpn\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:27.457784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:27.457753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:27.460415 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:27.460393    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls\") pod \"maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:27.668996 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:27.668958    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:27.819770 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:27.819685    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"]
Jul 07 19:28:27.820888 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:28:27.820862    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7089f1_e221_4cdd_b8f0_6e3a2f40aeeb.slice/crio-e38dc75ba4c48c67e64893aa10676e383e1a5d6dcbaec33a0ca59d91c2f49d1e WatchSource:0}: Error finding container e38dc75ba4c48c67e64893aa10676e383e1a5d6dcbaec33a0ca59d91c2f49d1e: Status 404 returned error can't find the container with id e38dc75ba4c48c67e64893aa10676e383e1a5d6dcbaec33a0ca59d91c2f49d1e
Jul 07 19:28:28.394522 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:28.394468    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" event={"ID":"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb","Type":"ContainerStarted","Data":"0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480"}
Jul 07 19:28:28.394698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:28.394558    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" event={"ID":"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb","Type":"ContainerStarted","Data":"e38dc75ba4c48c67e64893aa10676e383e1a5d6dcbaec33a0ca59d91c2f49d1e"}
Jul 07 19:28:28.394698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:28.394586    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:28.429148 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:28.429090    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" podStartSLOduration=2.067480631 podStartE2EDuration="2.429073174s" totalImagesPullingTime="361.592543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:28:28.427966965 +0000 UTC m=+1633.568341167" watchObservedRunningTime="2026-07-07 19:28:28.429073174 +0000 UTC m=+1633.569447355"
Jul 07 19:28:34.404828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:34.404797    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:39.022266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.022213    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"]
Jul 07 19:28:39.022766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.022453    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" podUID="ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" containerName="maas-api" containerID="cri-o://0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480" gracePeriod=30
Jul 07 19:28:39.284032 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.283973    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:39.375958 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.375922    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhkpn\" (UniqueName: \"kubernetes.io/projected/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-kube-api-access-mhkpn\") pod \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") "
Jul 07 19:28:39.376137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.376045    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-openshift-service-ca\") pod \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") "
Jul 07 19:28:39.376137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.376091    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls\") pod \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\" (UID: \"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb\") "
Jul 07 19:28:39.376481 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.376447    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" (UID: "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:28:39.378271 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.378237    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-kube-api-access-mhkpn" (OuterVolumeSpecName: "kube-api-access-mhkpn") pod "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" (UID: "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb"). InnerVolumeSpecName "kube-api-access-mhkpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:39.378449 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.378422    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" (UID: "ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:28:39.466782 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.466739    2569 generic.go:356] "Generic (PLEG): container finished" podID="ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" containerID="0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480" exitCode=0
Jul 07 19:28:39.466954 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.466785    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"
Jul 07 19:28:39.466954 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.466803    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" event={"ID":"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb","Type":"ContainerDied","Data":"0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480"}
Jul 07 19:28:39.466954 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.466873    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg" event={"ID":"ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb","Type":"ContainerDied","Data":"e38dc75ba4c48c67e64893aa10676e383e1a5d6dcbaec33a0ca59d91c2f49d1e"}
Jul 07 19:28:39.466954 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.466906    2569 scope.go:117] "RemoveContainer" containerID="0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480"
Jul 07 19:28:39.476669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.476647    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-openshift-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:39.476669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.476669    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-maas-api-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:39.476819 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.476679    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhkpn\" (UniqueName: \"kubernetes.io/projected/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb-kube-api-access-mhkpn\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:39.477811 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.477793    2569 scope.go:117] "RemoveContainer" containerID="0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480"
Jul 07 19:28:39.478124 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:28:39.478106    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480\": container with ID starting with 0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480 not found: ID does not exist" containerID="0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480"
Jul 07 19:28:39.478171 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.478134    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480"} err="failed to get container status \"0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480\": rpc error: code = NotFound desc = could not find container \"0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480\": container with ID starting with 0e51bed5006c0b2c81ac6e21d70d2634c380a6d84989d1532550db72ab844480 not found: ID does not exist"
Jul 07 19:28:39.493936 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.493903    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"]
Jul 07 19:28:39.496260 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:39.496236    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415bfc6-577b4c9b86-7ztqg"]
Jul 07 19:28:40.654888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:40.654731    2569 patch_prober.go:28] interesting pod/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": read tcp 10.133.0.2:36688->10.133.0.70:15021: read: connection reset by peer" start-of-body=
Jul 07 19:28:40.654888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:40.654813    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": read tcp 10.133.0.2:36688->10.133.0.70:15021: read: connection reset by peer"
Jul 07 19:28:41.482368 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.482336    2569 generic.go:356] "Generic (PLEG): container finished" podID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerID="2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5" exitCode=0
Jul 07 19:28:41.482568 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.482411    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" event={"ID":"ea279791-4da2-451e-8604-9c2c46ac16a7","Type":"ContainerDied","Data":"2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"}
Jul 07 19:28:41.482829 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.482815    2569 scope.go:117] "RemoveContainer" containerID="2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"
Jul 07 19:28:41.483858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.483833    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:28:41.483912 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.483894    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:28:41.483949 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.483923    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:28:41.500541 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:41.500496    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" path="/var/lib/kubelet/pods/ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb/volumes"
Jul 07 19:28:42.490553 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:42.490518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" event={"ID":"ea279791-4da2-451e-8604-9c2c46ac16a7","Type":"ContainerStarted","Data":"646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4"}
Jul 07 19:28:43.207078 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:43.207038    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:43.207318 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:43.207296    2569 patch_prober.go:28] interesting pod/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 07 19:28:43.207423 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:43.207354    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 07 19:28:44.206667 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:44.206630    2569 patch_prober.go:28] interesting pod/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 07 19:28:44.207113 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:44.206712    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 07 19:28:45.207246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:45.207207    2569 patch_prober.go:28] interesting pod/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 07 19:28:45.207699 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:45.207279    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 07 19:28:45.845536 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:45.835377    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"]
Jul 07 19:28:45.845536 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:45.835945    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy" containerID="cri-o://646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4" gracePeriod=30
Jul 07 19:28:51.698691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.698661    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:51.804358 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804262    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-data\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804358 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804341    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-token\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804358 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804358    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv295\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-kube-api-access-gv295\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804379    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-credential-socket\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804442    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-envoy\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804467    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-socket\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804843 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804804    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:51.804843 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804819    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:51.804948 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804876    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-podinfo\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.804948 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804922    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea279791-4da2-451e-8604-9c2c46ac16a7-istiod-ca-cert\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.805074 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.804986    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-certs\") pod \"ea279791-4da2-451e-8604-9c2c46ac16a7\" (UID: \"ea279791-4da2-451e-8604-9c2c46ac16a7\") "
Jul 07 19:28:51.805307 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.805271    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:51.805440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.805302    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea279791-4da2-451e-8604-9c2c46ac16a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:28:51.805440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.805317    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:51.805440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.805349    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.805440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.805368    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.805440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.805386    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.806806 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.806777    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:28:51.806913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.806843    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-kube-api-access-gv295" (OuterVolumeSpecName: "kube-api-access-gv295") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "kube-api-access-gv295". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:51.806913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.806862    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:51.806913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.806890    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea279791-4da2-451e-8604-9c2c46ac16a7" (UID: "ea279791-4da2-451e-8604-9c2c46ac16a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:28:51.906715 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.906682    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.906715 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.906707    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.906715 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.906718    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea279791-4da2-451e-8604-9c2c46ac16a7-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.906942 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.906728    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.906942 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.906738    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:51.906942 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:51.906745    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv295\" (UniqueName: \"kubernetes.io/projected/ea279791-4da2-451e-8604-9c2c46ac16a7-kube-api-access-gv295\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:28:52.549615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.549577    2569 generic.go:356] "Generic (PLEG): container finished" podID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerID="646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4" exitCode=0
Jul 07 19:28:52.549821 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.549636    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"
Jul 07 19:28:52.549821 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.549657    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" event={"ID":"ea279791-4da2-451e-8604-9c2c46ac16a7","Type":"ContainerDied","Data":"646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4"}
Jul 07 19:28:52.549821 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.549708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f" event={"ID":"ea279791-4da2-451e-8604-9c2c46ac16a7","Type":"ContainerDied","Data":"cfd6c8d37b220d3ab6a981249f70731afd55cc61c73634881439b4dd4107f47c"}
Jul 07 19:28:52.549821 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.549729    2569 scope.go:117] "RemoveContainer" containerID="646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4"
Jul 07 19:28:52.559602 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.559442    2569 scope.go:117] "RemoveContainer" containerID="2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"
Jul 07 19:28:52.570828 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.570802    2569 scope.go:117] "RemoveContainer" containerID="646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4"
Jul 07 19:28:52.571148 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:28:52.571121    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4\": container with ID starting with 646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4 not found: ID does not exist" containerID="646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4"
Jul 07 19:28:52.571266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.571156    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4"} err="failed to get container status \"646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4\": rpc error: code = NotFound desc = could not find container \"646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4\": container with ID starting with 646ef2277509627566eac4d79576f373eeeea5bd1a0c43607d3e504c31ef1bf4 not found: ID does not exist"
Jul 07 19:28:52.571266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.571181    2569 scope.go:117] "RemoveContainer" containerID="2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"
Jul 07 19:28:52.571500 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:28:52.571477    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5\": container with ID starting with 2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5 not found: ID does not exist" containerID="2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"
Jul 07 19:28:52.571500 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.571528    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5"} err="failed to get container status \"2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5\": rpc error: code = NotFound desc = could not find container \"2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5\": container with ID starting with 2768b27c95880f700a27dae1b8d664fa633bc7fc8e57c5e1cc24cb4e3fc160c5 not found: ID does not exist"
Jul 07 19:28:52.575076 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.575054    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"]
Jul 07 19:28:52.577219 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:52.577200    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e415bfc6-openshift-default-75dfb564c9-rvk6f"]
Jul 07 19:28:53.491413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:28:53.491381    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" path="/var/lib/kubelet/pods/ea279791-4da2-451e-8604-9c2c46ac16a7/volumes"
Jul 07 19:29:06.021255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021216    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"]
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021635    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021647    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021661    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021667    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021678    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" containerName="maas-api"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021684    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" containerName="maas-api"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021750    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy"
Jul 07 19:29:06.021786 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.021762    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7089f1-e221-4cdd-b8f0-6e3a2f40aeeb" containerName="maas-api"
Jul 07 19:29:06.024468 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.024451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.027254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.027227    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-13b76f9e-openshift-default-dockercfg-4rl74\""
Jul 07 19:29:06.027461 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.027389    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:29:06.042176 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.042140    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"]
Jul 07 19:29:06.125386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-socket\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-envoy\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-istio-token\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125540    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b598d0-9587-455d-8500-ed8dc292275d-istiod-ca-cert\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125609    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-credential-socket\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-certs\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvtl\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-kube-api-access-jlvtl\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-data\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.125850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.125797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b598d0-9587-455d-8500-ed8dc292275d-istio-podinfo\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227009 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.226974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-certs\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227009 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvtl\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-kube-api-access-jlvtl\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227040    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-data\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b598d0-9587-455d-8500-ed8dc292275d-istio-podinfo\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227100    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-socket\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-envoy\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227149    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-istio-token\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b598d0-9587-455d-8500-ed8dc292275d-istiod-ca-cert\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227279 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-credential-socket\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227658 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227442    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-certs\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227658 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-data\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227658 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227570    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-socket\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.227764 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.227662    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-credential-socket\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.228021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.228004    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b598d0-9587-455d-8500-ed8dc292275d-istiod-ca-cert\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.229526 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.229490    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-envoy\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.229638 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.229606    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b598d0-9587-455d-8500-ed8dc292275d-istio-podinfo\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.236702 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.236674    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvtl\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-kube-api-access-jlvtl\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.242623 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.242599    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-istio-token\") pod \"e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") " pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.336477 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.336443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:06.480018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.479993    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"]
Jul 07 19:29:06.481938 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:29:06.481913    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b598d0_9587_455d_8500_ed8dc292275d.slice/crio-2cbb4e9d542a878f1a18a6372888755bbd6214c7166e1ebf9280a91c2df720d9 WatchSource:0}: Error finding container 2cbb4e9d542a878f1a18a6372888755bbd6214c7166e1ebf9280a91c2df720d9: Status 404 returned error can't find the container with id 2cbb4e9d542a878f1a18a6372888755bbd6214c7166e1ebf9280a91c2df720d9
Jul 07 19:29:06.484129 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.484098    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:29:06.484197 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.484160    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:29:06.484197 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.484190    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:29:06.634652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.634542    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" event={"ID":"25b598d0-9587-455d-8500-ed8dc292275d","Type":"ContainerStarted","Data":"d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"}
Jul 07 19:29:06.634652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.634613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" event={"ID":"25b598d0-9587-455d-8500-ed8dc292275d","Type":"ContainerStarted","Data":"2cbb4e9d542a878f1a18a6372888755bbd6214c7166e1ebf9280a91c2df720d9"}
Jul 07 19:29:06.666984 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:06.666929    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" podStartSLOduration=1.666911366 podStartE2EDuration="1.666911366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:29:06.66363028 +0000 UTC m=+1671.804004460" watchObservedRunningTime="2026-07-07 19:29:06.666911366 +0000 UTC m=+1671.807285546"
Jul 07 19:29:07.336697 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:07.336655    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:07.342863 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:07.342834    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:07.641886 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:07.641807    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:07.642800 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:07.642775    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:08.894048 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.894010    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"]
Jul 07 19:29:08.894709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.894692    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea279791-4da2-451e-8604-9c2c46ac16a7" containerName="istio-proxy"
Jul 07 19:29:08.896950 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.896927    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:08.899322 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.899277    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-13b76f9e-serving-cert\""
Jul 07 19:29:08.899461 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.899342    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:29:08.916859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.916832    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"]
Jul 07 19:29:08.952251 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.952213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvbqb\" (UniqueName: \"kubernetes.io/projected/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-kube-api-access-rvbqb\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:08.952425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.952347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-maas-api-tls\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:08.952425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:08.952376    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-openshift-service-ca\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.053291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.053235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-maas-api-tls\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.053466 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.053296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-openshift-service-ca\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.053466 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.053344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvbqb\" (UniqueName: \"kubernetes.io/projected/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-kube-api-access-rvbqb\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.054038 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.054014    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-openshift-service-ca\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.055812 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.055792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-maas-api-tls\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.069090 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.069066    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvbqb\" (UniqueName: \"kubernetes.io/projected/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-kube-api-access-rvbqb\") pod \"maas-api-e2e-mt-13b76f9e-557898bb55-wptb7\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.207867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.207779    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:09.363698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.363674    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"]
Jul 07 19:29:09.364810 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:29:09.364781    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d7e3ba_0990_43fd_8677_6f9fdfd27f57.slice/crio-a260a7d408b8fed3359a36dcc809cf27dc195a52ab97248762565b5452fe7eb8 WatchSource:0}: Error finding container a260a7d408b8fed3359a36dcc809cf27dc195a52ab97248762565b5452fe7eb8: Status 404 returned error can't find the container with id a260a7d408b8fed3359a36dcc809cf27dc195a52ab97248762565b5452fe7eb8
Jul 07 19:29:09.654859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:09.654821    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7" event={"ID":"10d7e3ba-0990-43fd-8677-6f9fdfd27f57","Type":"ContainerStarted","Data":"a260a7d408b8fed3359a36dcc809cf27dc195a52ab97248762565b5452fe7eb8"}
Jul 07 19:29:10.662536 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:10.662491    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7" event={"ID":"10d7e3ba-0990-43fd-8677-6f9fdfd27f57","Type":"ContainerStarted","Data":"766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045"}
Jul 07 19:29:10.662981 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:10.662684    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:10.683336 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:10.683284    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7" podStartSLOduration=2.370632454 podStartE2EDuration="2.683269152s" totalImagesPullingTime="312.636698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:29:10.680982323 +0000 UTC m=+1675.821356503" watchObservedRunningTime="2026-07-07 19:29:10.683269152 +0000 UTC m=+1675.823643332"
Jul 07 19:29:16.674934 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:16.674906    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:20.722521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:20.722474    2569 generic.go:356] "Generic (PLEG): container finished" podID="25b598d0-9587-455d-8500-ed8dc292275d" containerID="d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792" exitCode=0
Jul 07 19:29:20.722957 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:20.722546    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" event={"ID":"25b598d0-9587-455d-8500-ed8dc292275d","Type":"ContainerDied","Data":"d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"}
Jul 07 19:29:20.722957 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:20.722948    2569 scope.go:117] "RemoveContainer" containerID="d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"
Jul 07 19:29:20.723906 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:20.723877    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:29:20.724027 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:20.723959    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:29:20.724027 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:20.724008    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:29:21.750298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:21.750251    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" event={"ID":"25b598d0-9587-455d-8500-ed8dc292275d","Type":"ContainerStarted","Data":"1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210"}
Jul 07 19:29:22.337082 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:22.337042    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:22.338107 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:22.338073    2569 patch_prober.go:28] interesting pod/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 19:29:22.338290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:22.338132    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 19:29:22.642132 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:22.642032    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:23.337380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:23.336908    2569 patch_prober.go:28] interesting pod/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 19:29:23.337380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:23.336993    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 19:29:24.337790 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:24.337738    2569 patch_prober.go:28] interesting pod/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 19:29:24.338293 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:24.337811    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 19:29:25.347084 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:25.347043    2569 patch_prober.go:28] interesting pod/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 19:29:25.347720 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:25.347681    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 19:29:26.341849 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:26.341816    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:26.342823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:26.342803    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:29:56.852411 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:56.852375    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"]
Jul 07 19:29:56.853073 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:56.852597    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7" podUID="10d7e3ba-0990-43fd-8677-6f9fdfd27f57" containerName="maas-api" containerID="cri-o://766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045" gracePeriod=30
Jul 07 19:29:57.108157 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.108087    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:57.199202 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.199167    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-maas-api-tls\") pod \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") "
Jul 07 19:29:57.199409 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.199261    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvbqb\" (UniqueName: \"kubernetes.io/projected/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-kube-api-access-rvbqb\") pod \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") "
Jul 07 19:29:57.199478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.199433    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-openshift-service-ca\") pod \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\" (UID: \"10d7e3ba-0990-43fd-8677-6f9fdfd27f57\") "
Jul 07 19:29:57.199780 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.199755    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10d7e3ba-0990-43fd-8677-6f9fdfd27f57" (UID: "10d7e3ba-0990-43fd-8677-6f9fdfd27f57"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:29:57.201408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.201385    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10d7e3ba-0990-43fd-8677-6f9fdfd27f57" (UID: "10d7e3ba-0990-43fd-8677-6f9fdfd27f57"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:29:57.201466 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.201389    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-kube-api-access-rvbqb" (OuterVolumeSpecName: "kube-api-access-rvbqb") pod "10d7e3ba-0990-43fd-8677-6f9fdfd27f57" (UID: "10d7e3ba-0990-43fd-8677-6f9fdfd27f57"). InnerVolumeSpecName "kube-api-access-rvbqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:57.300245 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.300203    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-maas-api-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:29:57.300479 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.300269    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvbqb\" (UniqueName: \"kubernetes.io/projected/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-kube-api-access-rvbqb\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:29:57.300479 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.300280    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d7e3ba-0990-43fd-8677-6f9fdfd27f57-openshift-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:29:57.962794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.962754    2569 generic.go:356] "Generic (PLEG): container finished" podID="10d7e3ba-0990-43fd-8677-6f9fdfd27f57" containerID="766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045" exitCode=0
Jul 07 19:29:57.963255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.962805    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"
Jul 07 19:29:57.963255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.962834    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7" event={"ID":"10d7e3ba-0990-43fd-8677-6f9fdfd27f57","Type":"ContainerDied","Data":"766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045"}
Jul 07 19:29:57.963255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.962889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7" event={"ID":"10d7e3ba-0990-43fd-8677-6f9fdfd27f57","Type":"ContainerDied","Data":"a260a7d408b8fed3359a36dcc809cf27dc195a52ab97248762565b5452fe7eb8"}
Jul 07 19:29:57.963255 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.962914    2569 scope.go:117] "RemoveContainer" containerID="766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045"
Jul 07 19:29:57.972391 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.972374    2569 scope.go:117] "RemoveContainer" containerID="766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045"
Jul 07 19:29:57.972714 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:29:57.972696    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045\": container with ID starting with 766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045 not found: ID does not exist" containerID="766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045"
Jul 07 19:29:57.972789 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.972724    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045"} err="failed to get container status \"766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045\": rpc error: code = NotFound desc = could not find container \"766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045\": container with ID starting with 766812c7336f4ece866f7f833f15ce2547b1013590fab343443c3cc949587045 not found: ID does not exist"
Jul 07 19:29:57.981998 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.981969    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"]
Jul 07 19:29:57.985978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:57.985953    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13b76f9e-557898bb55-wptb7"]
Jul 07 19:29:59.492736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:29:59.492706    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d7e3ba-0990-43fd-8677-6f9fdfd27f57" path="/var/lib/kubelet/pods/10d7e3ba-0990-43fd-8677-6f9fdfd27f57/volumes"
Jul 07 19:30:00.140118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.140081    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"]
Jul 07 19:30:00.140521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.140492    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d7e3ba-0990-43fd-8677-6f9fdfd27f57" containerName="maas-api"
Jul 07 19:30:00.140521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.140519    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d7e3ba-0990-43fd-8677-6f9fdfd27f57" containerName="maas-api"
Jul 07 19:30:00.140608 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.140593    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d7e3ba-0990-43fd-8677-6f9fdfd27f57" containerName="maas-api"
Jul 07 19:30:00.145152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.145131    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:30:00.148306 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.148285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:30:00.154158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.154134    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"]
Jul 07 19:30:00.229935 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.229878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrf2s\" (UniqueName: \"kubernetes.io/projected/38829625-5571-4fee-9b1f-70734d304efc-kube-api-access-nrf2s\") pod \"maas-api-key-cleanup-29724210-dmw2m\" (UID: \"38829625-5571-4fee-9b1f-70734d304efc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:30:00.330411 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.330371    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrf2s\" (UniqueName: \"kubernetes.io/projected/38829625-5571-4fee-9b1f-70734d304efc-kube-api-access-nrf2s\") pod \"maas-api-key-cleanup-29724210-dmw2m\" (UID: \"38829625-5571-4fee-9b1f-70734d304efc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:30:00.339650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.339619    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrf2s\" (UniqueName: \"kubernetes.io/projected/38829625-5571-4fee-9b1f-70734d304efc-kube-api-access-nrf2s\") pod \"maas-api-key-cleanup-29724210-dmw2m\" (UID: \"38829625-5571-4fee-9b1f-70734d304efc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:30:00.457534 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.457424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:30:00.599678 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.599649    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"]
Jul 07 19:30:00.600973 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:30:00.600942    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38829625_5571_4fee_9b1f_70734d304efc.slice/crio-163bd8a171c25f3b668c8b5ec92155cf1ae53e35afbd59509340c0aac904c264 WatchSource:0}: Error finding container 163bd8a171c25f3b668c8b5ec92155cf1ae53e35afbd59509340c0aac904c264: Status 404 returned error can't find the container with id 163bd8a171c25f3b668c8b5ec92155cf1ae53e35afbd59509340c0aac904c264
Jul 07 19:30:00.989464 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.989423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m" event={"ID":"38829625-5571-4fee-9b1f-70734d304efc","Type":"ContainerStarted","Data":"0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787"}
Jul 07 19:30:00.989677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:00.989533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m" event={"ID":"38829625-5571-4fee-9b1f-70734d304efc","Type":"ContainerStarted","Data":"163bd8a171c25f3b668c8b5ec92155cf1ae53e35afbd59509340c0aac904c264"}
Jul 07 19:30:01.008655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:01.008601    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m" podStartSLOduration=1.008585513 podStartE2EDuration="1.008585513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:30:01.006077376 +0000 UTC m=+1726.146451572" watchObservedRunningTime="2026-07-07 19:30:01.008585513 +0000 UTC m=+1726.148959694"
Jul 07 19:30:57.337348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:57.337308    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"]
Jul 07 19:30:57.337974 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:30:57.337703    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy" containerID="cri-o://1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210" gracePeriod=30
Jul 07 19:31:00.012961 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:00.012929    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"]
Jul 07 19:31:00.013357 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:00.013147    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m" podUID="38829625-5571-4fee-9b1f-70734d304efc" containerName="cleanup" containerID="cri-o://0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787" gracePeriod=30
Jul 07 19:31:02.614612 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.614576    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:31:02.679306 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679270    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-credential-socket\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679306 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679326    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-envoy\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679361    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlvtl\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-kube-api-access-jlvtl\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679380    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-data\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679399    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-socket\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679555    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-certs\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679575    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:31:02.679632 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679626    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b598d0-9587-455d-8500-ed8dc292275d-istiod-ca-cert\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-istio-token\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679686    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b598d0-9587-455d-8500-ed8dc292275d-istio-podinfo\") pod \"25b598d0-9587-455d-8500-ed8dc292275d\" (UID: \"25b598d0-9587-455d-8500-ed8dc292275d\") "
Jul 07 19:31:02.679963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679729    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:31:02.679963 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679764    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:31:02.680174 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679991    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b598d0-9587-455d-8500-ed8dc292275d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:31:02.680174 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.679999    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.680174 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.680015    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.680174 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.680030    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.680369 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.680291    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-data" (OuterVolumeSpecName: "istio-data") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:31:02.681773 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.681747    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-kube-api-access-jlvtl" (OuterVolumeSpecName: "kube-api-access-jlvtl") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "kube-api-access-jlvtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:31:02.682188 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.682168    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:31:02.682269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.682230    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25b598d0-9587-455d-8500-ed8dc292275d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:31:02.682330 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.682291    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-istio-token" (OuterVolumeSpecName: "istio-token") pod "25b598d0-9587-455d-8500-ed8dc292275d" (UID: "25b598d0-9587-455d-8500-ed8dc292275d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:31:02.781309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.781171    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b598d0-9587-455d-8500-ed8dc292275d-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.781309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.781213    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.781309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.781227    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b598d0-9587-455d-8500-ed8dc292275d-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.781309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.781238    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.781309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.781251    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlvtl\" (UniqueName: \"kubernetes.io/projected/25b598d0-9587-455d-8500-ed8dc292275d-kube-api-access-jlvtl\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:02.781309 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:02.781265    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b598d0-9587-455d-8500-ed8dc292275d-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:03.350163 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.350113    2569 generic.go:356] "Generic (PLEG): container finished" podID="25b598d0-9587-455d-8500-ed8dc292275d" containerID="1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210" exitCode=0
Jul 07 19:31:03.350360 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.350189    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"
Jul 07 19:31:03.350360 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.350233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" event={"ID":"25b598d0-9587-455d-8500-ed8dc292275d","Type":"ContainerDied","Data":"1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210"}
Jul 07 19:31:03.350360 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.350345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r" event={"ID":"25b598d0-9587-455d-8500-ed8dc292275d","Type":"ContainerDied","Data":"2cbb4e9d542a878f1a18a6372888755bbd6214c7166e1ebf9280a91c2df720d9"}
Jul 07 19:31:03.350552 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.350377    2569 scope.go:117] "RemoveContainer" containerID="1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210"
Jul 07 19:31:03.361074 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.361052    2569 scope.go:117] "RemoveContainer" containerID="d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"
Jul 07 19:31:03.373705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.373500    2569 scope.go:117] "RemoveContainer" containerID="1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210"
Jul 07 19:31:03.374757 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:31:03.374724    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210\": container with ID starting with 1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210 not found: ID does not exist" containerID="1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210"
Jul 07 19:31:03.374886 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.374768    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210"} err="failed to get container status \"1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210\": rpc error: code = NotFound desc = could not find container \"1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210\": container with ID starting with 1b3c8d62dfd7e77e8d61ac3c58f2af53a9b7ac12df801cf6bf6390f2769d9210 not found: ID does not exist"
Jul 07 19:31:03.374886 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.374794    2569 scope.go:117] "RemoveContainer" containerID="d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"
Jul 07 19:31:03.375149 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:31:03.375129    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792\": container with ID starting with d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792 not found: ID does not exist" containerID="d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"
Jul 07 19:31:03.375209 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.375157    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792"} err="failed to get container status \"d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792\": rpc error: code = NotFound desc = could not find container \"d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792\": container with ID starting with d13ee47f88a4f00b94947f1830d8d82200a80cd3793bfe3e0e111b58c188a792 not found: ID does not exist"
Jul 07 19:31:03.376557 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.376535    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"]
Jul 07 19:31:03.379888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.379866    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-13b76f9e-openshift-default-7686f7865f-ghg4r"]
Jul 07 19:31:03.495708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:03.495668    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b598d0-9587-455d-8500-ed8dc292275d" path="/var/lib/kubelet/pods/25b598d0-9587-455d-8500-ed8dc292275d/volumes"
Jul 07 19:31:30.212140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.212111    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:31:30.237061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.237033    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrf2s\" (UniqueName: \"kubernetes.io/projected/38829625-5571-4fee-9b1f-70734d304efc-kube-api-access-nrf2s\") pod \"38829625-5571-4fee-9b1f-70734d304efc\" (UID: \"38829625-5571-4fee-9b1f-70734d304efc\") "
Jul 07 19:31:30.239178 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.239138    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38829625-5571-4fee-9b1f-70734d304efc-kube-api-access-nrf2s" (OuterVolumeSpecName: "kube-api-access-nrf2s") pod "38829625-5571-4fee-9b1f-70734d304efc" (UID: "38829625-5571-4fee-9b1f-70734d304efc"). InnerVolumeSpecName "kube-api-access-nrf2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:31:30.338646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.338619    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrf2s\" (UniqueName: \"kubernetes.io/projected/38829625-5571-4fee-9b1f-70734d304efc-kube-api-access-nrf2s\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:31:30.506762 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.506727    2569 generic.go:356] "Generic (PLEG): container finished" podID="38829625-5571-4fee-9b1f-70734d304efc" containerID="0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787" exitCode=137
Jul 07 19:31:30.506962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.506772    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"
Jul 07 19:31:30.506962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.506802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m" event={"ID":"38829625-5571-4fee-9b1f-70734d304efc","Type":"ContainerDied","Data":"0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787"}
Jul 07 19:31:30.506962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.506848    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m" event={"ID":"38829625-5571-4fee-9b1f-70734d304efc","Type":"ContainerDied","Data":"163bd8a171c25f3b668c8b5ec92155cf1ae53e35afbd59509340c0aac904c264"}
Jul 07 19:31:30.506962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.506876    2569 scope.go:117] "RemoveContainer" containerID="0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787"
Jul 07 19:31:30.515962 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.515945    2569 scope.go:117] "RemoveContainer" containerID="0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787"
Jul 07 19:31:30.516204 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:31:30.516185    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787\": container with ID starting with 0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787 not found: ID does not exist" containerID="0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787"
Jul 07 19:31:30.516250 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.516213    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787"} err="failed to get container status \"0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787\": rpc error: code = NotFound desc = could not find container \"0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787\": container with ID starting with 0bae131e5a8a30185ef37c81cd106ebdcf71fcb62a72c309c54f946431c02787 not found: ID does not exist"
Jul 07 19:31:30.531038 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.531016    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"]
Jul 07 19:31:30.534840 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:30.534820    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724210-dmw2m"]
Jul 07 19:31:31.491639 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:31.491605    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38829625-5571-4fee-9b1f-70734d304efc" path="/var/lib/kubelet/pods/38829625-5571-4fee-9b1f-70734d304efc/volumes"
Jul 07 19:31:53.260953 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.260915    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"]
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261298    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38829625-5571-4fee-9b1f-70734d304efc" containerName="cleanup"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261308    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38829625-5571-4fee-9b1f-70734d304efc" containerName="cleanup"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261331    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261337    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261345    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261350    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261422    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261432    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b598d0-9587-455d-8500-ed8dc292275d" containerName="istio-proxy"
Jul 07 19:31:53.261655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.261440    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="38829625-5571-4fee-9b1f-70734d304efc" containerName="cleanup"
Jul 07 19:31:53.264600 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.264584    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.267386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.267362    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a43967-openshift-default-dockercfg-ngv8p\""
Jul 07 19:31:53.267881 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.267863    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:31:53.278938 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.278913    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"]
Jul 07 19:31:53.326988 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.326953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-credential-socket\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.326988 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-envoy\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-certs\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-podinfo\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbhc8\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-kube-api-access-xbhc8\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327103    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-data\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-token\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f82dfc1-7288-455d-ba9b-376352a807e3-istiod-ca-cert\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.327402 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.327233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-socket\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428101 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-envoy\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428101 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428101    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-certs\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-podinfo\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbhc8\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-kube-api-access-xbhc8\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-data\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-token\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f82dfc1-7288-455d-ba9b-376352a807e3-istiod-ca-cert\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-socket\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-credential-socket\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428768 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428563    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-certs\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428768 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428712    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-data\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428768 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428755    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-credential-socket\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.428879 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.428799    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-socket\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.429097 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.429078    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f82dfc1-7288-455d-ba9b-376352a807e3-istiod-ca-cert\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.430553 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.430533    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-envoy\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.430845 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.430827    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-podinfo\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.439347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.439312    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-token\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.439850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.439819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbhc8\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-kube-api-access-xbhc8\") pod \"e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") " pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.575560 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.575449    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:53.727292 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.727261    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"]
Jul 07 19:31:53.728496 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:31:53.728474    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f82dfc1_7288_455d_ba9b_376352a807e3.slice/crio-d6eb72d05dac847aec3e8413d9f2e6e8a3642f3feed8a7362165c7c04a34b3c2 WatchSource:0}: Error finding container d6eb72d05dac847aec3e8413d9f2e6e8a3642f3feed8a7362165c7c04a34b3c2: Status 404 returned error can't find the container with id d6eb72d05dac847aec3e8413d9f2e6e8a3642f3feed8a7362165c7c04a34b3c2
Jul 07 19:31:53.730583 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.730552    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:31:53.730665 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.730617    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:31:53.730665 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:53.730649    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:31:54.651413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:54.651377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" event={"ID":"2f82dfc1-7288-455d-ba9b-376352a807e3","Type":"ContainerStarted","Data":"0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"}
Jul 07 19:31:54.651851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:54.651444    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" event={"ID":"2f82dfc1-7288-455d-ba9b-376352a807e3","Type":"ContainerStarted","Data":"d6eb72d05dac847aec3e8413d9f2e6e8a3642f3feed8a7362165c7c04a34b3c2"}
Jul 07 19:31:54.672782 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:54.672727    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podStartSLOduration=1.672709929 podStartE2EDuration="1.672709929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:31:54.671747565 +0000 UTC m=+1839.812121745" watchObservedRunningTime="2026-07-07 19:31:54.672709929 +0000 UTC m=+1839.813084168"
Jul 07 19:31:55.576344 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:55.576305    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:55.581614 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:55.581587    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:55.657583 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:55.657552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:55.658711 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:55.658692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:31:56.808925 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.808883    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"]
Jul 07 19:31:56.812646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.812624    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.816362 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.816339    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a43967-serving-cert\""
Jul 07 19:31:56.816547 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.816525    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kqtqf\""
Jul 07 19:31:56.826622 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.826595    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"]
Jul 07 19:31:56.858286 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.858253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5sp\" (UniqueName: \"kubernetes.io/projected/de45b5ce-a9e2-4bd5-b381-4d0a965975af-kube-api-access-nx5sp\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.858455 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.858337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de45b5ce-a9e2-4bd5-b381-4d0a965975af-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.858455 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.858375    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.959184 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.959147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de45b5ce-a9e2-4bd5-b381-4d0a965975af-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.959390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.959221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.959390 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.959269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5sp\" (UniqueName: \"kubernetes.io/projected/de45b5ce-a9e2-4bd5-b381-4d0a965975af-kube-api-access-nx5sp\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.959485 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:31:56.959391    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-serving-cert: secret "maas-api-e2e-inf-a-a43967-serving-cert" not found
Jul 07 19:31:56.959485 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:31:56.959474    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls podName:de45b5ce-a9e2-4bd5-b381-4d0a965975af nodeName:}" failed. No retries permitted until 2026-07-07 19:31:57.459452586 +0000 UTC m=+1842.599826746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls") pod "maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" (UID: "de45b5ce-a9e2-4bd5-b381-4d0a965975af") : secret "maas-api-e2e-inf-a-a43967-serving-cert" not found
Jul 07 19:31:56.959921 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.959905    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de45b5ce-a9e2-4bd5-b381-4d0a965975af-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:56.993822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:56.993789    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5sp\" (UniqueName: \"kubernetes.io/projected/de45b5ce-a9e2-4bd5-b381-4d0a965975af-kube-api-access-nx5sp\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:57.463893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:57.463852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:57.466285 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:57.466254    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls\") pod \"maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:57.723716 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:57.723622    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:57.879951 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:57.879920    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"]
Jul 07 19:31:57.881488 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:31:57.881464    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde45b5ce_a9e2_4bd5_b381_4d0a965975af.slice/crio-2a6924e33253ca62f283f34fcfb635c8fa4931fd0a097932006e4092db210b7e WatchSource:0}: Error finding container 2a6924e33253ca62f283f34fcfb635c8fa4931fd0a097932006e4092db210b7e: Status 404 returned error can't find the container with id 2a6924e33253ca62f283f34fcfb635c8fa4931fd0a097932006e4092db210b7e
Jul 07 19:31:57.882983 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:57.882965    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:31:58.677714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:58.677629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" event={"ID":"de45b5ce-a9e2-4bd5-b381-4d0a965975af","Type":"ContainerStarted","Data":"32b2a248a0c796b59ff33b1f7507a571f6421cf7c1506e4332ba591aa97e8fc5"}
Jul 07 19:31:58.677714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:58.677677    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" event={"ID":"de45b5ce-a9e2-4bd5-b381-4d0a965975af","Type":"ContainerStarted","Data":"2a6924e33253ca62f283f34fcfb635c8fa4931fd0a097932006e4092db210b7e"}
Jul 07 19:31:58.677994 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:58.677764    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:31:58.700804 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:31:58.700753    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" podStartSLOduration=2.158943894 podStartE2EDuration="2.700737277s" totalImagesPullingTime="541.793383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:31:58.698087767 +0000 UTC m=+1843.838461948" watchObservedRunningTime="2026-07-07 19:31:58.700737277 +0000 UTC m=+1843.841111457"
Jul 07 19:32:01.779220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.779179    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"]
Jul 07 19:32:01.783257 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.783232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.785726 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.785704    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a4aa66-openshift-default-dockercfg-n5jp5\""
Jul 07 19:32:01.800676 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.800644    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"]
Jul 07 19:32:01.906629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istiod-ca-cert\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.906823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-token\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.906823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-envoy\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.906823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-certs\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.906823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-credential-socket\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.906823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-podinfo\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.906823 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk4gk\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-kube-api-access-qk4gk\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.907145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906867    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-data\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:01.907145 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:01.906885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-socket\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.007917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.007878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-token\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008126 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.007924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-envoy\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008126 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.007960    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-certs\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008126 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-credential-socket\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008126 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-podinfo\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk4gk\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-kube-api-access-qk4gk\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-data\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-socket\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008329    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-certs\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008338    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istiod-ca-cert\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008650 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008572    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-credential-socket\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008714 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008687    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-data\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008832 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008806    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-socket\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.008995 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.008974    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istiod-ca-cert\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.010389 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.010364    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-envoy\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.010656 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.010639    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-podinfo\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.016147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.016124    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-token\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.016253 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.016192    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk4gk\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-kube-api-access-qk4gk\") pod \"e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") " pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.094018 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.093986    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:02.248295 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.248264    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"]
Jul 07 19:32:02.249920 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:32:02.249890    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9f1de3_5b4e_48bc_992e_5eaccb116603.slice/crio-f6f4d8679e0ecdb9e59c8009e1a06fe3f191cee4d94ebb4bb188a4bd2483f6ad WatchSource:0}: Error finding container f6f4d8679e0ecdb9e59c8009e1a06fe3f191cee4d94ebb4bb188a4bd2483f6ad: Status 404 returned error can't find the container with id f6f4d8679e0ecdb9e59c8009e1a06fe3f191cee4d94ebb4bb188a4bd2483f6ad
Jul 07 19:32:02.252101 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.252069    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:02.252179 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.252138    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:02.252179 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.252167    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:02.701692 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.701660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" event={"ID":"4b9f1de3-5b4e-48bc-992e-5eaccb116603","Type":"ContainerStarted","Data":"ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"}
Jul 07 19:32:02.701881 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.701707    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" event={"ID":"4b9f1de3-5b4e-48bc-992e-5eaccb116603","Type":"ContainerStarted","Data":"f6f4d8679e0ecdb9e59c8009e1a06fe3f191cee4d94ebb4bb188a4bd2483f6ad"}
Jul 07 19:32:02.741896 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:02.741834    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podStartSLOduration=1.741819738 podStartE2EDuration="1.741819738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:32:02.740030041 +0000 UTC m=+1847.880404221" watchObservedRunningTime="2026-07-07 19:32:02.741819738 +0000 UTC m=+1847.882193918"
Jul 07 19:32:03.094356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:03.094321    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:03.099447 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:03.099425    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:03.710753 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:03.710643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:03.715890 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:03.715863    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:04.696657 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:04.696615    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:32:11.699721 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:11.699674    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:32:11.700118 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:11.699745    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:32:12.766903 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:12.766870    2569 generic.go:356] "Generic (PLEG): container finished" podID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerID="0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9" exitCode=0
Jul 07 19:32:12.767493 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:12.766947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" event={"ID":"2f82dfc1-7288-455d-ba9b-376352a807e3","Type":"ContainerDied","Data":"0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"}
Jul 07 19:32:12.767493 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:12.767367    2569 scope.go:117] "RemoveContainer" containerID="0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"
Jul 07 19:32:12.768474 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:12.768447    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:12.768573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:12.768544    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:12.768619 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:12.768584    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:13.779171 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:13.779133    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" event={"ID":"2f82dfc1-7288-455d-ba9b-376352a807e3","Type":"ContainerStarted","Data":"e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2"}
Jul 07 19:32:14.576807 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:14.576762    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:32:14.577046 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:14.576909    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 07 19:32:14.577046 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:14.576953    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 07 19:32:15.576179 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:15.576137    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 07 19:32:15.576822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:15.576787    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 07 19:32:16.576648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:16.576170    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 07 19:32:16.576648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:16.576233    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 07 19:32:17.576845 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:17.576808    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 07 19:32:17.577210 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:17.576893    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 07 19:32:18.580553 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:18.580501    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:32:18.581072 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:18.580785    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:32:18.581725 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:18.581704    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:32:19.752670 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:19.752631    2569 patch_prober.go:28] interesting pod/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:32:19.753127 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:19.752712    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:32:20.831008 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:20.830967    2569 generic.go:356] "Generic (PLEG): container finished" podID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerID="ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3" exitCode=0
Jul 07 19:32:20.831521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:20.831027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" event={"ID":"4b9f1de3-5b4e-48bc-992e-5eaccb116603","Type":"ContainerDied","Data":"ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"}
Jul 07 19:32:20.831521 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:20.831386    2569 scope.go:117] "RemoveContainer" containerID="ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"
Jul 07 19:32:20.832380 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:20.832348    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:20.832498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:20.832430    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:20.832498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:20.832475    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:32:21.844595 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:21.844551    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" event={"ID":"4b9f1de3-5b4e-48bc-992e-5eaccb116603","Type":"ContainerStarted","Data":"3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837"}
Jul 07 19:32:22.094217 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:22.094180    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:22.094475 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:22.094452    2569 patch_prober.go:28] interesting pod/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 07 19:32:22.094629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:22.094536    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 07 19:32:23.094878 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:23.094839    2569 patch_prober.go:28] interesting pod/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 07 19:32:23.095265 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:23.094899    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 07 19:32:24.094399 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:24.094358    2569 patch_prober.go:28] interesting pod/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 07 19:32:24.094614 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:24.094424    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 07 19:32:25.094534 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:25.094478    2569 patch_prober.go:28] interesting pod/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 07 19:32:25.094937 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:25.094561    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 07 19:32:26.099135 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:26.099107    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:26.099610 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:26.099555    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:32:26.100331 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:32:26.100313    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:33:04.875451 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:04.875418    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"]
Jul 07 19:33:04.876000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:04.875667    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" podUID="de45b5ce-a9e2-4bd5-b381-4d0a965975af" containerName="maas-api" containerID="cri-o://32b2a248a0c796b59ff33b1f7507a571f6421cf7c1506e4332ba591aa97e8fc5" gracePeriod=30
Jul 07 19:33:05.105447 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.105412    2569 generic.go:356] "Generic (PLEG): container finished" podID="de45b5ce-a9e2-4bd5-b381-4d0a965975af" containerID="32b2a248a0c796b59ff33b1f7507a571f6421cf7c1506e4332ba591aa97e8fc5" exitCode=0
Jul 07 19:33:05.105646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.105485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" event={"ID":"de45b5ce-a9e2-4bd5-b381-4d0a965975af","Type":"ContainerDied","Data":"32b2a248a0c796b59ff33b1f7507a571f6421cf7c1506e4332ba591aa97e8fc5"}
Jul 07 19:33:05.142156 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.142079    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:33:05.328121 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.328091    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de45b5ce-a9e2-4bd5-b381-4d0a965975af-openshift-service-ca\") pod \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") "
Jul 07 19:33:05.328298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.328150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls\") pod \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") "
Jul 07 19:33:05.328298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.328215    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx5sp\" (UniqueName: \"kubernetes.io/projected/de45b5ce-a9e2-4bd5-b381-4d0a965975af-kube-api-access-nx5sp\") pod \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\" (UID: \"de45b5ce-a9e2-4bd5-b381-4d0a965975af\") "
Jul 07 19:33:05.328423 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.328398    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de45b5ce-a9e2-4bd5-b381-4d0a965975af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de45b5ce-a9e2-4bd5-b381-4d0a965975af" (UID: "de45b5ce-a9e2-4bd5-b381-4d0a965975af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:33:05.330229 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.330198    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de45b5ce-a9e2-4bd5-b381-4d0a965975af" (UID: "de45b5ce-a9e2-4bd5-b381-4d0a965975af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:33:05.330340 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.330305    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de45b5ce-a9e2-4bd5-b381-4d0a965975af-kube-api-access-nx5sp" (OuterVolumeSpecName: "kube-api-access-nx5sp") pod "de45b5ce-a9e2-4bd5-b381-4d0a965975af" (UID: "de45b5ce-a9e2-4bd5-b381-4d0a965975af"). InnerVolumeSpecName "kube-api-access-nx5sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:33:05.429170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.429081    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de45b5ce-a9e2-4bd5-b381-4d0a965975af-maas-api-tls\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:05.429170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.429114    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx5sp\" (UniqueName: \"kubernetes.io/projected/de45b5ce-a9e2-4bd5-b381-4d0a965975af-kube-api-access-nx5sp\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:05.429170 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:05.429125    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de45b5ce-a9e2-4bd5-b381-4d0a965975af-openshift-service-ca\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:06.112367 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:06.112328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8" event={"ID":"de45b5ce-a9e2-4bd5-b381-4d0a965975af","Type":"ContainerDied","Data":"2a6924e33253ca62f283f34fcfb635c8fa4931fd0a097932006e4092db210b7e"}
Jul 07 19:33:06.112367 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:06.112358    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"
Jul 07 19:33:06.112913 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:06.112402    2569 scope.go:117] "RemoveContainer" containerID="32b2a248a0c796b59ff33b1f7507a571f6421cf7c1506e4332ba591aa97e8fc5"
Jul 07 19:33:06.136897 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:06.136865    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"]
Jul 07 19:33:06.144032 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:06.144009    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a43967-798f6f857d-4ksk8"]
Jul 07 19:33:07.492158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:07.492126    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de45b5ce-a9e2-4bd5-b381-4d0a965975af" path="/var/lib/kubelet/pods/de45b5ce-a9e2-4bd5-b381-4d0a965975af/volumes"
Jul 07 19:33:47.389306 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:47.389270    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"]
Jul 07 19:33:47.390444 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:47.389482    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" containerID="cri-o://e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2" gracePeriod=30
Jul 07 19:33:48.584709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:48.584664    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:33:48.585329 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:48.585281    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:33:52.664540 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.664456    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:33:52.755319 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755282    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-socket\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755355    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f82dfc1-7288-455d-ba9b-376352a807e3-istiod-ca-cert\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755383    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-data\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755439    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-credential-socket\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755470    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-token\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-certs\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755564    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-podinfo\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.755630 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755602    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbhc8\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-kube-api-access-xbhc8\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755633    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-envoy\") pod \"2f82dfc1-7288-455d-ba9b-376352a807e3\" (UID: \"2f82dfc1-7288-455d-ba9b-376352a807e3\") "
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755656    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755800    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755921    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755950    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f82dfc1-7288-455d-ba9b-376352a807e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.755983    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.756041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.756002    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.756670 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.756643    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:33:52.757870 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.757844    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:33:52.757993 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.757957    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-kube-api-access-xbhc8" (OuterVolumeSpecName: "kube-api-access-xbhc8") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "kube-api-access-xbhc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:33:52.758198 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.758181    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:33:52.758326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.758298    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f82dfc1-7288-455d-ba9b-376352a807e3" (UID: "2f82dfc1-7288-455d-ba9b-376352a807e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:33:52.857077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857041    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f82dfc1-7288-455d-ba9b-376352a807e3-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.857077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857071    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.857077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857079    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.857077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857088    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.857353 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857096    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.857353 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857104    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbhc8\" (UniqueName: \"kubernetes.io/projected/2f82dfc1-7288-455d-ba9b-376352a807e3-kube-api-access-xbhc8\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:52.857353 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:52.857115    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f82dfc1-7288-455d-ba9b-376352a807e3-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:33:53.384926 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.384885    2569 generic.go:356] "Generic (PLEG): container finished" podID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerID="e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2" exitCode=0
Jul 07 19:33:53.385143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.384949    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"
Jul 07 19:33:53.385143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.384962    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" event={"ID":"2f82dfc1-7288-455d-ba9b-376352a807e3","Type":"ContainerDied","Data":"e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2"}
Jul 07 19:33:53.385143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.385016    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx" event={"ID":"2f82dfc1-7288-455d-ba9b-376352a807e3","Type":"ContainerDied","Data":"d6eb72d05dac847aec3e8413d9f2e6e8a3642f3feed8a7362165c7c04a34b3c2"}
Jul 07 19:33:53.385143 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.385038    2569 scope.go:117] "RemoveContainer" containerID="e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2"
Jul 07 19:33:53.395317 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.395298    2569 scope.go:117] "RemoveContainer" containerID="0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"
Jul 07 19:33:53.404005 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.403987    2569 scope.go:117] "RemoveContainer" containerID="e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2"
Jul 07 19:33:53.404295 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:33:53.404276    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2\": container with ID starting with e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2 not found: ID does not exist" containerID="e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2"
Jul 07 19:33:53.404339 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.404305    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2"} err="failed to get container status \"e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2\": rpc error: code = NotFound desc = could not find container \"e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2\": container with ID starting with e57a75765545b869cd7907430a464e5cc2170c524057db72c22a31bd07442de2 not found: ID does not exist"
Jul 07 19:33:53.404339 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.404324    2569 scope.go:117] "RemoveContainer" containerID="0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"
Jul 07 19:33:53.404577 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:33:53.404559    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9\": container with ID starting with 0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9 not found: ID does not exist" containerID="0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"
Jul 07 19:33:53.404634 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.404583    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9"} err="failed to get container status \"0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9\": rpc error: code = NotFound desc = could not find container \"0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9\": container with ID starting with 0ffcdd603aa440e5f336de83946aebdfc1b60ad7900c208b74b4e5ce16af18b9 not found: ID does not exist"
Jul 07 19:33:53.408460 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.408433    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"]
Jul 07 19:33:53.412557 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.412535    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a43967-openshift-default-d75f877b5-qpmcx"]
Jul 07 19:33:53.497999 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:53.497962    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" path="/var/lib/kubelet/pods/2f82dfc1-7288-455d-ba9b-376352a807e3/volumes"
Jul 07 19:33:54.732283 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:54.732250    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"]
Jul 07 19:33:54.732782 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:54.732539    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" containerID="cri-o://3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837" gracePeriod=30
Jul 07 19:33:55.621968 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.621933    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"]
Jul 07 19:33:55.622386 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622374    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy"
Jul 07 19:33:55.622433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622388    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy"
Jul 07 19:33:55.622433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622398    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy"
Jul 07 19:33:55.622433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622404    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy"
Jul 07 19:33:55.622433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622413    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de45b5ce-a9e2-4bd5-b381-4d0a965975af" containerName="maas-api"
Jul 07 19:33:55.622433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622419    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="de45b5ce-a9e2-4bd5-b381-4d0a965975af" containerName="maas-api"
Jul 07 19:33:55.622620 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622476    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy"
Jul 07 19:33:55.622620 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.622486    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="de45b5ce-a9e2-4bd5-b381-4d0a965975af" containerName="maas-api"
Jul 07 19:33:55.627192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.627173    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.629590 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.629569    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-58a302-openshift-default-dockercfg-fjjwm\""
Jul 07 19:33:55.643054 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.643023    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"]
Jul 07 19:33:55.682429 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-envoy\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-socket\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istiod-ca-cert\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682493    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-podinfo\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-credential-socket\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682810 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchf7\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-kube-api-access-dchf7\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682810 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682661    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-certs\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682810 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-data\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.682810 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.682713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-token\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.783956 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.783912    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-data\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.783956 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.783955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-token\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.783998    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-envoy\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784060    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-socket\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istiod-ca-cert\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-podinfo\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-credential-socket\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchf7\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-kube-api-access-dchf7\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-certs\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784369    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-data\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.784478 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784384    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-socket\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.785000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784653    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-credential-socket\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.785000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784704    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-certs\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.785000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.784908    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istiod-ca-cert\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.786485 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.786464    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-envoy\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.786652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.786637    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-podinfo\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.792711 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.792685    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-token\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.793002 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.792978    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchf7\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-kube-api-access-dchf7\") pod \"e2e-api-a-58a302-openshift-default-6688dcb869-26r8f\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") " pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:55.937542 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:55.937421    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:56.089343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.089303    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"]
Jul 07 19:33:56.090929 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:33:56.090904    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e59af51_11c6_42e4_9e2b_d7d399b17ce4.slice/crio-923c34ecffcec4a7e9a225bb367491e62d7a691f1b67b681c9a0518a9ad7b399 WatchSource:0}: Error finding container 923c34ecffcec4a7e9a225bb367491e62d7a691f1b67b681c9a0518a9ad7b399: Status 404 returned error can't find the container with id 923c34ecffcec4a7e9a225bb367491e62d7a691f1b67b681c9a0518a9ad7b399
Jul 07 19:33:56.093397 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.093358    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:33:56.093531 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.093457    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:33:56.093597 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.093533    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:33:56.101657 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.101624    2569 patch_prober.go:28] interesting pod/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:33:56.101758 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.101686    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:33:56.406120 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.406084    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" event={"ID":"8e59af51-11c6-42e4-9e2b-d7d399b17ce4","Type":"ContainerStarted","Data":"578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"}
Jul 07 19:33:56.406276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.406136    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" event={"ID":"8e59af51-11c6-42e4-9e2b-d7d399b17ce4","Type":"ContainerStarted","Data":"923c34ecffcec4a7e9a225bb367491e62d7a691f1b67b681c9a0518a9ad7b399"}
Jul 07 19:33:56.434049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.433984    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podStartSLOduration=1.433963721 podStartE2EDuration="1.433963721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:33:56.430602176 +0000 UTC m=+1961.570976356" watchObservedRunningTime="2026-07-07 19:33:56.433963721 +0000 UTC m=+1961.574337905"
Jul 07 19:33:56.937917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:56.937879    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:57.943968 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:57.943938    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:58.417598 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:58.417566    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:33:58.418498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:33:58.418478    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:00.003065 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.002985    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:34:00.022295 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022264    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istiod-ca-cert\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022320    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-envoy\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022337    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-socket\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022355    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk4gk\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-kube-api-access-qk4gk\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022377    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-token\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022396    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-podinfo\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022425    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-data\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022483 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022462    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-credential-socket\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022879 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022500    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-certs\") pod \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\" (UID: \"4b9f1de3-5b4e-48bc-992e-5eaccb116603\") "
Jul 07 19:34:00.022879 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022750    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:34:00.022879 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022754    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:00.023044 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022883    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.023044 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022904    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.023044 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.022945    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:00.023044 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.023019    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:00.023347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.023326    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:00.025403 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.025372    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:34:00.025725 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.025695    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-kube-api-access-qk4gk" (OuterVolumeSpecName: "kube-api-access-qk4gk") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "kube-api-access-qk4gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:34:00.026189 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.026164    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:00.026278 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.026226    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b9f1de3-5b4e-48bc-992e-5eaccb116603" (UID: "4b9f1de3-5b4e-48bc-992e-5eaccb116603"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:34:00.123891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123853    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.123891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123885    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk4gk\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-kube-api-access-qk4gk\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.123891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123894    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.124131 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123903    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.124131 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123912    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.124131 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123921    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.124131 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.123929    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9f1de3-5b4e-48bc-992e-5eaccb116603-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:00.429501 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.429466    2569 generic.go:356] "Generic (PLEG): container finished" podID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerID="3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837" exitCode=0
Jul 07 19:34:00.429713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.429543    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"
Jul 07 19:34:00.429713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.429555    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" event={"ID":"4b9f1de3-5b4e-48bc-992e-5eaccb116603","Type":"ContainerDied","Data":"3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837"}
Jul 07 19:34:00.429713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.429611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb" event={"ID":"4b9f1de3-5b4e-48bc-992e-5eaccb116603","Type":"ContainerDied","Data":"f6f4d8679e0ecdb9e59c8009e1a06fe3f191cee4d94ebb4bb188a4bd2483f6ad"}
Jul 07 19:34:00.429713 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.429637    2569 scope.go:117] "RemoveContainer" containerID="3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837"
Jul 07 19:34:00.440066 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.440041    2569 scope.go:117] "RemoveContainer" containerID="ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"
Jul 07 19:34:00.449302 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.449282    2569 scope.go:117] "RemoveContainer" containerID="3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837"
Jul 07 19:34:00.449621 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:34:00.449599    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837\": container with ID starting with 3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837 not found: ID does not exist" containerID="3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837"
Jul 07 19:34:00.449734 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.449628    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837"} err="failed to get container status \"3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837\": rpc error: code = NotFound desc = could not find container \"3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837\": container with ID starting with 3fa1572a5a585a1141849d30607d409609ee68a8a729f70475ff0bf912322837 not found: ID does not exist"
Jul 07 19:34:00.449734 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.449646    2569 scope.go:117] "RemoveContainer" containerID="ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"
Jul 07 19:34:00.449927 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:34:00.449905    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3\": container with ID starting with ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3 not found: ID does not exist" containerID="ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"
Jul 07 19:34:00.449995 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.449936    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3"} err="failed to get container status \"ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3\": rpc error: code = NotFound desc = could not find container \"ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3\": container with ID starting with ce21cece0730905a6c43a2aa981dcec831738979965b1d903a760c9f46582ae3 not found: ID does not exist"
Jul 07 19:34:00.458664 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.458609    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"]
Jul 07 19:34:00.463204 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:00.463171    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a4aa66-openshift-default-6fbb4d5d65-tcgmb"]
Jul 07 19:34:01.491352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:01.491319    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" path="/var/lib/kubelet/pods/4b9f1de3-5b4e-48bc-992e-5eaccb116603/volumes"
Jul 07 19:34:03.585230 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.585190    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"]
Jul 07 19:34:03.585623 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.585609    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy"
Jul 07 19:34:03.585666 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.585625    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy"
Jul 07 19:34:03.585706 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.585697    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy"
Jul 07 19:34:03.585766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.585708    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f82dfc1-7288-455d-ba9b-376352a807e3" containerName="istio-proxy"
Jul 07 19:34:03.590250 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.590230    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.592718 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.592693    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0ffa2c-openshift-default-dockercfg-d2zw4\""
Jul 07 19:34:03.600784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.600756    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"]
Jul 07 19:34:03.656140 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-data\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-credential-socket\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77vl\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-kube-api-access-n77vl\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656205    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b52a28e-e6fb-4277-a268-350928fdc00c-istiod-ca-cert\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656239    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-podinfo\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-certs\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656348 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-token\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-socket\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.656652 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.656421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-envoy\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.757998 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.757956    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-socket\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.758341 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.758317    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-envoy\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.758491 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.758474    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-data\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.758661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.758645    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-credential-socket\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.758787 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.758773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n77vl\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-kube-api-access-n77vl\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.758903 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.758890    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b52a28e-e6fb-4277-a268-350928fdc00c-istiod-ca-cert\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.759009 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.758997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-podinfo\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.759146 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.759130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-certs\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.759254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.759240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-token\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.759403 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.759288    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-credential-socket\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.759613 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.759585    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-certs\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.760030 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.760009    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b52a28e-e6fb-4277-a268-350928fdc00c-istiod-ca-cert\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.760137 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.760086    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-socket\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.760481 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.760452    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-data\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.761662 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.761636    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-envoy\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.761772 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.761672    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-podinfo\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.768768 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.768748    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-token\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.769208 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.769185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77vl\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-kube-api-access-n77vl\") pod \"e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") " pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:03.901606 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:03.901572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:04.059746 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.059718    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"]
Jul 07 19:34:04.061784 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:34:04.061758    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b52a28e_e6fb_4277_a268_350928fdc00c.slice/crio-7d6dd379f7abf86f82a9c2e7a9921b70c2c8438759752d68f449a4bb91cc7390 WatchSource:0}: Error finding container 7d6dd379f7abf86f82a9c2e7a9921b70c2c8438759752d68f449a4bb91cc7390: Status 404 returned error can't find the container with id 7d6dd379f7abf86f82a9c2e7a9921b70c2c8438759752d68f449a4bb91cc7390
Jul 07 19:34:04.063945 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.063910    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:04.064034 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.063977    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:04.064034 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.064006    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:04.458375 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.458334    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" event={"ID":"3b52a28e-e6fb-4277-a268-350928fdc00c","Type":"ContainerStarted","Data":"c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"}
Jul 07 19:34:04.458585 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.458393    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" event={"ID":"3b52a28e-e6fb-4277-a268-350928fdc00c","Type":"ContainerStarted","Data":"7d6dd379f7abf86f82a9c2e7a9921b70c2c8438759752d68f449a4bb91cc7390"}
Jul 07 19:34:04.480410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.480356    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podStartSLOduration=1.48033748 podStartE2EDuration="1.48033748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:04.477971354 +0000 UTC m=+1969.618345544" watchObservedRunningTime="2026-07-07 19:34:04.48033748 +0000 UTC m=+1969.620711998"
Jul 07 19:34:04.902356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:04.902318    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:05.907618 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:05.907588    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:06.471197 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:06.471158    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:06.472294 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:06.472273    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:13.525578 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:13.524077    2569 patch_prober.go:28] interesting pod/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": read tcp 10.133.0.2:33012->10.133.0.78:15021: read: connection reset by peer" start-of-body=
Jul 07 19:34:13.525578 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:13.524141    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": read tcp 10.133.0.2:33012->10.133.0.78:15021: read: connection reset by peer"
Jul 07 19:34:14.526055 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:14.526021    2569 generic.go:356] "Generic (PLEG): container finished" podID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerID="578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d" exitCode=0
Jul 07 19:34:14.526569 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:14.526097    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" event={"ID":"8e59af51-11c6-42e4-9e2b-d7d399b17ce4","Type":"ContainerDied","Data":"578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"}
Jul 07 19:34:14.526704 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:14.526686    2569 scope.go:117] "RemoveContainer" containerID="578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"
Jul 07 19:34:14.527748 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:14.527717    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:14.527854 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:14.527802    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:14.527918 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:14.527853    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:15.538891 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:15.538842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" event={"ID":"8e59af51-11c6-42e4-9e2b-d7d399b17ce4","Type":"ContainerStarted","Data":"edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6"}
Jul 07 19:34:15.938587 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:15.938545    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:15.938814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:15.938691    2569 patch_prober.go:28] interesting pod/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 07 19:34:15.938814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:15.938739    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 07 19:34:16.938379 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:16.938333    2569 patch_prober.go:28] interesting pod/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 07 19:34:16.939211 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:16.939115    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 07 19:34:17.938469 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:17.938421    2569 patch_prober.go:28] interesting pod/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 07 19:34:17.939242 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:17.939188    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 07 19:34:18.938471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:18.937907    2569 patch_prober.go:28] interesting pod/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 07 19:34:18.938471 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:18.937976    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 07 19:34:19.943298 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:19.943263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:19.943763 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:19.943621    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:19.944502 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:19.944483    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:21.661438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:21.661086    2569 patch_prober.go:28] interesting pod/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": read tcp 10.133.0.2:38460->10.133.0.79:15021: read: connection reset by peer" start-of-body=
Jul 07 19:34:21.661438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:21.661166    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": read tcp 10.133.0.2:38460->10.133.0.79:15021: read: connection reset by peer"
Jul 07 19:34:22.594388 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:22.594357    2569 generic.go:356] "Generic (PLEG): container finished" podID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerID="c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa" exitCode=0
Jul 07 19:34:22.594609 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:22.594420    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" event={"ID":"3b52a28e-e6fb-4277-a268-350928fdc00c","Type":"ContainerDied","Data":"c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"}
Jul 07 19:34:22.594859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:22.594844    2569 scope.go:117] "RemoveContainer" containerID="c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"
Jul 07 19:34:22.595855 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:22.595825    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:22.595912 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:22.595898    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:22.595954 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:22.595930    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:23.602052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:23.602020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" event={"ID":"3b52a28e-e6fb-4277-a268-350928fdc00c","Type":"ContainerStarted","Data":"87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc"}
Jul 07 19:34:23.902325 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:23.902228    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:23.902529 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:23.902481    2569 patch_prober.go:28] interesting pod/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 07 19:34:23.902585 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:23.902556    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 07 19:34:24.902017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:24.901976    2569 patch_prober.go:28] interesting pod/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 07 19:34:24.902434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:24.902035    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 07 19:34:25.902272 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:25.902237    2569 patch_prober.go:28] interesting pod/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 07 19:34:25.902679 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:25.902292    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 07 19:34:26.153707 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:26.153565    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"]
Jul 07 19:34:26.161544 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:26.154213    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy" containerID="cri-o://edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6" gracePeriod=30
Jul 07 19:34:26.902575 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:26.902538    2569 patch_prober.go:28] interesting pod/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Jul 07 19:34:26.902980 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:26.902595    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Jul 07 19:34:27.950893 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:27.950839    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:27.951385 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:27.951173    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:27.953303 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:27.953276    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:31.332283 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.332257    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:31.431356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431263    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istiod-ca-cert\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431310    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-credential-socket\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431334    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-data\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431371    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-podinfo\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-certs\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431541    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-envoy\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431567    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dchf7\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-kube-api-access-dchf7\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431625    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-socket\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431632    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:31.431691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431674    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-token\") pod \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\" (UID: \"8e59af51-11c6-42e4-9e2b-d7d399b17ce4\") "
Jul 07 19:34:31.432058 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431813    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:31.432058 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.431861    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:34:31.432058 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.432017    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:31.432233 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.432111    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.432233 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.432131    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.432233 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.432146    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.432233 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.432159    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.432446 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.432344    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:31.433966 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.433938    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:34:31.434099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.434038    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:31.434157 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.434108    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-kube-api-access-dchf7" (OuterVolumeSpecName: "kube-api-access-dchf7") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "kube-api-access-dchf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:34:31.434254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.434236    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e59af51-11c6-42e4-9e2b-d7d399b17ce4" (UID: "8e59af51-11c6-42e4-9e2b-d7d399b17ce4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:34:31.532814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.532778    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.532814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.532803    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.532814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.532812    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dchf7\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-kube-api-access-dchf7\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.532814 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.532822    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.533164 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.532830    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e59af51-11c6-42e4-9e2b-d7d399b17ce4-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:31.650826 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.650794    2569 generic.go:356] "Generic (PLEG): container finished" podID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerID="edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6" exitCode=0
Jul 07 19:34:31.651000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.650846    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"
Jul 07 19:34:31.651000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.650886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" event={"ID":"8e59af51-11c6-42e4-9e2b-d7d399b17ce4","Type":"ContainerDied","Data":"edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6"}
Jul 07 19:34:31.651000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.650933    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f" event={"ID":"8e59af51-11c6-42e4-9e2b-d7d399b17ce4","Type":"ContainerDied","Data":"923c34ecffcec4a7e9a225bb367491e62d7a691f1b67b681c9a0518a9ad7b399"}
Jul 07 19:34:31.651000 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.650956    2569 scope.go:117] "RemoveContainer" containerID="edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6"
Jul 07 19:34:31.660336 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.660313    2569 scope.go:117] "RemoveContainer" containerID="578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"
Jul 07 19:34:31.669304 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.669283    2569 scope.go:117] "RemoveContainer" containerID="edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6"
Jul 07 19:34:31.669796 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:34:31.669775    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6\": container with ID starting with edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6 not found: ID does not exist" containerID="edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6"
Jul 07 19:34:31.669874 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.669804    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6"} err="failed to get container status \"edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6\": rpc error: code = NotFound desc = could not find container \"edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6\": container with ID starting with edb932e7f728039191c27eaff9831fa73675ab353bc2022ae0c9f1289604ffb6 not found: ID does not exist"
Jul 07 19:34:31.669874 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.669823    2569 scope.go:117] "RemoveContainer" containerID="578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"
Jul 07 19:34:31.670094 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:34:31.670078    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d\": container with ID starting with 578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d not found: ID does not exist" containerID="578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"
Jul 07 19:34:31.670136 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.670098    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d"} err="failed to get container status \"578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d\": rpc error: code = NotFound desc = could not find container \"578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d\": container with ID starting with 578d28ceee0ba3eaf27779068e3d6e37363b4be8887963169deade9a827be87d not found: ID does not exist"
Jul 07 19:34:31.671212 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.671189    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"]
Jul 07 19:34:31.676613 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:31.676590    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-58a302-openshift-default-6688dcb869-26r8f"]
Jul 07 19:34:33.156438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:33.154608    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"]
Jul 07 19:34:33.156438 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:33.154940    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy" containerID="cri-o://87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc" gracePeriod=30
Jul 07 19:34:33.492200 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:33.492104    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" path="/var/lib/kubelet/pods/8e59af51-11c6-42e4-9e2b-d7d399b17ce4/volumes"
Jul 07 19:34:33.999681 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:33.999642    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"]
Jul 07 19:34:34.000064 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000052    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy"
Jul 07 19:34:34.000111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000066    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy"
Jul 07 19:34:34.000111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000086    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy"
Jul 07 19:34:34.000111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000093    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy"
Jul 07 19:34:34.000111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000103    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy"
Jul 07 19:34:34.000111 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000109    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy"
Jul 07 19:34:34.000269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000174    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy"
Jul 07 19:34:34.000269 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.000184    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9f1de3-5b4e-48bc-992e-5eaccb116603" containerName="istio-proxy"
Jul 07 19:34:34.004836 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.004818    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.007375 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.007351    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c576d2-openshift-default-dockercfg-d6kmc\""
Jul 07 19:34:34.020225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.020199    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"]
Jul 07 19:34:34.058890 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.058851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-socket\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.058890 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.058890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-envoy\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.058906    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39f99b9-ac23-4758-94c2-9a4cde53facf-istiod-ca-cert\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.058929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-credential-socket\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.058993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k84jb\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-kube-api-access-k84jb\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.059056    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-data\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059152 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.059107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-token\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.059155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-certs\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.059363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.059185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-podinfo\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.159817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159780    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-data\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-token\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-certs\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159884    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-podinfo\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-socket\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159946    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-envoy\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.159972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39f99b9-ac23-4758-94c2-9a4cde53facf-istiod-ca-cert\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-credential-socket\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160055    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k84jb\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-kube-api-access-k84jb\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160327 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160243    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-data\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160359    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-certs\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160439    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-socket\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160566    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-credential-socket\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.160761 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.160751    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39f99b9-ac23-4758-94c2-9a4cde53facf-istiod-ca-cert\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.162413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.162391    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-envoy\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.162536 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.162523    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-podinfo\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.168177 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.168144    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-token\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.168289 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.168204    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k84jb\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-kube-api-access-k84jb\") pod \"e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") " pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.316656 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.316559    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:34.495852 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.495823    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"]
Jul 07 19:34:34.498139 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:34:34.498108    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39f99b9_ac23_4758_94c2_9a4cde53facf.slice/crio-0c200baf613c15895f082d1902cce77bd9825a598fc244634c48b7bb669e62cd WatchSource:0}: Error finding container 0c200baf613c15895f082d1902cce77bd9825a598fc244634c48b7bb669e62cd: Status 404 returned error can't find the container with id 0c200baf613c15895f082d1902cce77bd9825a598fc244634c48b7bb669e62cd
Jul 07 19:34:34.500705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.500637    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:34.500863 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.500763    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:34.500863 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.500806    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:34.671070 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.671031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" event={"ID":"f39f99b9-ac23-4758-94c2-9a4cde53facf","Type":"ContainerStarted","Data":"6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"}
Jul 07 19:34:34.671257 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.671098    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" event={"ID":"f39f99b9-ac23-4758-94c2-9a4cde53facf","Type":"ContainerStarted","Data":"0c200baf613c15895f082d1902cce77bd9825a598fc244634c48b7bb669e62cd"}
Jul 07 19:34:34.693197 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:34.693148    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podStartSLOduration=1.693130853 podStartE2EDuration="1.693130853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:34.691163948 +0000 UTC m=+1999.831538128" watchObservedRunningTime="2026-07-07 19:34:34.693130853 +0000 UTC m=+1999.833505032"
Jul 07 19:34:35.317147 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:35.317107    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:35.321888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:35.321859    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:35.677150 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:35.677115    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:35.678254 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:35.678228    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:38.435850 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.435823    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:38.503069 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503042    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-token\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503069 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503073    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-certs\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503108    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-data\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503132    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-socket\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503197    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b52a28e-e6fb-4277-a268-350928fdc00c-istiod-ca-cert\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503231    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-credential-socket\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503259    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-podinfo\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503324 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503303    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-envoy\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503345    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n77vl\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-kube-api-access-n77vl\") pod \"3b52a28e-e6fb-4277-a268-350928fdc00c\" (UID: \"3b52a28e-e6fb-4277-a268-350928fdc00c\") "
Jul 07 19:34:38.503740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503434    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:38.503740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503554    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:38.503740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503698    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.503740 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503716    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.503977 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.503752    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:38.504244 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.504200    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:38.504640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.504616    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b52a28e-e6fb-4277-a268-350928fdc00c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:34:38.505669 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.505648    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:34:38.505766 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.505661    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:34:38.505812 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.505792    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:34:38.506268 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.506254    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-kube-api-access-n77vl" (OuterVolumeSpecName: "kube-api-access-n77vl") pod "3b52a28e-e6fb-4277-a268-350928fdc00c" (UID: "3b52a28e-e6fb-4277-a268-350928fdc00c"). InnerVolumeSpecName "kube-api-access-n77vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:34:38.604866 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604832    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.604866 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604866    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.605061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604879    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b52a28e-e6fb-4277-a268-350928fdc00c-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.605061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604893    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.605061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604919    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.605061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604933    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b52a28e-e6fb-4277-a268-350928fdc00c-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.605061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.604946    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n77vl\" (UniqueName: \"kubernetes.io/projected/3b52a28e-e6fb-4277-a268-350928fdc00c-kube-api-access-n77vl\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:34:38.704132 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.704037    2569 generic.go:356] "Generic (PLEG): container finished" podID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerID="87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc" exitCode=0
Jul 07 19:34:38.704132 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.704092    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"
Jul 07 19:34:38.704363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.704124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" event={"ID":"3b52a28e-e6fb-4277-a268-350928fdc00c","Type":"ContainerDied","Data":"87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc"}
Jul 07 19:34:38.704363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.704213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t" event={"ID":"3b52a28e-e6fb-4277-a268-350928fdc00c","Type":"ContainerDied","Data":"7d6dd379f7abf86f82a9c2e7a9921b70c2c8438759752d68f449a4bb91cc7390"}
Jul 07 19:34:38.704363 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.704248    2569 scope.go:117] "RemoveContainer" containerID="87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc"
Jul 07 19:34:38.714498 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.714479    2569 scope.go:117] "RemoveContainer" containerID="c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"
Jul 07 19:34:38.723784 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.723764    2569 scope.go:117] "RemoveContainer" containerID="87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc"
Jul 07 19:34:38.724071 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:34:38.724052    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc\": container with ID starting with 87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc not found: ID does not exist" containerID="87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc"
Jul 07 19:34:38.724123 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.724079    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc"} err="failed to get container status \"87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc\": rpc error: code = NotFound desc = could not find container \"87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc\": container with ID starting with 87c56eef85545e0b83bafcecffb7c23787181246a4130780ba4e5e85165700dc not found: ID does not exist"
Jul 07 19:34:38.724123 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.724097    2569 scope.go:117] "RemoveContainer" containerID="c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"
Jul 07 19:34:38.724353 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:34:38.724335    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa\": container with ID starting with c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa not found: ID does not exist" containerID="c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"
Jul 07 19:34:38.724404 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.724359    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa"} err="failed to get container status \"c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa\": rpc error: code = NotFound desc = could not find container \"c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa\": container with ID starting with c2febbdc5e16f050600133a39366f1cf0b532bbe502d98801a252c3eabdcadfa not found: ID does not exist"
Jul 07 19:34:38.759077 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.759046    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"]
Jul 07 19:34:38.764449 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:38.764418    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0ffa2c-openshift-default-6d5f797677-s4s5t"]
Jul 07 19:34:39.492206 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:39.492176    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" path="/var/lib/kubelet/pods/3b52a28e-e6fb-4277-a268-350928fdc00c/volumes"
Jul 07 19:34:41.684371 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684334    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"]
Jul 07 19:34:41.684836 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684819    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy"
Jul 07 19:34:41.684915 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684839    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy"
Jul 07 19:34:41.684915 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684851    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy"
Jul 07 19:34:41.684915 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684857    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy"
Jul 07 19:34:41.685013 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684954    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e59af51-11c6-42e4-9e2b-d7d399b17ce4" containerName="istio-proxy"
Jul 07 19:34:41.685013 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684964    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy"
Jul 07 19:34:41.685013 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.684972    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b52a28e-e6fb-4277-a268-350928fdc00c" containerName="istio-proxy"
Jul 07 19:34:41.688109 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.688090    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.691573 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.691551    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2620f1-openshift-default-dockercfg-tg9ks\""
Jul 07 19:34:41.711430 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.711404    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"]
Jul 07 19:34:41.836331 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4qz\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-kube-api-access-fz4qz\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-data\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836427    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-socket\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-credential-socket\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-istio-token\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254a0635-ea17-4948-bf01-a461f4a1822b-istio-podinfo\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-certs\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-envoy\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.836736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.836706    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254a0635-ea17-4948-bf01-a461f4a1822b-istiod-ca-cert\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937272 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-istio-token\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937272 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254a0635-ea17-4948-bf01-a461f4a1822b-istio-podinfo\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937272 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937263    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-certs\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-envoy\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937615 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254a0635-ea17-4948-bf01-a461f4a1822b-istiod-ca-cert\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937732 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4qz\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-kube-api-access-fz4qz\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937732 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-data\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937842 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-socket\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937842 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937774    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-certs\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.937842 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.937783    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-credential-socket\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.938088 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.938068    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-credential-socket\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.938246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.938223    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-data\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.938314 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.938226    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254a0635-ea17-4948-bf01-a461f4a1822b-istiod-ca-cert\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.938314 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.938304    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-socket\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.939999 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.939970    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-envoy\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.940218 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.940202    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254a0635-ea17-4948-bf01-a461f4a1822b-istio-podinfo\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.946796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.946770    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-istio-token\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.946796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.946799    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4qz\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-kube-api-access-fz4qz\") pod \"e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") " pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:41.999347 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:41.999312    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:42.146413 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.146383    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"]
Jul 07 19:34:42.147582 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:34:42.147544    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254a0635_ea17_4948_bf01_a461f4a1822b.slice/crio-71fe45d074a464e536e6f9aeb6dda0b6dc72dae3ec3ced3a0c0249ccef7458f1 WatchSource:0}: Error finding container 71fe45d074a464e536e6f9aeb6dda0b6dc72dae3ec3ced3a0c0249ccef7458f1: Status 404 returned error can't find the container with id 71fe45d074a464e536e6f9aeb6dda0b6dc72dae3ec3ced3a0c0249ccef7458f1
Jul 07 19:34:42.149801 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.149762    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:42.149885 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.149852    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:42.149937 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.149918    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:42.729465 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.729429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" event={"ID":"254a0635-ea17-4948-bf01-a461f4a1822b","Type":"ContainerStarted","Data":"13172b142d23b04cb1743f2b98312e0057492be7ef8df8270b21893778ce9a4d"}
Jul 07 19:34:42.729881 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.729492    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" event={"ID":"254a0635-ea17-4948-bf01-a461f4a1822b","Type":"ContainerStarted","Data":"71fe45d074a464e536e6f9aeb6dda0b6dc72dae3ec3ced3a0c0249ccef7458f1"}
Jul 07 19:34:42.752304 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:42.752245    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podStartSLOduration=1.752222777 podStartE2EDuration="1.752222777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:34:42.751014432 +0000 UTC m=+2007.891388616" watchObservedRunningTime="2026-07-07 19:34:42.752222777 +0000 UTC m=+2007.892596960"
Jul 07 19:34:43.000345 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:43.000253    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:43.005256 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:43.005231    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:43.736770 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:43.736738    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:43.738041 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:43.738012    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:34:51.719712 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:51.719662    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:34:51.720107 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:51.719737    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:34:52.802066 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:52.802028    2569 generic.go:356] "Generic (PLEG): container finished" podID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerID="6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927" exitCode=0
Jul 07 19:34:52.802629 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:52.802102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" event={"ID":"f39f99b9-ac23-4758-94c2-9a4cde53facf","Type":"ContainerDied","Data":"6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"}
Jul 07 19:34:52.802709 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:52.802659    2569 scope.go:117] "RemoveContainer" containerID="6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"
Jul 07 19:34:52.803778 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:52.803745    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:52.803848 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:52.803822    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:52.803888 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:52.803876    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:34:53.809864 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:53.809601    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" event={"ID":"f39f99b9-ac23-4758-94c2-9a4cde53facf","Type":"ContainerStarted","Data":"8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128"}
Jul 07 19:34:54.317640 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:54.317611    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:54.317953 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:54.317769    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 07 19:34:54.318081 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:54.318062    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 07 19:34:55.318024 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:55.317978    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 07 19:34:55.318466 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:55.318046    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 07 19:34:56.317389 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:56.317349    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 07 19:34:56.317597 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:56.317416    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 07 19:34:57.317435 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:57.317400    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 07 19:34:57.317862 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:57.317476    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 07 19:34:58.321228 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:58.321198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:58.321703 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:58.321475    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:58.322112 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:58.322094    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:34:59.779662 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:59.779621    2569 patch_prober.go:28] interesting pod/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:34:59.780122 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:34:59.779685    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:35:00.863734 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:00.863696    2569 generic.go:356] "Generic (PLEG): container finished" podID="254a0635-ea17-4948-bf01-a461f4a1822b" containerID="13172b142d23b04cb1743f2b98312e0057492be7ef8df8270b21893778ce9a4d" exitCode=0
Jul 07 19:35:00.864261 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:00.863764    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" event={"ID":"254a0635-ea17-4948-bf01-a461f4a1822b","Type":"ContainerDied","Data":"13172b142d23b04cb1743f2b98312e0057492be7ef8df8270b21893778ce9a4d"}
Jul 07 19:35:00.864330 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:00.864291    2569 scope.go:117] "RemoveContainer" containerID="13172b142d23b04cb1743f2b98312e0057492be7ef8df8270b21893778ce9a4d"
Jul 07 19:35:00.865407 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:00.865372    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:35:00.865496 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:00.865447    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:35:00.865496 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:00.865485    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 07 19:35:01.871918 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:01.871882    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" event={"ID":"254a0635-ea17-4948-bf01-a461f4a1822b","Type":"ContainerStarted","Data":"3e8ee100f0b8ddb9c02108c0989b99892b081ad3bb5d72730025c0bee1377d9d"}
Jul 07 19:35:01.999627 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:01.999592    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:35:01.999817 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:01.999796    2569 patch_prober.go:28] interesting pod/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 07 19:35:01.999867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:01.999845    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 07 19:35:02.999869 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:02.999832    2569 patch_prober.go:28] interesting pod/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 07 19:35:03.000275 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:02.999887    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 07 19:35:03.999736 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:03.999696    2569 patch_prober.go:28] interesting pod/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 07 19:35:03.999938 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:03.999759    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 07 19:35:05.000648 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:05.000601    2569 patch_prober.go:28] interesting pod/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 07 19:35:05.001021 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:05.000679    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 07 19:35:06.003611 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:06.003581    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:35:06.003984 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:06.003879    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:35:06.004566 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:35:06.004548    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:40:37.541410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:37.541375    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"]
Jul 07 19:40:37.541953 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:37.541593    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy" containerID="cri-o://8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128" gracePeriod=30
Jul 07 19:40:42.795245 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.795213    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:40:42.829052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.828954    2569 generic.go:356] "Generic (PLEG): container finished" podID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerID="8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128" exitCode=0
Jul 07 19:40:42.829052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.829006    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"
Jul 07 19:40:42.829266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.829044    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" event={"ID":"f39f99b9-ac23-4758-94c2-9a4cde53facf","Type":"ContainerDied","Data":"8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128"}
Jul 07 19:40:42.829266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.829120    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q" event={"ID":"f39f99b9-ac23-4758-94c2-9a4cde53facf","Type":"ContainerDied","Data":"0c200baf613c15895f082d1902cce77bd9825a598fc244634c48b7bb669e62cd"}
Jul 07 19:40:42.829266 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.829152    2569 scope.go:117] "RemoveContainer" containerID="8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128"
Jul 07 19:40:42.838982 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.838958    2569 scope.go:117] "RemoveContainer" containerID="6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"
Jul 07 19:40:42.847987 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.847959    2569 scope.go:117] "RemoveContainer" containerID="8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128"
Jul 07 19:40:42.848253 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:40:42.848233    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128\": container with ID starting with 8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128 not found: ID does not exist" containerID="8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128"
Jul 07 19:40:42.848320 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.848263    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128"} err="failed to get container status \"8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128\": rpc error: code = NotFound desc = could not find container \"8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128\": container with ID starting with 8dc4561487627e716723cba4d7592419590481bef80c750aa1a32121609e0128 not found: ID does not exist"
Jul 07 19:40:42.848320 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.848281    2569 scope.go:117] "RemoveContainer" containerID="6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"
Jul 07 19:40:42.848587 ip-10-0-133-243 kubenswrapper[2569]: E0707 19:40:42.848568    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927\": container with ID starting with 6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927 not found: ID does not exist" containerID="6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"
Jul 07 19:40:42.848651 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.848595    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927"} err="failed to get container status \"6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927\": rpc error: code = NotFound desc = could not find container \"6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927\": container with ID starting with 6cf680cd216855f9699946674eecb4a33f4fdf7b9230e03f97f1bfe325341927 not found: ID does not exist"
Jul 07 19:40:42.963622 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963585    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-token\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.963818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963636    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-credential-socket\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.963818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963678    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-data\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.963818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963702    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k84jb\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-kube-api-access-k84jb\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.963818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963750    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39f99b9-ac23-4758-94c2-9a4cde53facf-istiod-ca-cert\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.963818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963781    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-envoy\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.963818 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963809    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-podinfo\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.964158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963840    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-certs\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.964158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.963880    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-socket\") pod \"f39f99b9-ac23-4758-94c2-9a4cde53facf\" (UID: \"f39f99b9-ac23-4758-94c2-9a4cde53facf\") "
Jul 07 19:40:42.964158 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.964036    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:42.964332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.964197    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:42.964332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.964217    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:42.964440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.964368    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:42.964440 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.964321    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f39f99b9-ac23-4758-94c2-9a4cde53facf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:40:42.964927 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.964903    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-data" (OuterVolumeSpecName: "istio-data") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:42.966067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.966038    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-token" (OuterVolumeSpecName: "istio-token") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:40:42.966146 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.966105    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-kube-api-access-k84jb" (OuterVolumeSpecName: "kube-api-access-k84jb") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "kube-api-access-k84jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:40:42.966306 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.966287    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:42.966356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:42.966322    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f39f99b9-ac23-4758-94c2-9a4cde53facf" (UID: "f39f99b9-ac23-4758-94c2-9a4cde53facf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:40:43.064767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064733    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39f99b9-ac23-4758-94c2-9a4cde53facf-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.064767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064760    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.064767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064770    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.064767 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064778    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.065052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064786    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.065052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064794    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.065052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064803    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39f99b9-ac23-4758-94c2-9a4cde53facf-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.065052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.064811    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k84jb\" (UniqueName: \"kubernetes.io/projected/f39f99b9-ac23-4758-94c2-9a4cde53facf-kube-api-access-k84jb\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:43.172185 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.172149    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"]
Jul 07 19:40:43.178331 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.178301    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c576d2-openshift-default-69b75d6f99-2rp4q"]
Jul 07 19:40:43.495227 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:43.495145    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" path="/var/lib/kubelet/pods/f39f99b9-ac23-4758-94c2-9a4cde53facf/volumes"
Jul 07 19:40:45.658433 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:45.658396    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"]
Jul 07 19:40:45.658867 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:45.658637    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy" containerID="cri-o://3e8ee100f0b8ddb9c02108c0989b99892b081ad3bb5d72730025c0bee1377d9d" gracePeriod=30
Jul 07 19:40:46.342592 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:46.342563    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cb9686f66-zvnxf_50e7ae66-cb6f-4684-92b8-8eb0502abfc1/authorino/0.log"
Jul 07 19:40:50.878677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.878644    2569 generic.go:356] "Generic (PLEG): container finished" podID="254a0635-ea17-4948-bf01-a461f4a1822b" containerID="3e8ee100f0b8ddb9c02108c0989b99892b081ad3bb5d72730025c0bee1377d9d" exitCode=0
Jul 07 19:40:50.879052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.878700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" event={"ID":"254a0635-ea17-4948-bf01-a461f4a1822b","Type":"ContainerDied","Data":"3e8ee100f0b8ddb9c02108c0989b99892b081ad3bb5d72730025c0bee1377d9d"}
Jul 07 19:40:50.879052 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.878750    2569 scope.go:117] "RemoveContainer" containerID="13172b142d23b04cb1743f2b98312e0057492be7ef8df8270b21893778ce9a4d"
Jul 07 19:40:50.928311 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.928254    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:40:50.933646 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933627    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254a0635-ea17-4948-bf01-a461f4a1822b-istiod-ca-cert\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.933749 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933663    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-credential-socket\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.933749 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-istio-token\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.933819 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933804    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-certs\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.933865 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933846    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254a0635-ea17-4948-bf01-a461f4a1822b-istio-podinfo\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.933926 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933869    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-envoy\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.933926 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933905    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz4qz\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-kube-api-access-fz4qz\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.934090 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933952    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-data\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.934090 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.933962    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:50.934090 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934005    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-socket\") pod \"254a0635-ea17-4948-bf01-a461f4a1822b\" (UID: \"254a0635-ea17-4948-bf01-a461f4a1822b\") "
Jul 07 19:40:50.934090 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934075    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:50.934322 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934099    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/254a0635-ea17-4948-bf01-a461f4a1822b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:40:50.934322 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934222    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:50.934434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934360    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:50.934434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934382    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/254a0635-ea17-4948-bf01-a461f4a1822b-istiod-ca-cert\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:50.934434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934397    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-credential-socket\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:50.934434 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934411    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-workload-certs\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:50.934955 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.934927    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-data" (OuterVolumeSpecName: "istio-data") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:50.936146 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.936123    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:40:50.936290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.936272    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-istio-token" (OuterVolumeSpecName: "istio-token") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:40:50.936352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.936323    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-kube-api-access-fz4qz" (OuterVolumeSpecName: "kube-api-access-fz4qz") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "kube-api-access-fz4qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:40:50.936534 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:50.936496    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/254a0635-ea17-4948-bf01-a461f4a1822b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "254a0635-ea17-4948-bf01-a461f4a1822b" (UID: "254a0635-ea17-4948-bf01-a461f4a1822b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:40:51.035061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.035020    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-istio-token\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:51.035061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.035054    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/254a0635-ea17-4948-bf01-a461f4a1822b-istio-podinfo\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:51.035061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.035063    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-envoy\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:51.035061 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.035072    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz4qz\" (UniqueName: \"kubernetes.io/projected/254a0635-ea17-4948-bf01-a461f4a1822b-kube-api-access-fz4qz\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:51.035343 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.035083    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/254a0635-ea17-4948-bf01-a461f4a1822b-istio-data\") on node \"ip-10-0-133-243.ec2.internal\" DevicePath \"\""
Jul 07 19:40:51.197539 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.197436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r86ct_454c9f76-6028-4126-8d47-7970b51cb362/manager/0.log"
Jul 07 19:40:51.315204 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.315175    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rbpkk_fa1f95f5-a2f9-4bf1-96d6-aef881d3b956/manager/0.log"
Jul 07 19:40:51.438658 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.438624    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4f86c5fb-jzd89_77228910-616f-4759-886f-c05a8dd66050/manager/0.log"
Jul 07 19:40:51.556838 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.556805    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dgb54_44254f20-e593-4d81-a233-2e02887cca48/server/0.log"
Jul 07 19:40:51.885945 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.885915    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"
Jul 07 19:40:51.885945 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.885942    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44" event={"ID":"254a0635-ea17-4948-bf01-a461f4a1822b","Type":"ContainerDied","Data":"71fe45d074a464e536e6f9aeb6dda0b6dc72dae3ec3ced3a0c0249ccef7458f1"}
Jul 07 19:40:51.886410 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.885995    2569 scope.go:117] "RemoveContainer" containerID="3e8ee100f0b8ddb9c02108c0989b99892b081ad3bb5d72730025c0bee1377d9d"
Jul 07 19:40:51.908144 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.908115    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"]
Jul 07 19:40:51.912710 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:51.912687    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2620f1-openshift-default-7d799cb5b7-cgs44"]
Jul 07 19:40:52.088488 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:52.088458    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-n4c9b_80814367-8254-4351-9f3f-fbca8e76417c/copy-manifests/0.log"
Jul 07 19:40:52.103918 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:52.103891    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-n4c9b_80814367-8254-4351-9f3f-fbca8e76417c/manager/0.log"
Jul 07 19:40:52.900708 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:52.900684    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8_b06ea888-7b96-4d67-8f83-24f14cf17d7b/util/0.log"
Jul 07 19:40:52.915926 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:52.915888    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8_b06ea888-7b96-4d67-8f83-24f14cf17d7b/pull/0.log"
Jul 07 19:40:52.925026 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:52.925001    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8_b06ea888-7b96-4d67-8f83-24f14cf17d7b/extract/0.log"
Jul 07 19:40:53.039546 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.039519    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd_1f4c01ad-4be8-48bb-8440-94e2675aff11/util/0.log"
Jul 07 19:40:53.047747 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.047712    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd_1f4c01ad-4be8-48bb-8440-94e2675aff11/pull/0.log"
Jul 07 19:40:53.055947 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.055920    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd_1f4c01ad-4be8-48bb-8440-94e2675aff11/extract/0.log"
Jul 07 19:40:53.176171 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.176094    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8_99b142a1-662e-4fbb-b354-04bdcd347145/extract/0.log"
Jul 07 19:40:53.184227 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.184205    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8_99b142a1-662e-4fbb-b354-04bdcd347145/util/0.log"
Jul 07 19:40:53.192799 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.192782    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8_99b142a1-662e-4fbb-b354-04bdcd347145/pull/0.log"
Jul 07 19:40:53.301919 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.301861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65_069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b/util/0.log"
Jul 07 19:40:53.310099 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.310070    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65_069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b/pull/0.log"
Jul 07 19:40:53.318356 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.318332    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65_069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b/extract/0.log"
Jul 07 19:40:53.446794 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.446712    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cb9686f66-zvnxf_50e7ae66-cb6f-4684-92b8-8eb0502abfc1/authorino/0.log"
Jul 07 19:40:53.491525 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.491478    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" path="/var/lib/kubelet/pods/254a0635-ea17-4948-bf01-a461f4a1822b/volumes"
Jul 07 19:40:53.576107 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.576077    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pfrwq_e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb/manager/0.log"
Jul 07 19:40:53.692851 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.692825    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tfrq5_8f8052ac-7402-4ad5-ae87-d9a8d8216ba4/manager/0.log"
Jul 07 19:40:53.805553 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.805457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qw64w_7429c6f9-bb53-4db8-b130-a948088b4cf3/kuadrant-console-plugin/0.log"
Jul 07 19:40:53.929978 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:53.929951    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gjpkm_cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918/registry-server/0.log"
Jul 07 19:40:54.055853 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:54.055772    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xzklz_eb7fa44b-3640-4831-98c0-dde6ef6ab593/manager/0.log"
Jul 07 19:40:54.298997 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:54.298967    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7cw5_c8e863af-7a41-480f-89a6-025a735e192b/manager/0.log"
Jul 07 19:40:54.898859 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:54.898832    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-955bd7587-7mjhb_4e05057e-6b20-4087-b12f-bee036bc3f7e/kube-auth-proxy/0.log"
Jul 07 19:40:55.259663 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:55.259585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g2rh2_74caba65-af6a-4dca-906c-d2bf6d07d912/payload-pre-processing/0.log"
Jul 07 19:40:55.388947 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:40:55.388916    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-f4rw6_7209660b-2463-45e3-a9e7-56f5eadebaee/payload-processing/0.log"
Jul 07 19:41:00.673667 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.673631    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4c88/must-gather-dfqlh"]
Jul 07 19:41:00.674071 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674038    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy"
Jul 07 19:41:00.674071 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674049    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy"
Jul 07 19:41:00.674071 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674057    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy"
Jul 07 19:41:00.674071 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674063    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674083    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674089    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674100    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674105    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674173    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674181    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674186    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="254a0635-ea17-4948-bf01-a461f4a1822b" containerName="istio-proxy"
Jul 07 19:41:00.674225 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.674193    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39f99b9-ac23-4758-94c2-9a4cde53facf" containerName="istio-proxy"
Jul 07 19:41:00.677291 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.677266    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.681423 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.681373    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v4c88\"/\"default-dockercfg-drvns\""
Jul 07 19:41:00.682049 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.682022    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4c88\"/\"kube-root-ca.crt\""
Jul 07 19:41:00.682186 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.682108    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4c88\"/\"openshift-service-ca.crt\""
Jul 07 19:41:00.691285 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.691260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4c88/must-gather-dfqlh"]
Jul 07 19:41:00.716691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.716660    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6fqs\" (UniqueName: \"kubernetes.io/projected/9fad951d-f779-4f84-9975-af02d0d8def5-kube-api-access-h6fqs\") pod \"must-gather-dfqlh\" (UID: \"9fad951d-f779-4f84-9975-af02d0d8def5\") " pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.716691 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.716689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fad951d-f779-4f84-9975-af02d0d8def5-must-gather-output\") pod \"must-gather-dfqlh\" (UID: \"9fad951d-f779-4f84-9975-af02d0d8def5\") " pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.817333 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.817286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6fqs\" (UniqueName: \"kubernetes.io/projected/9fad951d-f779-4f84-9975-af02d0d8def5-kube-api-access-h6fqs\") pod \"must-gather-dfqlh\" (UID: \"9fad951d-f779-4f84-9975-af02d0d8def5\") " pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.817333 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.817326    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fad951d-f779-4f84-9975-af02d0d8def5-must-gather-output\") pod \"must-gather-dfqlh\" (UID: \"9fad951d-f779-4f84-9975-af02d0d8def5\") " pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.817729 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.817711    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fad951d-f779-4f84-9975-af02d0d8def5-must-gather-output\") pod \"must-gather-dfqlh\" (UID: \"9fad951d-f779-4f84-9975-af02d0d8def5\") " pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.828487 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.828452    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6fqs\" (UniqueName: \"kubernetes.io/projected/9fad951d-f779-4f84-9975-af02d0d8def5-kube-api-access-h6fqs\") pod \"must-gather-dfqlh\" (UID: \"9fad951d-f779-4f84-9975-af02d0d8def5\") " pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:00.987764 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:00.987672    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4c88/must-gather-dfqlh"
Jul 07 19:41:01.127096 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:01.127069    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4c88/must-gather-dfqlh"]
Jul 07 19:41:01.128905 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:41:01.128871    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fad951d_f779_4f84_9975_af02d0d8def5.slice/crio-98c47c0e6474ca728d915d7e9afd2ed95fe484fe04a1cf8a7de35e41ed53cc1d WatchSource:0}: Error finding container 98c47c0e6474ca728d915d7e9afd2ed95fe484fe04a1cf8a7de35e41ed53cc1d: Status 404 returned error can't find the container with id 98c47c0e6474ca728d915d7e9afd2ed95fe484fe04a1cf8a7de35e41ed53cc1d
Jul 07 19:41:01.130992 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:01.130970    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:41:01.941402 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:01.941359    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/must-gather-dfqlh" event={"ID":"9fad951d-f779-4f84-9975-af02d0d8def5","Type":"ContainerStarted","Data":"98c47c0e6474ca728d915d7e9afd2ed95fe484fe04a1cf8a7de35e41ed53cc1d"}
Jul 07 19:41:02.949799 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:02.949766    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/must-gather-dfqlh" event={"ID":"9fad951d-f779-4f84-9975-af02d0d8def5","Type":"ContainerStarted","Data":"2e4658cbdeee43bbe7c4646d2cc2b8fa9ae256c04e2b6c2964e0bc1951459878"}
Jul 07 19:41:02.950192 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:02.949810    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/must-gather-dfqlh" event={"ID":"9fad951d-f779-4f84-9975-af02d0d8def5","Type":"ContainerStarted","Data":"176eab4277dbfce40346eac26169572fac1f5561017379aa30caac47da5a20a8"}
Jul 07 19:41:02.967467 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:02.967385    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4c88/must-gather-dfqlh" podStartSLOduration=1.712757283 podStartE2EDuration="2.967359759s" totalImagesPullingTime="1.254602476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:41:02.965490611 +0000 UTC m=+2388.105864796" watchObservedRunningTime="2026-07-07 19:41:02.967359759 +0000 UTC m=+2388.107733942"
Jul 07 19:41:04.294317 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:04.294285    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wm5f9_a03e1d90-67f3-4f8a-a185-0f542e623f54/global-pull-secret-syncer/0.log"
Jul 07 19:41:04.433858 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:04.433800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zwv5z_f557f0ef-50b9-4fd4-9ad3-ff4b62128088/konnectivity-agent/0.log"
Jul 07 19:41:04.466048 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:04.465987    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-243.ec2.internal_ea6aa2ed699049cefc1e795a074e4c66/haproxy/0.log"
Jul 07 19:41:09.123722 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.123637    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8_b06ea888-7b96-4d67-8f83-24f14cf17d7b/extract/0.log"
Jul 07 19:41:09.154205 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.154177    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8_b06ea888-7b96-4d67-8f83-24f14cf17d7b/util/0.log"
Jul 07 19:41:09.181686 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.181636    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cm2w8_b06ea888-7b96-4d67-8f83-24f14cf17d7b/pull/0.log"
Jul 07 19:41:09.234493 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.234460    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd_1f4c01ad-4be8-48bb-8440-94e2675aff11/extract/0.log"
Jul 07 19:41:09.262046 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.262015    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd_1f4c01ad-4be8-48bb-8440-94e2675aff11/util/0.log"
Jul 07 19:41:09.283268 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.283117    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r97nd_1f4c01ad-4be8-48bb-8440-94e2675aff11/pull/0.log"
Jul 07 19:41:09.317246 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.317216    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8_99b142a1-662e-4fbb-b354-04bdcd347145/extract/0.log"
Jul 07 19:41:09.345680 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.345632    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8_99b142a1-662e-4fbb-b354-04bdcd347145/util/0.log"
Jul 07 19:41:09.374887 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.374803    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dnpp8_99b142a1-662e-4fbb-b354-04bdcd347145/pull/0.log"
Jul 07 19:41:09.409822 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.409788    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65_069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b/extract/0.log"
Jul 07 19:41:09.438425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.438301    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65_069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b/util/0.log"
Jul 07 19:41:09.467198 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.467147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pnw65_069ebcf7-5c0c-4e15-9f16-f93c2a50bb2b/pull/0.log"
Jul 07 19:41:09.858524 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.858344    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cb9686f66-zvnxf_50e7ae66-cb6f-4684-92b8-8eb0502abfc1/authorino/0.log"
Jul 07 19:41:09.892108 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.892078    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pfrwq_e3a8fd64-af0c-4c73-ada2-9fcd9b127bdb/manager/0.log"
Jul 07 19:41:09.919705 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.919679    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tfrq5_8f8052ac-7402-4ad5-ae87-d9a8d8216ba4/manager/0.log"
Jul 07 19:41:09.950020 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:09.949994    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qw64w_7429c6f9-bb53-4db8-b130-a948088b4cf3/kuadrant-console-plugin/0.log"
Jul 07 19:41:10.013661 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:10.013628    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gjpkm_cc6c1d7e-f2d0-4b1b-9735-b9f7d0e9d918/registry-server/0.log"
Jul 07 19:41:10.213693 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:10.213604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xzklz_eb7fa44b-3640-4831-98c0-dde6ef6ab593/manager/0.log"
Jul 07 19:41:10.335992 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:10.335956    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7cw5_c8e863af-7a41-480f-89a6-025a735e192b/manager/0.log"
Jul 07 19:41:12.335677 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.335639    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-gfspx_7fb23e74-4e35-4076-ae31-7372982727a2/kube-state-metrics/0.log"
Jul 07 19:41:12.364655 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.364627    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-gfspx_7fb23e74-4e35-4076-ae31-7372982727a2/kube-rbac-proxy-main/0.log"
Jul 07 19:41:12.396326 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.396299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-gfspx_7fb23e74-4e35-4076-ae31-7372982727a2/kube-rbac-proxy-self/0.log"
Jul 07 19:41:12.470332 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.470300    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-dqthb_0a72389e-2e19-4bb1-9493-fe48d7c7e01d/monitoring-plugin/0.log"
Jul 07 19:41:12.740917 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.740878    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9ggf_c9852e22-e9ef-4f1b-9128-69876c8663f6/node-exporter/0.log"
Jul 07 19:41:12.769698 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.769665    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9ggf_c9852e22-e9ef-4f1b-9128-69876c8663f6/kube-rbac-proxy/0.log"
Jul 07 19:41:12.798276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.798241    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9ggf_c9852e22-e9ef-4f1b-9128-69876c8663f6/init-textfile/0.log"
Jul 07 19:41:12.831695 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.831660    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fkrg7_cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc/kube-rbac-proxy-main/0.log"
Jul 07 19:41:12.859748 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.859585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fkrg7_cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc/kube-rbac-proxy-self/0.log"
Jul 07 19:41:12.889165 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:12.889125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fkrg7_cbb1bcb2-bcee-4f96-91df-35e4eb2a29cc/openshift-state-metrics/0.log"
Jul 07 19:41:13.140796 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:13.140767    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-btvf2_d2e6fc1c-508a-48b6-82c9-9caf409ca091/prometheus-operator/0.log"
Jul 07 19:41:13.163482 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:13.163456    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-btvf2_d2e6fc1c-508a-48b6-82c9-9caf409ca091/kube-rbac-proxy/0.log"
Jul 07 19:41:14.172783 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.172746    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"]
Jul 07 19:41:14.181290 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.181263    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.189816 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.189785    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"]
Jul 07 19:41:14.272015 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.271939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-sys\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.272015 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.272007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-lib-modules\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.272276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.272067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-proc\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.272276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.272095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9nh\" (UniqueName: \"kubernetes.io/projected/cb9a63c9-c695-4be4-a21a-f23395233cd0-kube-api-access-qm9nh\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.272276 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.272142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-podres\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373313 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373270    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-sys\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373313 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373316    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-lib-modules\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-proc\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9nh\" (UniqueName: \"kubernetes.io/projected/cb9a63c9-c695-4be4-a21a-f23395233cd0-kube-api-access-qm9nh\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-podres\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373445    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-sys\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373526    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-lib-modules\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373536    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-proc\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.373653 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.373591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb9a63c9-c695-4be4-a21a-f23395233cd0-podres\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.382780 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.382741    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9nh\" (UniqueName: \"kubernetes.io/projected/cb9a63c9-c695-4be4-a21a-f23395233cd0-kube-api-access-qm9nh\") pod \"perf-node-gather-daemonset-ztn2j\" (UID: \"cb9a63c9-c695-4be4-a21a-f23395233cd0\") " pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.499408 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.499309    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:14.693352 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.692428    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"]
Jul 07 19:41:14.697272 ip-10-0-133-243 kubenswrapper[2569]: W0707 19:41:14.697233    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb9a63c9_c695_4be4_a21a_f23395233cd0.slice/crio-9e702745d37bbac86c85550aa3585b08c5840b795690719e42df7e9b5599bb87 WatchSource:0}: Error finding container 9e702745d37bbac86c85550aa3585b08c5840b795690719e42df7e9b5599bb87: Status 404 returned error can't find the container with id 9e702745d37bbac86c85550aa3585b08c5840b795690719e42df7e9b5599bb87
Jul 07 19:41:14.703531 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:14.703403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-hz6fm_12b194d0-ab4a-47f9-ab3f-ce3abe41c87c/networking-console-plugin/0.log"
Jul 07 19:41:15.054544 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:15.054410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j" event={"ID":"cb9a63c9-c695-4be4-a21a-f23395233cd0","Type":"ContainerStarted","Data":"c6ddf267098cf950119fa03798e5b46aa3eb42d02840a0a803f73d336bb7003f"}
Jul 07 19:41:15.054544 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:15.054485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j" event={"ID":"cb9a63c9-c695-4be4-a21a-f23395233cd0","Type":"ContainerStarted","Data":"9e702745d37bbac86c85550aa3585b08c5840b795690719e42df7e9b5599bb87"}
Jul 07 19:41:15.054544 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:15.054535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:15.080619 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:15.080554    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j" podStartSLOduration=1.080532662 podStartE2EDuration="1.080532662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:41:15.077354001 +0000 UTC m=+2400.217728182" watchObservedRunningTime="2026-07-07 19:41:15.080532662 +0000 UTC m=+2400.220906844"
Jul 07 19:41:15.850806 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:15.850769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76954c7c97-2rmwv_617b5718-df2e-497c-9058-4feb02c67208/console/0.log"
Jul 07 19:41:15.890126 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:15.890094    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-fkr88_f15799ca-50bc-447b-8ff2-d9b4f9ee440e/download-server/0.log"
Jul 07 19:41:17.751034 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:17.750956    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rp677_b24be916-b171-419c-88e4-105618b31ac6/dns/0.log"
Jul 07 19:41:17.774179 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:17.774149    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rp677_b24be916-b171-419c-88e4-105618b31ac6/kube-rbac-proxy/0.log"
Jul 07 19:41:17.851982 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:17.851951    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jtqj7_1ac9b790-71ac-4f5a-bcff-d1679c48f5ba/dns-node-resolver/0.log"
Jul 07 19:41:18.445361 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:18.445330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5858cf7c49-2tfl6_fbfc70f2-5b5e-49bd-af18-b28a1338d17e/registry/0.log"
Jul 07 19:41:18.468785 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:18.468758    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7dbh4_5b692e26-8a80-4791-8e20-6e567d0b4fc7/node-ca/0.log"
Jul 07 19:41:19.693731 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:19.693699    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-955bd7587-7mjhb_4e05057e-6b20-4087-b12f-bee036bc3f7e/kube-auth-proxy/0.log"
Jul 07 19:41:19.819425 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:19.819396    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g2rh2_74caba65-af6a-4dca-906c-d2bf6d07d912/payload-pre-processing/0.log"
Jul 07 19:41:19.875560 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:19.875477    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-f4rw6_7209660b-2463-45e3-a9e7-56f5eadebaee/payload-processing/0.log"
Jul 07 19:41:20.682068 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:20.682040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-747jl_d2f62e5e-fea0-4778-8476-fba463cff416/serve-healthcheck-canary/0.log"
Jul 07 19:41:21.073837 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:21.073754    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v4c88/perf-node-gather-daemonset-ztn2j"
Jul 07 19:41:21.470684 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:21.470656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kqkg_21cdff67-551f-447c-9314-b2f606b1068d/kube-rbac-proxy/0.log"
Jul 07 19:41:21.500213 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:21.500145    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kqkg_21cdff67-551f-447c-9314-b2f606b1068d/exporter/0.log"
Jul 07 19:41:21.526067 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:21.526040    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5kqkg_21cdff67-551f-447c-9314-b2f606b1068d/extractor/0.log"
Jul 07 19:41:24.144017 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:24.143989    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-r86ct_454c9f76-6028-4126-8d47-7970b51cb362/manager/0.log"
Jul 07 19:41:24.322532 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:24.322474    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rbpkk_fa1f95f5-a2f9-4bf1-96d6-aef881d3b956/manager/0.log"
Jul 07 19:41:24.450093 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:24.450055    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4f86c5fb-jzd89_77228910-616f-4759-886f-c05a8dd66050/manager/0.log"
Jul 07 19:41:24.474321 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:24.474296    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dgb54_44254f20-e593-4d81-a233-2e02887cca48/server/0.log"
Jul 07 19:41:24.862280 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:24.862248    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-n4c9b_80814367-8254-4351-9f3f-fbca8e76417c/manager/0.log"
Jul 07 19:41:24.889550 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:24.889502    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59996cbd9d-n4c9b_80814367-8254-4351-9f3f-fbca8e76417c/copy-manifests/0.log"
Jul 07 19:41:25.174196 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:25.174105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-955bd7587-7mjhb_4e05057e-6b20-4087-b12f-bee036bc3f7e/kube-auth-proxy/0.log"
Jul 07 19:41:25.290382 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:25.290349    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g2rh2_74caba65-af6a-4dca-906c-d2bf6d07d912/payload-pre-processing/0.log"
Jul 07 19:41:25.359220 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:25.359181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-f4rw6_7209660b-2463-45e3-a9e7-56f5eadebaee/payload-processing/0.log"
Jul 07 19:41:26.772894 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:26.772859    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-955bd7587-7mjhb_4e05057e-6b20-4087-b12f-bee036bc3f7e/kube-auth-proxy/0.log"
Jul 07 19:41:26.869564 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:26.869534    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g2rh2_74caba65-af6a-4dca-906c-d2bf6d07d912/payload-pre-processing/0.log"
Jul 07 19:41:26.916770 ip-10-0-133-243 kubenswrapper[2569]: I0707 19:41:26.916704    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-f4rw6_7209660b-2463-45e3-a9e7-56f5eadebaee/payload-processing/0.log"