Jul 23 11:10:07.563742 ip-10-0-132-128 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 11:10:07.890086 ip-10-0-132-128 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 11:10:07.890086 ip-10-0-132-128 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 11:10:07.890086 ip-10-0-132-128 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 11:10:07.890086 ip-10-0-132-128 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 11:10:07.890086 ip-10-0-132-128 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 11:10:07.892261 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.892192    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 11:10:07.896444 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896430    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:10:07.896444 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896444    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896448    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896451    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896455    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896459    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896463    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896466    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896480    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896483    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896486    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896489    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896492    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896495    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896498    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896501    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896504    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896507    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896510    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896513    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896515    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:10:07.896520 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896518    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896521    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896523    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896526    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896529    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896532    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896535    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896537    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896540    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896543    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896545    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896548    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896550    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896552    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896555    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896558    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896560    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896562    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896594    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896626    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:10:07.897274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896631    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896635    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896639    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896644    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896650    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896656    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896662    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896665    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896670    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896674    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896681    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896685    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896688    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896692    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896695    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896701    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896710    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896717    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:10:07.897933 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.896722    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897267    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897274    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897285    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897290    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897295    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897300    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897305    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897309    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897315    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897319    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897324    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897328    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897342    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897346    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897351    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897360    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897364    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897369    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897374    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:10:07.898373 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897378    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897382    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897386    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897391    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897395    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897400    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897404    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897409    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897414    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897422    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897427    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897431    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897435    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897439    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897444    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897448    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897452    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897456    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897460    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.897464    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:10:07.898847 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898460    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898487    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898491    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898494    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898497    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898501    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898504    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898506    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898509    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898512    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898514    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898517    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898519    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898522    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898525    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898527    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898530    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898534    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898536    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898539    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:10:07.899327 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898542    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898545    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898547    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898550    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898553    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898555    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898558    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898560    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898563    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898566    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898569    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898571    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898574    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898576    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898579    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898581    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898584    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898586    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898589    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:10:07.899839 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898591    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898594    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898597    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898601    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898605    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898608    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898611    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898613    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898616    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898618    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898621    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898623    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898626    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898629    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898631    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898634    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898636    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898640    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898642    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898645    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:10:07.900309 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898647    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898650    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898654    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898658    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898661    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898663    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898666    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898669    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898671    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898674    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898676    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898679    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898681    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898684    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898686    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898689    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898692    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898694    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898698    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898700    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:10:07.900812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898703    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898705    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898708    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898712    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898716    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898719    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898722    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898724    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898727    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898729    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898732    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898735    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898737    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898739    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898742    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898744    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898747    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898749    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898752    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:10:07.901281 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.898754    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899103    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899109    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899113    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899116    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899119    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899121    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899124    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899126    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899129    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899132    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899134    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899137    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899139    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899142    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899147    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899149    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899152    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899154    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:10:07.901733 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899157    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899160    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899163    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899165    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899168    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899171    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899173    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899177    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899179    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899183    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899185    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899188    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899190    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899193    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899195    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899198    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899200    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899203    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899205    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899207    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:10:07.902176 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899210    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899212    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899215    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899217    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899221    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899224    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899227    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899230    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899235    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899238    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899241    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899244    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899246    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899249    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899251    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899254    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899256    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899262    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899278    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:10:07.902653 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899281    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899284    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899286    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899289    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899291    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899295    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899297    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899300    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899302    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899305    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899307    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899310    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899312    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899315    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899317    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899321    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899324    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899327    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899330    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899332    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:10:07.903088 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899335    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899340    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899344    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899348    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899351    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899355    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899359    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899363    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899367    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899370    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899374    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899377    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899380    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899382    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899385    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899387    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899390    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899392    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899394    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899397    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:10:07.903574 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899399    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.899402    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899483    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899493    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899500    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899506    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899512    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899517    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899522    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899525    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899528    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899531    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899535    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899538    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899542    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899544    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899547    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899550    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899553    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899555    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899560    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899562    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899565    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899568    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 11:10:07.904079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899572    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899576    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899578    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899581    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899584    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899587    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899590    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899592    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899596    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899598    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899602    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899605    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899608    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899610    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899613    2578 flags.go:64] FLAG: --enable-server="true"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899616    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899620    2578 flags.go:64] FLAG: --event-burst="100"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899623    2578 flags.go:64] FLAG: --event-qps="50"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899625    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899628    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899631    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899634    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899637    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899640    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899643    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 23 11:10:07.904672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899646    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899649    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899652    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899654    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899657    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899660    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899662    2578 flags.go:64] FLAG: --feature-gates=""
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899668    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899671    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899675    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899678    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899680    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899683    2578 flags.go:64] FLAG: --help="false"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899686    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-132-128.ec2.internal"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899689    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899692    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899694    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899698    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899701    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899704    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899706    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899709    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899712    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 11:10:07.905298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899714    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899717    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899720    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899723    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899725    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899728    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899731    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899734    2578 flags.go:64] FLAG: --lock-file=""
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899736    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899739    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899741    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899746    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899749    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899751    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899754    2578 flags.go:64] FLAG: --logging-format="text"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899757    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899761    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899764    2578 flags.go:64] FLAG: --manifest-url=""
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899767    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899771    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899773    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899777    2578 flags.go:64] FLAG: --max-pods="110"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899780    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899783    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899785    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 11:10:07.906029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899788    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899791    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899793    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899796    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899803    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899805    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899808    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899811    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899814    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899820    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899823    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899826    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899828    2578 flags.go:64] FLAG: --port="10250"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899832    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899834    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04090f7a997d38c82"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899837    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899840    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899843    2578 flags.go:64] FLAG: --register-node="true"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899846    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899849    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899852    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899855    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899857    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899862    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899865    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 11:10:07.907052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899868    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899871    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899874    2578 flags.go:64] FLAG: --runonce="false"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899876    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899879    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899882    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899885    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899887    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899890    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899893    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899896    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899898    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899901    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899904    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899906    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899909    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899912    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899916    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899931    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899934    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899937    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899941    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899944    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899947    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899949    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 11:10:07.908093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899952    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899955    2578 flags.go:64] FLAG: --v="2"
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899978    2578 flags.go:64] FLAG: --version="false"
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899982    2578 flags.go:64] FLAG: --vmodule=""
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899985    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.899990    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900109    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900113    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900116    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900120    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900123    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900126    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900129    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900132    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900135    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900138    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900141    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900143    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900146    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900149    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:10:07.909209 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900151    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900154    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900157    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900159    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900163    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900166    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900168    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900171    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900174    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900176    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900179    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900182    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900185    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900187    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900189    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900192    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900195    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900202    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900205    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900208    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:10:07.909750 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900210    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900213    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900216    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900218    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900221    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900223    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900226    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900228    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900231    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900233    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900236    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900238    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900241    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900244    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900246    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900249    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900254    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900258    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900261    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:10:07.910427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900265    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900268    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900271    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900274    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900277    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900279    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900282    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900284    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900286    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900289    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900293    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900295    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900298    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900300    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900303    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900305    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900308    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900311    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900314    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900317    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:10:07.910945 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900320    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900322    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900325    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900328    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900330    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900333    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900335    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900338    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900340    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900344    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900347    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900351    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900354    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900358    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900360    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900363    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900365    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900368    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900370    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900373    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:10:07.911763 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900376    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900378    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900382    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900385    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900387    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.900390    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.901049    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.907784    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.907801    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.907827    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.907835    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907943    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907950    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907955    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907978    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:10:07.912322 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907983    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907987    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907992    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.907996    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908001    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908005    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908009    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908013    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908018    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908022    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908028    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908034    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908039    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908044    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908048    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908052    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908057    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908061    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908066    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908070    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:10:07.912793 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908075    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908079    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908083    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908087    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908092    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908096    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908101    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908106    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908110    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908114    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908118    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908122    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908126    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908131    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908136    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908140    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908145    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908149    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908153    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:10:07.913467 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908158    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908162    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908166    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908171    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908175    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908179    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908184    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908188    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908193    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908197    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908201    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908205    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908210    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908214    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908218    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908222    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908227    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908231    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908236    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908241    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:10:07.913955 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908246    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908250    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908254    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908259    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908263    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908267    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908273    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908280    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908284    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908288    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908292    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908296    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908300    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908304    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908309    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908314    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908317    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908322    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908326    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:10:07.914427 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908334    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908339    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908343    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908347    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908352    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908357    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908362    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908366    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908371    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908375    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908379    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908383    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908387    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908391    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908396    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908401    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:10:07.914970 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908405    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.908413    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908599    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908608    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908612    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908617    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908622    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908626    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908630    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908635    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908640    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908644    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908648    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908652    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908656    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 11:10:07.915386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908661    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908667    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908673    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908678    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908682    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908686    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908691    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908695    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908699    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908703    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908707    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908711    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908715    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908720    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908724    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908728    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908733    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908737    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908741    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 11:10:07.915768 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908745    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908749    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908753    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908757    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908761    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908765    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908769    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908773    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908779    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908785    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908790    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908794    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908798    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908802    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908806    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908810    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908814    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908818    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908822    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908826    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 11:10:07.916270 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908830    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908834    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908838    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908842    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908846    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908850    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908855    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908859    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908863    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908867    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908872    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908878    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908883    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908888    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908892    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908898    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908902    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908907    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908912    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908916    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 11:10:07.916889 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908921    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908926    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908930    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908934    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908938    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908942    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908946    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908950    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908954    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908958    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908963    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908967    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908970    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908975    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908979    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908983    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908987    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908991    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908995    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 11:10:07.917757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.908999    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909004    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909008    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909012    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909017    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909021    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909025    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:07.909029    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.909037    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.909181    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.913128    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.914655    2578 server.go:1019] "Starting client certificate rotation"
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.914768    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 11:10:07.918206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.914813    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 11:10:07.918531 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.917204    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 11:10:07.920157 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.920138    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 11:10:07.927442 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.927424    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 23 11:10:07.929827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.929810    2578 log.go:25] "Validated CRI v1 image API"
Jul 23 11:10:07.930547 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.930533    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 11:10:07.933356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.933338    2578 fs.go:135] Filesystem UUIDs: map[5c3f7320-21ab-4b26-b808-160825ab804a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 af0cecc1-96a9-4d06-8107-f17d2dc36765:/dev/nvme0n1p3]
Jul 23 11:10:07.933414 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.933355    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 11:10:07.938106 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.937978    2578 manager.go:216] Machine: {Timestamp:2026-07-23 11:10:07.936846139 +0000 UTC m=+0.276844025 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3191363 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21c84e8f397d6834e95e90ddb836a8 SystemUUID:ec21c84e-8f39-7d68-34e9-5e90ddb836a8 BootID:d46f8264-686b-495c-b62d-ec1f5b00ef32 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:91:fd:4c:10:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:91:fd:4c:10:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:fd:9a:76:7e:e8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 11:10:07.938106 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.938103    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 11:10:07.938218 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.938169    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 11:10:07.940712 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.940695    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 11:10:07.940821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.940797    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 11:10:07.940975 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.940827    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 11:10:07.941500 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.941490    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 11:10:07.941530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.941504    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 11:10:07.941530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.941510    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 11:10:07.942115 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.942104    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 11:10:07.943487 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.943478    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 11:10:07.947297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947286    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 11:10:07.947404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947395    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 11:10:07.947433 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947423    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 11:10:07.947462 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947433    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 11:10:07.947462 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947448    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 11:10:07.947462 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947458    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 23 11:10:07.947580 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947482    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 11:10:07.947775 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947758    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 11:10:07.947876 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.947784    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 11:10:07.949753 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.949730    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 11:10:07.951065 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951052    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 11:10:07.951105 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951081    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 11:10:07.951690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951679    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951696    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951705    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951712    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951721    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951727    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951735    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951740    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951746    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951751    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951759    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 11:10:07.951760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951764    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 11:10:07.952220 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951785    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 11:10:07.952220 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.951794    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 11:10:07.954724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.954709    2578 server.go:1268] "Started kubelet"
Jul 23 11:10:07.957870 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.957561    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 11:10:07.958192 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.958147    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 11:10:07.958243 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.958218    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 11:10:07.958227 ip-10-0-132-128 systemd[1]: Started Kubernetes Kubelet.
Jul 23 11:10:07.960614 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.960592    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 11:10:07.961211 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.961187    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 11:10:07.961641 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.961622    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 11:10:07.961724 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.961672    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 11:10:07.962229 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.962211    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 11:10:07.965937 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.965853    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 11:10:07.966242 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.965392    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-128.ec2.internal.18c4e6b2cc7a2590  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-128.ec2.internal,UID:ip-10-0-132-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-128.ec2.internal,},FirstTimestamp:2026-07-23 11:10:07.95468328 +0000 UTC m=+0.294681163,LastTimestamp:2026-07-23 11:10:07.95468328 +0000 UTC m=+0.294681163,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-128.ec2.internal,}"
Jul 23 11:10:07.968995 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.968980    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 11:10:07.969080 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.969071    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:07.969139 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969085    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 11:10:07.969680 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969561    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 11:10:07.969680 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969592    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 11:10:07.969680 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969628    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 11:10:07.969905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969698    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 11:10:07.969905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969707    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 11:10:07.969996 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969983    2578 factory.go:55] Registering systemd factory
Jul 23 11:10:07.969996 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.969996    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 23 11:10:07.970207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.970190    2578 factory.go:153] Registering CRI-O factory
Jul 23 11:10:07.970260 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.970211    2578 factory.go:223] Registration of the crio container factory successfully
Jul 23 11:10:07.970310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.970261    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 11:10:07.970310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.970286    2578 factory.go:103] Registering Raw factory
Jul 23 11:10:07.970310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.970300    2578 manager.go:1196] Started watching for new ooms in manager
Jul 23 11:10:07.970717 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.970702    2578 manager.go:349] Starting recovery of all containers
Jul 23 11:10:07.974185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.974165    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42ssw"
Jul 23 11:10:07.975718 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.975665    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 11:10:07.975859 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.975836    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 11:10:07.980098 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.980082    2578 manager.go:354] Recovery completed
Jul 23 11:10:07.983305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.983289    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42ssw"
Jul 23 11:10:07.983870 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.983858    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:07.985490 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.985460    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:07.985559 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.985499    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:07.985559 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.985510    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:07.986233 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.986212    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 11:10:07.986233 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.986228    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 11:10:07.986233 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.986231    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:07.986441 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.986245    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 11:10:07.987367 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.987349    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:07.987451 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.987377    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:07.987451 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.987391    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:07.988196 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:07.988106    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-128.ec2.internal.18c4e6b2ce5021c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-128.ec2.internal,UID:ip-10-0-132-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-128.ec2.internal,},FirstTimestamp:2026-07-23 11:10:07.985484229 +0000 UTC m=+0.325482115,LastTimestamp:2026-07-23 11:10:07.985484229 +0000 UTC m=+0.325482115,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-128.ec2.internal,}"
Jul 23 11:10:07.988838 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.988820    2578 policy_none.go:49] "None policy: Start"
Jul 23 11:10:07.988922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.988843    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 11:10:07.988922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.988856    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 11:10:07.990905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:07.990893    2578 policy_none.go:47] "Start"
Jul 23 11:10:08.024116 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024008    2578 manager.go:337] "Starting Device Plugin manager"
Jul 23 11:10:08.024185 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.024136    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 11:10:08.024185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024148    2578 server.go:87] "Starting device plugin registration server"
Jul 23 11:10:08.024371 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024359    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 11:10:08.024405 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024374    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 11:10:08.024524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024503    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 11:10:08.024612 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024585    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 11:10:08.024612 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.024595    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 11:10:08.025060 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.025041    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 11:10:08.025160 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.025091    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:08.096673 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.096640    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 11:10:08.098746 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.097822    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 11:10:08.098746 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.097862    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 11:10:08.098746 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.097883    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 11:10:08.098746 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.097917    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 11:10:08.100625 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.100609    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:10:08.124980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.124965    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:08.125737 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.125717    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:08.125804 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.125742    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:08.125804 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.125754    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:08.125804 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.125772    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.132720 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.132703    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.132793 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.132722    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-128.ec2.internal\": node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:08.155915 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.155873    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:08.198863 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.198826    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"]
Jul 23 11:10:08.198935 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.198890    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:08.199565 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.199546    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:08.199640 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.199571    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:08.199640 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.199581    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:08.201812 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.201801    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:08.201954 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.201942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.201988 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.201966    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:08.202525 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.202504    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:08.202617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.202530    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:08.202617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.202508    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:08.202617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.202540    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:08.202617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.202553    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:08.202617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.202579    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:08.204738 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.204721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.204826 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.204744    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 11:10:08.205360 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.205345    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 11:10:08.205435 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.205374    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 11:10:08.205435 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.205390    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID"
Jul 23 11:10:08.229038 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.229022    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-128.ec2.internal\" not found" node="ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.233239 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.233225    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-128.ec2.internal\" not found" node="ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.256322 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.256305    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:08.271549 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.271532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf50aae12e69e2f8a51417b14d5fe036-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"cf50aae12e69e2f8a51417b14d5fe036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.271605 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.271554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf50aae12e69e2f8a51417b14d5fe036-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"cf50aae12e69e2f8a51417b14d5fe036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.271605 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.271571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f55fef534baa21e90d350e1062068982-config\") pod \"kube-apiserver-proxy-ip-10-0-132-128.ec2.internal\" (UID: \"f55fef534baa21e90d350e1062068982\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.356816 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:08.356797    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:08.372544 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.372527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf50aae12e69e2f8a51417b14d5fe036-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"cf50aae12e69e2f8a51417b14d5fe036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.372602 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.372545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf50aae12e69e2f8a51417b14d5fe036-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"cf50aae12e69e2f8a51417b14d5fe036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.372602 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.372595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf50aae12e69e2f8a51417b14d5fe036-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"cf50aae12e69e2f8a51417b14d5fe036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.372676 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.372604    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf50aae12e69e2f8a51417b14d5fe036-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"cf50aae12e69e2f8a51417b14d5fe036\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.372676 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.372621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f55fef534baa21e90d350e1062068982-config\") pod \"kube-apiserver-proxy-ip-10-0-132-128.ec2.internal\" (UID: \"f55fef534baa21e90d350e1062068982\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:08.372676 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:08.372649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f55fef534baa21e90d350e1062068982-config\") pod \"kube-apiserver-proxy-ip-10-0-132-128.ec2.internal\" (UID: \"f55fef534baa21e90d350e1062068982\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:09.670454 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:09.670408    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:09.743828 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:09.743805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:09.750736 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:09.750719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:09.771430 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:09.771410    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:09.871965 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:09.871944    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:09.972419 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:09.972375    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.072932 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:10.072914    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.127352 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.127335    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 11:10:10.127725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.127447    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 11:10:10.173794 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:10.173775    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.202188 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.202162    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 11:05:09 +0000 UTC" deadline="2028-01-15 12:52:45.930718623 +0000 UTC"
Jul 23 11:10:10.202188 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.202185    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12985h42m35.728537101s"
Jul 23 11:10:10.274460 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:10.274443    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.375435 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:10.375415    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.377949 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:10.377913    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf50aae12e69e2f8a51417b14d5fe036.slice/crio-42225c8c94f3aaea7d97df4046c0c1f5ff15da384b8a8e6bcfcbc81f98511ef9 WatchSource:0}: Error finding container 42225c8c94f3aaea7d97df4046c0c1f5ff15da384b8a8e6bcfcbc81f98511ef9: Status 404 returned error can't find the container with id 42225c8c94f3aaea7d97df4046c0c1f5ff15da384b8a8e6bcfcbc81f98511ef9
Jul 23 11:10:10.381652 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.381638    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:10:10.434268 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.434243    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:10:10.441751 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.441731    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:10:10.475992 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:10.475973    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.576414 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:10.576365    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found"
Jul 23 11:10:10.606724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.606703    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:10:10.683244 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.683225    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:10.696972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.696955    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 11:10:10.697836 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.697823    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"
Jul 23 11:10:10.712710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:10.712692    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 11:10:10.745543 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:10.745524    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55fef534baa21e90d350e1062068982.slice/crio-e2ba72678b97295e98550260bd014fca63b6b0ccb7e69f95c644183144e3768b WatchSource:0}: Error finding container e2ba72678b97295e98550260bd014fca63b6b0ccb7e69f95c644183144e3768b: Status 404 returned error can't find the container with id e2ba72678b97295e98550260bd014fca63b6b0ccb7e69f95c644183144e3768b
Jul 23 11:10:11.162262 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.162239    2578 apiserver.go:52] "Watching apiserver"
Jul 23 11:10:11.171258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.171238    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 11:10:11.171674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.171644    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-5g24p","kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l","openshift-cluster-node-tuning-operator/tuned-d2zvl","openshift-dns/node-resolver-b2xgb","openshift-image-registry/node-ca-vphwl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal","openshift-multus/multus-4q8g5","kube-system/global-pull-secret-syncer-6xkjn","openshift-multus/multus-additional-cni-plugins-gb6sq","openshift-multus/network-metrics-daemon-b8svt","openshift-network-diagnostics/network-check-target-jmsx7","openshift-network-operator/iptables-alerter-b6zcz","openshift-ovn-kubernetes/ovnkube-node-6zdz9"]
Jul 23 11:10:11.174211 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.174192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.177154 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177125    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.177712 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177689    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 11:10:11.177806 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177730    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 11:10:11.177806 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lxvpr\""
Jul 23 11:10:11.177910 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177803    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.177910 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177697    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 11:10:11.177910 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.177693    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.179321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.179301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.179805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.179784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7n6f\""
Jul 23 11:10:11.179909 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.179895    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 11:10:11.180042 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.180018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.180164 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.180148    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.181517 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.181455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zkn2r\""
Jul 23 11:10:11.181624 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.181503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.182069 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.182054    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.182549 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.182532    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 11:10:11.182646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.182627    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 11:10:11.182986 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.182950    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.183826 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.183807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.184201 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.184183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.184201 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.184194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.184329 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.184317    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w6xbc\""
Jul 23 11:10:11.187684 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.186203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.187684 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.186365    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.187684 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.186520    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.187684 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.186682    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q2ztt\""
Jul 23 11:10:11.188901 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.188883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.189001 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.188973    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:11.189129 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.189116    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.189620 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.189591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ftpzq\""
Jul 23 11:10:11.189922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.189905    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.190320 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.190289    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 11:10:11.191313 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.191296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.194018 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.193999    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 11:10:11.194114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.193997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da18810f-56d3-44eb-9284-9f360efd769c-tmp\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-system-cni-dir\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.194114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba51f484-6c8a-47ba-a730-897c2425f221-host-slash\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.194114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-sys-fs\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvrg\" (UniqueName: \"kubernetes.io/projected/da18810f-56d3-44eb-9284-9f360efd769c-kube-api-access-whvrg\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-registration-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysctl-d\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cni-binary-copy\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2jx2j\""
Jul 23 11:10:11.194376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194362    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysconfig\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-systemd\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-lib-modules\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cnibin\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5ss\" (UniqueName: \"kubernetes.io/projected/ba51f484-6c8a-47ba-a730-897c2425f221-kube-api-access-lx5ss\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-socket-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-device-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-var-lib-kubelet\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.194657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-host\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab206a7-a67f-4b16-9d4d-55775dc248c9-hosts-file\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-os-release\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba51f484-6c8a-47ba-a730-897c2425f221-iptables-alerter-script\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvtq\" (UniqueName: \"kubernetes.io/projected/10700591-85fa-4d84-9e85-d56db933b66c-kube-api-access-wzvtq\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-run\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab206a7-a67f-4b16-9d4d-55775dc248c9-tmp-dir\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-modprobe-d\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-kubernetes\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194963    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.194979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysctl-conf\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da18810f-56d3-44eb-9284-9f360efd769c-etc-tuned\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2d9q\" (UniqueName: \"kubernetes.io/projected/aab206a7-a67f-4b16-9d4d-55775dc248c9-kube-api-access-q2d9q\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-282tk\" (UniqueName: \"kubernetes.io/projected/9413a10a-efcd-48c3-bc00-8be7e2d8d849-kube-api-access-282tk\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-etc-selinux\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-sys\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195312    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195371    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 11:10:11.195654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.195376    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 11:10:11.196404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.196384    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 11:10:11.197299 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.197280    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 11:10:11.197398 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.197312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.197458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.197419    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2n6rh\""
Jul 23 11:10:11.199726 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.199682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.199819 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.199784    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:11.200081 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.200062    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 11:10:11.200546 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.200531    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 11:10:11.200680 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.200665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8p45v\""
Jul 23 11:10:11.202083 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.202065    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:11.202167 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.202143    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:11.222075 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.222056    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7cf9"
Jul 23 11:10:11.234094 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.234078    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7cf9"
Jul 23 11:10:11.283906 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.283879    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 11:10:11.295893 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.295870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-cni-bin\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.296007 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.295904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf4j5\" (UniqueName: \"kubernetes.io/projected/dd4d0263-b791-46b7-943e-9a20d96bcb6c-kube-api-access-wf4j5\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.296007 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.295932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysctl-d\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.296007 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.295957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.296119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.296119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cni-binary-copy\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.296119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysctl-d\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.296119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-system-cni-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c695be04-8b12-47ea-a6e7-13920359544b-konnectivity-ca\") pod \"konnectivity-agent-5g24p\" (UID: \"c695be04-8b12-47ea-a6e7-13920359544b\") " pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f32602e-69a4-48a7-8841-0e1ef0600081-dbus\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-log-socket\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-daemon-config\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.296297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cnibin\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cnibin\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5ss\" (UniqueName: \"kubernetes.io/projected/ba51f484-6c8a-47ba-a730-897c2425f221-kube-api-access-lx5ss\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-device-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-var-lib-kubelet\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-systemd\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-os-release\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-run\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-os-release\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-run-netns\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-kubernetes\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.296600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da18810f-56d3-44eb-9284-9f360efd769c-etc-tuned\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-device-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-kubernetes\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-kubelet\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cni-binary-copy\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-var-lib-kubelet\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-conf-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369dab9d-4a01-4c58-b914-a51165a15b46-host\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-var-lib-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-os-release\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da18810f-56d3-44eb-9284-9f360efd769c-tmp\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-socket-dir-parent\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296915    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.296982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-run\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-k8s-cni-cncf-io\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-cni-bin\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f32602e-69a4-48a7-8841-0e1ef0600081-kubelet-config\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-env-overrides\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba51f484-6c8a-47ba-a730-897c2425f221-host-slash\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba51f484-6c8a-47ba-a730-897c2425f221-host-slash\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c695be04-8b12-47ea-a6e7-13920359544b-agent-certs\") pod \"konnectivity-agent-5g24p\" (UID: \"c695be04-8b12-47ea-a6e7-13920359544b\") " pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-kubelet\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-systemd-units\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-registration-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-cni-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-cnibin\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-hostroot\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-registration-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/369dab9d-4a01-4c58-b914-a51165a15b46-serviceca\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovnkube-config\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.297957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysconfig\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c068fdaa-072c-41d5-baff-f5351b43b4b0-cni-binary-copy\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-slash\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysconfig\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-systemd\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-lib-modules\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovnkube-script-lib\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-systemd\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-socket-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-host\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab206a7-a67f-4b16-9d4d-55775dc248c9-hosts-file\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab206a7-a67f-4b16-9d4d-55775dc248c9-tmp-dir\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-lib-modules\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-netns\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-socket-dir\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.298761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aab206a7-a67f-4b16-9d4d-55775dc248c9-hosts-file\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-node-log\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-host\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba51f484-6c8a-47ba-a730-897c2425f221-iptables-alerter-script\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.297980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvtq\" (UniqueName: \"kubernetes.io/projected/10700591-85fa-4d84-9e85-d56db933b66c-kube-api-access-wzvtq\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-cni-multus\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-etc-kubernetes\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45zv7\" (UniqueName: \"kubernetes.io/projected/c068fdaa-072c-41d5-baff-f5351b43b4b0-kube-api-access-45zv7\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6t5p\" (UniqueName: \"kubernetes.io/projected/2949fccc-8b43-42a4-89e2-48d257ab3736-kube-api-access-f6t5p\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-modprobe-d\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysctl-conf\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab206a7-a67f-4b16-9d4d-55775dc248c9-tmp-dir\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2d9q\" (UniqueName: \"kubernetes.io/projected/aab206a7-a67f-4b16-9d4d-55775dc248c9-kube-api-access-q2d9q\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5trp\" (UniqueName: \"kubernetes.io/projected/369dab9d-4a01-4c58-b914-a51165a15b46-kube-api-access-x5trp\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.299535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovn-node-metrics-cert\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-282tk\" (UniqueName: \"kubernetes.io/projected/9413a10a-efcd-48c3-bc00-8be7e2d8d849-kube-api-access-282tk\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-etc-selinux\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-sys\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-multus-certs\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-ovn\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-cni-netd\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-system-cni-dir\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba51f484-6c8a-47ba-a730-897c2425f221-iptables-alerter-script\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-sys-fs\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvrg\" (UniqueName: \"kubernetes.io/projected/da18810f-56d3-44eb-9284-9f360efd769c-kube-api-access-whvrg\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-sys-fs\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10700591-85fa-4d84-9e85-d56db933b66c-etc-selinux\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-sys\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9413a10a-efcd-48c3-bc00-8be7e2d8d849-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9413a10a-efcd-48c3-bc00-8be7e2d8d849-system-cni-dir\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.298925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-modprobe-d\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.300159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.299014    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da18810f-56d3-44eb-9284-9f360efd769c-etc-sysctl-conf\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.300742 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.299047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-etc-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.300742 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.299995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da18810f-56d3-44eb-9284-9f360efd769c-etc-tuned\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.300742 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.300028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da18810f-56d3-44eb-9284-9f360efd769c-tmp\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.308105 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.308082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5ss\" (UniqueName: \"kubernetes.io/projected/ba51f484-6c8a-47ba-a730-897c2425f221-kube-api-access-lx5ss\") pod \"iptables-alerter-b6zcz\" (UID: \"ba51f484-6c8a-47ba-a730-897c2425f221\") " pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.308575 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.308548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvrg\" (UniqueName: \"kubernetes.io/projected/da18810f-56d3-44eb-9284-9f360efd769c-kube-api-access-whvrg\") pod \"tuned-d2zvl\" (UID: \"da18810f-56d3-44eb-9284-9f360efd769c\") " pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.308796 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.308760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2d9q\" (UniqueName: \"kubernetes.io/projected/aab206a7-a67f-4b16-9d4d-55775dc248c9-kube-api-access-q2d9q\") pod \"node-resolver-b2xgb\" (UID: \"aab206a7-a67f-4b16-9d4d-55775dc248c9\") " pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.309171 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.309154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvtq\" (UniqueName: \"kubernetes.io/projected/10700591-85fa-4d84-9e85-d56db933b66c-kube-api-access-wzvtq\") pod \"aws-ebs-csi-driver-node-txq6l\" (UID: \"10700591-85fa-4d84-9e85-d56db933b66c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.309332 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.309313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-282tk\" (UniqueName: \"kubernetes.io/projected/9413a10a-efcd-48c3-bc00-8be7e2d8d849-kube-api-access-282tk\") pod \"multus-additional-cni-plugins-gb6sq\" (UID: \"9413a10a-efcd-48c3-bc00-8be7e2d8d849\") " pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.316514 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.316472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" event={"ID":"f55fef534baa21e90d350e1062068982","Type":"ContainerStarted","Data":"e2ba72678b97295e98550260bd014fca63b6b0ccb7e69f95c644183144e3768b"}
Jul 23 11:10:11.317547 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.317527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" event={"ID":"cf50aae12e69e2f8a51417b14d5fe036","Type":"ContainerStarted","Data":"42225c8c94f3aaea7d97df4046c0c1f5ff15da384b8a8e6bcfcbc81f98511ef9"}
Jul 23 11:10:11.400095 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c695be04-8b12-47ea-a6e7-13920359544b-agent-certs\") pod \"konnectivity-agent-5g24p\" (UID: \"c695be04-8b12-47ea-a6e7-13920359544b\") " pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.400207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-kubelet\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-systemd-units\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-systemd-units\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-kubelet\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-cni-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-cnibin\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-hostroot\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/369dab9d-4a01-4c58-b914-a51165a15b46-serviceca\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovnkube-config\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-cnibin\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c068fdaa-072c-41d5-baff-f5351b43b4b0-cni-binary-copy\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-cni-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.400498 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-slash\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovnkube-script-lib\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-slash\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-hostroot\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-netns\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-netns\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-node-log\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-cni-multus\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-etc-kubernetes\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45zv7\" (UniqueName: \"kubernetes.io/projected/c068fdaa-072c-41d5-baff-f5351b43b4b0-kube-api-access-45zv7\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6t5p\" (UniqueName: \"kubernetes.io/projected/2949fccc-8b43-42a4-89e2-48d257ab3736-kube-api-access-f6t5p\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5trp\" (UniqueName: \"kubernetes.io/projected/369dab9d-4a01-4c58-b914-a51165a15b46-kube-api-access-x5trp\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovn-node-metrics-cert\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-multus-certs\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/369dab9d-4a01-4c58-b914-a51165a15b46-serviceca\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.400992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-ovn\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-cni-netd\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovnkube-config\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-etc-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-cni-bin\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.401083    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovnkube-script-lib\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf4j5\" (UniqueName: \"kubernetes.io/projected/dd4d0263-b791-46b7-943e-9a20d96bcb6c-kube-api-access-wf4j5\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.401211    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:11.901189402 +0000 UTC m=+3.028052816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-cni-multus\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-node-log\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-etc-kubernetes\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-cni-bin\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-etc-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c068fdaa-072c-41d5-baff-f5351b43b4b0-cni-binary-copy\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-cni-netd\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401576    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-ovn\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.401980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-multus-certs\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-system-cni-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c695be04-8b12-47ea-a6e7-13920359544b-konnectivity-ca\") pod \"konnectivity-agent-5g24p\" (UID: \"c695be04-8b12-47ea-a6e7-13920359544b\") " pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f32602e-69a4-48a7-8841-0e1ef0600081-dbus\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-system-cni-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.401757    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-log-socket\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-log-socket\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-daemon-config\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.401827    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:11.901809361 +0000 UTC m=+3.028672776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f32602e-69a4-48a7-8841-0e1ef0600081-dbus\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-systemd\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-run-systemd\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-os-release\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-run-netns\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.402767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-os-release\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-kubelet\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-conf-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.401993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-host-run-netns\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369dab9d-4a01-4c58-b914-a51165a15b46-host\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-kubelet\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-conf-dir\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369dab9d-4a01-4c58-b914-a51165a15b46-host\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-var-lib-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-socket-dir-parent\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4d0263-b791-46b7-943e-9a20d96bcb6c-var-lib-openvswitch\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-k8s-cni-cncf-io\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c695be04-8b12-47ea-a6e7-13920359544b-konnectivity-ca\") pod \"konnectivity-agent-5g24p\" (UID: \"c695be04-8b12-47ea-a6e7-13920359544b\") " pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-run-k8s-cni-cncf-io\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-daemon-config\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-multus-socket-dir-parent\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-cni-bin\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f32602e-69a4-48a7-8841-0e1ef0600081-kubelet-config\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.403458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-env-overrides\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.404016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c068fdaa-072c-41d5-baff-f5351b43b4b0-host-var-lib-cni-bin\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.404016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f32602e-69a4-48a7-8841-0e1ef0600081-kubelet-config\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.404016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c695be04-8b12-47ea-a6e7-13920359544b-agent-certs\") pod \"konnectivity-agent-5g24p\" (UID: \"c695be04-8b12-47ea-a6e7-13920359544b\") " pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.404016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.402842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd4d0263-b791-46b7-943e-9a20d96bcb6c-env-overrides\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.404016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.403364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd4d0263-b791-46b7-943e-9a20d96bcb6c-ovn-node-metrics-cert\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.410087 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.410067    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:11.410166 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.410094    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:11.410166 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.410109    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:11.410240 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.410173    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:11.910157245 +0000 UTC m=+3.037020666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:11.411154 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.411129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6t5p\" (UniqueName: \"kubernetes.io/projected/2949fccc-8b43-42a4-89e2-48d257ab3736-kube-api-access-f6t5p\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.412743 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.412696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45zv7\" (UniqueName: \"kubernetes.io/projected/c068fdaa-072c-41d5-baff-f5351b43b4b0-kube-api-access-45zv7\") pod \"multus-4q8g5\" (UID: \"c068fdaa-072c-41d5-baff-f5351b43b4b0\") " pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.413512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.413487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf4j5\" (UniqueName: \"kubernetes.io/projected/dd4d0263-b791-46b7-943e-9a20d96bcb6c-kube-api-access-wf4j5\") pod \"ovnkube-node-6zdz9\" (UID: \"dd4d0263-b791-46b7-943e-9a20d96bcb6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.413695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.413679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5trp\" (UniqueName: \"kubernetes.io/projected/369dab9d-4a01-4c58-b914-a51165a15b46-kube-api-access-x5trp\") pod \"node-ca-vphwl\" (UID: \"369dab9d-4a01-4c58-b914-a51165a15b46\") " pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.490026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.489994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gb6sq"
Jul 23 11:10:11.494045 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.494016    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6zcz"
Jul 23 11:10:11.504844 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.504824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l"
Jul 23 11:10:11.509450 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.509435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4q8g5"
Jul 23 11:10:11.516017 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.516000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2zvl"
Jul 23 11:10:11.522570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.522553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2xgb"
Jul 23 11:10:11.529348 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.529320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vphwl"
Jul 23 11:10:11.529888 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.529867    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 11:10:11.536344 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.536324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:11.544036 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.544017    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:11.570249 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.570225    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc695be04_8b12_47ea_a6e7_13920359544b.slice/crio-0f60633c047c3aee26041c80b4280296c29385e3c0c1dbd6af0a8ca23a0242c7 WatchSource:0}: Error finding container 0f60633c047c3aee26041c80b4280296c29385e3c0c1dbd6af0a8ca23a0242c7: Status 404 returned error can't find the container with id 0f60633c047c3aee26041c80b4280296c29385e3c0c1dbd6af0a8ca23a0242c7
Jul 23 11:10:11.571863 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.571839    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4d0263_b791_46b7_943e_9a20d96bcb6c.slice/crio-61d275864cbb262170cbd4d3ef92ef62ea18d13e033d79cbb696d1865d1d1bc6 WatchSource:0}: Error finding container 61d275864cbb262170cbd4d3ef92ef62ea18d13e033d79cbb696d1865d1d1bc6: Status 404 returned error can't find the container with id 61d275864cbb262170cbd4d3ef92ef62ea18d13e033d79cbb696d1865d1d1bc6
Jul 23 11:10:11.576042 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.575859    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369dab9d_4a01_4c58_b914_a51165a15b46.slice/crio-97d0f7e03a276aead923a951e37d11e9d603c8fa86b43ec9f067e2e6179deac5 WatchSource:0}: Error finding container 97d0f7e03a276aead923a951e37d11e9d603c8fa86b43ec9f067e2e6179deac5: Status 404 returned error can't find the container with id 97d0f7e03a276aead923a951e37d11e9d603c8fa86b43ec9f067e2e6179deac5
Jul 23 11:10:11.578682 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.578658    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10700591_85fa_4d84_9e85_d56db933b66c.slice/crio-5fbf96f429fed63d53b2ee2b73eced5e1835d81650c2324d8f5e6e97e659b10d WatchSource:0}: Error finding container 5fbf96f429fed63d53b2ee2b73eced5e1835d81650c2324d8f5e6e97e659b10d: Status 404 returned error can't find the container with id 5fbf96f429fed63d53b2ee2b73eced5e1835d81650c2324d8f5e6e97e659b10d
Jul 23 11:10:11.579154 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.579126    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9413a10a_efcd_48c3_bc00_8be7e2d8d849.slice/crio-ab87cce3ae940e00b927fe5d3504f1d0ed01f2ddd6edd3ce00fa039096e94075 WatchSource:0}: Error finding container ab87cce3ae940e00b927fe5d3504f1d0ed01f2ddd6edd3ce00fa039096e94075: Status 404 returned error can't find the container with id ab87cce3ae940e00b927fe5d3504f1d0ed01f2ddd6edd3ce00fa039096e94075
Jul 23 11:10:11.580162 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.580002    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc068fdaa_072c_41d5_baff_f5351b43b4b0.slice/crio-1a625b1ad4e882150289c63def0bcc8efe72212b0948e8b82ac349d6f720a9f0 WatchSource:0}: Error finding container 1a625b1ad4e882150289c63def0bcc8efe72212b0948e8b82ac349d6f720a9f0: Status 404 returned error can't find the container with id 1a625b1ad4e882150289c63def0bcc8efe72212b0948e8b82ac349d6f720a9f0
Jul 23 11:10:11.580899 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.580720    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab206a7_a67f_4b16_9d4d_55775dc248c9.slice/crio-163df1037d0c58daab5a5f6e3c00090d4a996de8e07af858b494bc6af817c7fe WatchSource:0}: Error finding container 163df1037d0c58daab5a5f6e3c00090d4a996de8e07af858b494bc6af817c7fe: Status 404 returned error can't find the container with id 163df1037d0c58daab5a5f6e3c00090d4a996de8e07af858b494bc6af817c7fe
Jul 23 11:10:11.581424 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.581367    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda18810f_56d3_44eb_9284_9f360efd769c.slice/crio-06fd51493d4c5d462da2f28fdcc32241f083ca9d921484c0a47df3fba1c9008c WatchSource:0}: Error finding container 06fd51493d4c5d462da2f28fdcc32241f083ca9d921484c0a47df3fba1c9008c: Status 404 returned error can't find the container with id 06fd51493d4c5d462da2f28fdcc32241f083ca9d921484c0a47df3fba1c9008c
Jul 23 11:10:11.582154 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:11.582106    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba51f484_6c8a_47ba_a730_897c2425f221.slice/crio-b8a74d291619b0bd05739a712893f76d67351b490407ece8cb2dbf5827767900 WatchSource:0}: Error finding container b8a74d291619b0bd05739a712893f76d67351b490407ece8cb2dbf5827767900: Status 404 returned error can't find the container with id b8a74d291619b0bd05739a712893f76d67351b490407ece8cb2dbf5827767900
Jul 23 11:10:11.905966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.905940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:11.906096 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:11.905998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:11.906144 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.906095    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:11.906188 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.906162    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:12.906143725 +0000 UTC m=+4.033007133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:11.906241 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.906099    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:11.906298 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:11.906251    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:12.906233832 +0000 UTC m=+4.033097239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:12.006543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.006515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:12.006738 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.006676    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:12.006738 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.006694    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:12.006738 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.006703    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:12.006888 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.006752    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:13.006739615 +0000 UTC m=+4.133603020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:12.237695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.237496    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 11:05:11 +0000 UTC" deadline="2028-02-19 18:47:12.819571705 +0000 UTC"
Jul 23 11:10:12.237695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.237557    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13831h37m0.582018663s"
Jul 23 11:10:12.325152 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.325110    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf50aae12e69e2f8a51417b14d5fe036" containerID="bb89bc64a1b88bb3827a20b78b9cc6238a0205fbb61e52cf88a5a98b86b485dc" exitCode=0
Jul 23 11:10:12.325301 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.325240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" event={"ID":"cf50aae12e69e2f8a51417b14d5fe036","Type":"ContainerDied","Data":"bb89bc64a1b88bb3827a20b78b9cc6238a0205fbb61e52cf88a5a98b86b485dc"}
Jul 23 11:10:12.327493 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.327460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2zvl" event={"ID":"da18810f-56d3-44eb-9284-9f360efd769c","Type":"ContainerStarted","Data":"06fd51493d4c5d462da2f28fdcc32241f083ca9d921484c0a47df3fba1c9008c"}
Jul 23 11:10:12.328925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.328852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2xgb" event={"ID":"aab206a7-a67f-4b16-9d4d-55775dc248c9","Type":"ContainerStarted","Data":"163df1037d0c58daab5a5f6e3c00090d4a996de8e07af858b494bc6af817c7fe"}
Jul 23 11:10:12.331561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.331497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4q8g5" event={"ID":"c068fdaa-072c-41d5-baff-f5351b43b4b0","Type":"ContainerStarted","Data":"1a625b1ad4e882150289c63def0bcc8efe72212b0948e8b82ac349d6f720a9f0"}
Jul 23 11:10:12.335589 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.335565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6zcz" event={"ID":"ba51f484-6c8a-47ba-a730-897c2425f221","Type":"ContainerStarted","Data":"b8a74d291619b0bd05739a712893f76d67351b490407ece8cb2dbf5827767900"}
Jul 23 11:10:12.337352 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.337328    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerStarted","Data":"ab87cce3ae940e00b927fe5d3504f1d0ed01f2ddd6edd3ce00fa039096e94075"}
Jul 23 11:10:12.342021 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.341997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l" event={"ID":"10700591-85fa-4d84-9e85-d56db933b66c","Type":"ContainerStarted","Data":"5fbf96f429fed63d53b2ee2b73eced5e1835d81650c2324d8f5e6e97e659b10d"}
Jul 23 11:10:12.343725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.343702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vphwl" event={"ID":"369dab9d-4a01-4c58-b914-a51165a15b46","Type":"ContainerStarted","Data":"97d0f7e03a276aead923a951e37d11e9d603c8fa86b43ec9f067e2e6179deac5"}
Jul 23 11:10:12.348021 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.347997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"61d275864cbb262170cbd4d3ef92ef62ea18d13e033d79cbb696d1865d1d1bc6"}
Jul 23 11:10:12.349855 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.349831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5g24p" event={"ID":"c695be04-8b12-47ea-a6e7-13920359544b","Type":"ContainerStarted","Data":"0f60633c047c3aee26041c80b4280296c29385e3c0c1dbd6af0a8ca23a0242c7"}
Jul 23 11:10:12.916185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.916150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:12.916357 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:12.916223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:12.916357 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.916314    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:12.916357 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.916352    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:12.916518 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.916398    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:14.916378234 +0000 UTC m=+6.043241650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:12.916518 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:12.916419    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:14.916410175 +0000 UTC m=+6.043273582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:13.017437 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:13.017401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:13.017652 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.017563    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:13.017652 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.017585    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:13.017652 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.017598    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:13.017863 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.017675    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:15.017657175 +0000 UTC m=+6.144520580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:13.238732 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:13.238628    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 11:05:11 +0000 UTC" deadline="2028-01-30 01:28:48.773109112 +0000 UTC"
Jul 23 11:10:13.238732 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:13.238666    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13334h18m35.534446966s"
Jul 23 11:10:13.314938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:13.314124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:13.314938 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.314257    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:13.314938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:13.314677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:13.314938 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.314764    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:13.314938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:13.314820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:13.314938 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:13.314888    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:14.934108 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:14.934068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:14.934788 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:14.934160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:14.934788 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:14.934320    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:14.934788 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:14.934381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:18.93436231 +0000 UTC m=+10.061225755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:14.934977 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:14.934799    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:14.934977 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:14.934854    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:18.934837601 +0000 UTC m=+10.061701025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:15.035189 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:15.035155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:15.035368 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.035352    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:15.035464 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.035377    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:15.035464 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.035391    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:15.035464 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.035446    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:19.035428921 +0000 UTC m=+10.162292325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:15.311891 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:15.311843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:15.311891 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:15.311859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:15.312132 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.311988    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:15.312132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:15.312042    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:15.312229 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.312152    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:15.312281 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:15.312228    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:17.311844 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:17.311814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:17.312321 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:17.311921    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:17.312321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:17.311976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:17.312321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:17.311982    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:17.312321 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:17.312045    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:17.312321 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:17.312152    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:18.969624 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:18.969567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:18.970059 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:18.969727    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:18.970059 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:18.969780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:18.970059 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:18.969805    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:26.969783966 +0000 UTC m=+18.096647368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:18.970059 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:18.969868    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:18.971667 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:18.970356    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:26.970333253 +0000 UTC m=+18.097196670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:19.070587 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:19.070541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:19.070783 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.070703    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:19.070783 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.070721    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:19.070783 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.070734    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:19.070912 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.070786    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:27.070768667 +0000 UTC m=+18.197632085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:19.312745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:19.312704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:19.312745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:19.312726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:19.313010 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.312818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:19.313010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:19.312866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:19.313010 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.312958    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:19.313218 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:19.313038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:21.311781 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:21.311751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:21.312219 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:21.311886    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:21.312219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:21.311765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:21.312219 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:21.311974    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:21.312219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:21.311757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:21.312437 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:21.312409    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:23.311707 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:23.311667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:23.312144 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:23.311667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:23.312144 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:23.311893    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:23.312144 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:23.311797    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:23.312144 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:23.311667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:23.312144 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:23.311980    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:25.311675 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:25.311647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:25.311675 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:25.311671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:25.312150 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:25.311722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:25.312150 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:25.311825    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:25.312150 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:25.311885    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:25.312150 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:25.311943    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:27.034179 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:27.034138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:27.034668 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:27.034208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:27.034668 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.034340    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:27.034668 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.034415    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:43.034393478 +0000 UTC m=+34.161256879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:27.034668 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.034340    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:27.034668 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.034518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:43.034495974 +0000 UTC m=+34.161359377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:27.134750 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:27.134711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:27.134913 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.134869    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:27.134913 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.134897    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:27.134913 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.134907    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:27.135086 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.134970    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:43.13494815 +0000 UTC m=+34.261811553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:27.311342 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:27.311262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:27.311489 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:27.311268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:27.311489 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:27.311404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:27.311489 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.311398    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:27.311658 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.311530    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:27.311658 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:27.311602    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:29.312549 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:29.312516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:29.312992 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:29.312650    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:29.312992 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:29.312755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:29.312992 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:29.312782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:29.312992 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:29.312883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:29.312992 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:29.312979    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:30.402016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.401852    2578 generic.go:356] "Generic (PLEG): container finished" podID="9413a10a-efcd-48c3-bc00-8be7e2d8d849" containerID="d0baa4bb7696df84d884dae1384cc165f41a379df2c8b1a088b6f9b2b37b9bf2" exitCode=0
Jul 23 11:10:30.402562 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.401957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerDied","Data":"d0baa4bb7696df84d884dae1384cc165f41a379df2c8b1a088b6f9b2b37b9bf2"}
Jul 23 11:10:30.404292 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.404268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l" event={"ID":"10700591-85fa-4d84-9e85-d56db933b66c","Type":"ContainerStarted","Data":"6a983781b9ab2065d9fcabcc0a82ec9a90d309b14b683b78db4cae8fb4804989"}
Jul 23 11:10:30.405664 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.405640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vphwl" event={"ID":"369dab9d-4a01-4c58-b914-a51165a15b46","Type":"ContainerStarted","Data":"22db3985e9ef302639d657f94d4d40c06142bdb3165fd42d5c30f70d2d5be02b"}
Jul 23 11:10:30.407169 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.407131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5g24p" event={"ID":"c695be04-8b12-47ea-a6e7-13920359544b","Type":"ContainerStarted","Data":"bfc638a5213043dd7f0145abe85cf546c0c270b7baf91e68f2409a7c80ec2cc6"}
Jul 23 11:10:30.408664 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.408644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" event={"ID":"f55fef534baa21e90d350e1062068982","Type":"ContainerStarted","Data":"c83a99a17569b0ef6cdb5b7e8f1262c444e42353c2a4e2bf28664085abc33b35"}
Jul 23 11:10:30.410627 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.410590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" event={"ID":"cf50aae12e69e2f8a51417b14d5fe036","Type":"ContainerStarted","Data":"68bff8f57a905de3c6a65c07d0443e82a51add1e9d6388bb6a08d59c9b109fce"}
Jul 23 11:10:30.412097 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.412079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2zvl" event={"ID":"da18810f-56d3-44eb-9284-9f360efd769c","Type":"ContainerStarted","Data":"5a2b0a2b53342b2132b9aa213534c7629003534b60b124c22ac82b1a98265972"}
Jul 23 11:10:30.413722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.413663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2xgb" event={"ID":"aab206a7-a67f-4b16-9d4d-55775dc248c9","Type":"ContainerStarted","Data":"b601d2658d819a49d6838e8e6f17a10e53339e2c1b2e0ec29b33f22a2721f28f"}
Jul 23 11:10:30.415274 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.415249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4q8g5" event={"ID":"c068fdaa-072c-41d5-baff-f5351b43b4b0","Type":"ContainerStarted","Data":"b7b152e466f7a35f5d210fd9915a9f34a183a7134cfbc3d372adfa820725abc2"}
Jul 23 11:10:30.505382 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.505335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d2zvl" podStartSLOduration=3.251251577 podStartE2EDuration="21.505320515s" totalImagesPullingTime="18.254068938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.468160981 +0000 UTC m=+21.595024403" watchObservedRunningTime="2026-07-23 11:10:30.505320515 +0000 UTC m=+21.632183974"
Jul 23 11:10:30.505619 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.505516    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4q8g5" podStartSLOduration=3.167466688 podStartE2EDuration="21.505510932s" totalImagesPullingTime="18.338044244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.505150144 +0000 UTC m=+21.632013570" watchObservedRunningTime="2026-07-23 11:10:30.505510932 +0000 UTC m=+21.632374356"
Jul 23 11:10:30.548908 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.548870    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" podStartSLOduration=20.548854044 podStartE2EDuration="20.548854044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.526739989 +0000 UTC m=+21.653603411" watchObservedRunningTime="2026-07-23 11:10:30.548854044 +0000 UTC m=+21.675717468"
Jul 23 11:10:30.571184 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.571143    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" podStartSLOduration=20.571125452 podStartE2EDuration="20.571125452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.549366631 +0000 UTC m=+21.676230052" watchObservedRunningTime="2026-07-23 11:10:30.571125452 +0000 UTC m=+21.697988933"
Jul 23 11:10:30.571380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.571357    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b2xgb" podStartSLOduration=3.299659602 podStartE2EDuration="21.571350279s" totalImagesPullingTime="18.271690677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.571185235 +0000 UTC m=+21.698048640" watchObservedRunningTime="2026-07-23 11:10:30.571350279 +0000 UTC m=+21.698213698"
Jul 23 11:10:30.608730 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.608284    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vphwl" podStartSLOduration=3.327262232 podStartE2EDuration="21.608273189s" totalImagesPullingTime="18.281010957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.607767398 +0000 UTC m=+21.734630830" watchObservedRunningTime="2026-07-23 11:10:30.608273189 +0000 UTC m=+21.735136613"
Jul 23 11:10:30.630419 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.630310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5g24p" podStartSLOduration=3.327449891 podStartE2EDuration="21.630298332s" totalImagesPullingTime="18.302848441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:30.628768559 +0000 UTC m=+21.755631981" watchObservedRunningTime="2026-07-23 11:10:30.630298332 +0000 UTC m=+21.757161754"
Jul 23 11:10:30.683905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.683876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:30.772128 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:30.772103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:31.311946 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.311915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:31.312156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.312042    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:31.312156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.312046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:31.312156 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:31.312061    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:31.312156 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:31.312134    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:31.312390 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:31.312144    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:31.420074 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.420034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"5e2b13cfc8adfdbfd9152cf50f5240536854e5460ab0dd9c540c7a28a54d1fc0"}
Jul 23 11:10:31.420724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.420125    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"737fb0a01a28fce4f06ccf382682b2ce932a206bc9b1d8fde00784af0ae477a7"}
Jul 23 11:10:31.420724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.420176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"41537f6c5c1b1d7f97bada74eb3bcd6a5ea1515bf109f0a083a70b1809a90fe6"}
Jul 23 11:10:31.420724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.420220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"2418771868f9a8fd004fc7d3c04e8976aa384d161a7dbeb1b91def5776046c7e"}
Jul 23 11:10:31.420724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.420260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"8f2e50e43c46e9798aee69639c2a5de4741f51144694d4052cf7a75995ec8543"}
Jul 23 11:10:31.420724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.420296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"b1338e4ff53f1d4d1f33e6c4d14ecf2cb8db37e00221933c0bcf327b07f6f444"}
Jul 23 11:10:31.421363 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.421341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6zcz" event={"ID":"ba51f484-6c8a-47ba-a730-897c2425f221","Type":"ContainerStarted","Data":"9f82eff1d895ea62086d448e552c52c48fb6e5fad4f0723489d12169e39826d3"}
Jul 23 11:10:31.441317 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.441281    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b6zcz" podStartSLOduration=4.187307494 podStartE2EDuration="22.441267724s" totalImagesPullingTime="18.25396023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:31.440976886 +0000 UTC m=+22.567840432" watchObservedRunningTime="2026-07-23 11:10:31.441267724 +0000 UTC m=+22.568131147"
Jul 23 11:10:31.579377 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.579348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:31.589895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.589877    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 11:10:31.678425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.678401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:31.779373 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.779345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:31.843171 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:31.843103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:32.251060 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:32.250922    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T11:10:31.589890469Z","UUID":"56f1ec7e-0c19-47f5-bebb-16c57f26ec7b","Handler":null,"Name":"","Endpoint":""}
Jul 23 11:10:32.253687 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:32.253663    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 11:10:32.253830 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:32.253705    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 11:10:32.426526 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:32.426487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l" event={"ID":"10700591-85fa-4d84-9e85-d56db933b66c","Type":"ContainerStarted","Data":"98def80857298446b6d525ff9cdb33ebea2649fc0bcef2cb844ae2ee36e6a865"}
Jul 23 11:10:33.312277 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.312054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:33.312438 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.312078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:33.312438 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:33.312358    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:33.312552 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:33.312452    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:33.312552 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.312093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:33.312552 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:33.312535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:33.431322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.431243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l" event={"ID":"10700591-85fa-4d84-9e85-d56db933b66c","Type":"ContainerStarted","Data":"7d3a989291eaea304e25d70f4f96e4f3f266ca0519074c80019367bfffd1937e"}
Jul 23 11:10:33.435134 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.435107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"2b2da82cb94f8944293d1fa3d488c3c2481c338934fc55e260865d7e51e47f8b"}
Jul 23 11:10:33.654317 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.654293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:33.654889 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.654867    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:33.672336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:33.672299    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-txq6l" podStartSLOduration=8.137361381 podStartE2EDuration="24.672284215s" totalImagesPullingTime="16.534922834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:33.458490189 +0000 UTC m=+24.585353632" watchObservedRunningTime="2026-07-23 11:10:33.672284215 +0000 UTC m=+24.799147637"
Jul 23 11:10:34.437558 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:34.437523    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:34.438077 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:34.437925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5g24p"
Jul 23 11:10:34.512783 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:34.512751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:35.311799 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:35.311777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:35.311901 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:35.311806    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:35.311901 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:35.311777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:35.311901 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:35.311883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:35.312068 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:35.311936    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:35.312068 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:35.312043    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:35.447186 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:35.446989    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" event={"ID":"dd4d0263-b791-46b7-943e-9a20d96bcb6c","Type":"ContainerStarted","Data":"f82f115b7f0948f47437474a78633fd1c51e90bd8a621c4a00157dee552ec7ed"}
Jul 23 11:10:35.480545 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:35.480464    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9" podStartSLOduration=7.629173665 podStartE2EDuration="26.480450586s" totalImagesPullingTime="18.851276921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:35.480183344 +0000 UTC m=+26.607046767" watchObservedRunningTime="2026-07-23 11:10:35.480450586 +0000 UTC m=+26.607314026"
Jul 23 11:10:36.275133 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.275104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:36.345230 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.345202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:36.451098 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.451076    2578 generic.go:356] "Generic (PLEG): container finished" podID="9413a10a-efcd-48c3-bc00-8be7e2d8d849" containerID="3d5d82631421cc20e170666ea3685162254187df425b31eac4030bb8009245d1" exitCode=0
Jul 23 11:10:36.451450 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.451160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerDied","Data":"3d5d82631421cc20e170666ea3685162254187df425b31eac4030bb8009245d1"}
Jul 23 11:10:36.452420 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.451798    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:36.452420 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.451866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:36.452420 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.451921    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:36.467191 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.467169    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:36.467448 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:36.467434    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:10:37.311258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.311234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:37.311258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.311255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:37.311424 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.311235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:37.311424 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:37.311355    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:37.311521 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:37.311426    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:37.311521 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:37.311495    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:37.508792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.508765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jmsx7"]
Jul 23 11:10:37.509119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.508846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:37.509119 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:37.508914    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:37.511361 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.511332    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b8svt"]
Jul 23 11:10:37.511457 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.511444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:37.511583 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:37.511562    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:37.522618 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.522589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xkjn"]
Jul 23 11:10:37.522719 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:37.522686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:37.522778 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:37.522755    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:39.312733 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:39.312547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:39.313128 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:39.312842    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:39.313128 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:39.312644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:39.313128 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:39.312928    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:39.313128 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:39.312646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:39.313128 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:39.313007    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:39.459412 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:39.459383    2578 generic.go:356] "Generic (PLEG): container finished" podID="9413a10a-efcd-48c3-bc00-8be7e2d8d849" containerID="4793f296fff5ed6123805eff2dc11606c004371ab46c852730ae1a9ce3fc6a82" exitCode=0
Jul 23 11:10:39.459512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:39.459437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerDied","Data":"4793f296fff5ed6123805eff2dc11606c004371ab46c852730ae1a9ce3fc6a82"}
Jul 23 11:10:41.312235 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:41.312202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:41.312649 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:41.312202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:41.312649 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:41.312298    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:41.312649 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:41.312311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:41.312649 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:41.312380    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:41.312649 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:41.312437    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:42.466855 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:42.466829    2578 generic.go:356] "Generic (PLEG): container finished" podID="9413a10a-efcd-48c3-bc00-8be7e2d8d849" containerID="8f94fc7d07c108acc114fe24d2bd225b7b32031c75e53fb6b0dc038d6a8cc4c1" exitCode=0
Jul 23 11:10:42.467288 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:42.466878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerDied","Data":"8f94fc7d07c108acc114fe24d2bd225b7b32031c75e53fb6b0dc038d6a8cc4c1"}
Jul 23 11:10:43.061803 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.061766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:43.061982 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.061822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:43.061982 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.061917    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:43.062073 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.061990    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret podName:9f32602e-69a4-48a7-8841-0e1ef0600081 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:15.061974955 +0000 UTC m=+66.188838361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret") pod "global-pull-secret-syncer-6xkjn" (UID: "9f32602e-69a4-48a7-8841-0e1ef0600081") : object "kube-system"/"original-pull-secret" not registered
Jul 23 11:10:43.062073 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.061917    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:43.062182 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.062078    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:15.062053118 +0000 UTC m=+66.188916520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 11:10:43.162693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.162664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:43.162868 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.162842    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 11:10:43.162868 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.162865    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 11:10:43.162972 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.162875    2578 projected.go:196] Error preparing data for projected volume kube-api-access-9dmw5 for pod openshift-network-diagnostics/network-check-target-jmsx7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:43.162972 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.162926    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5 podName:75a2c327-cac2-4f27-b466-43f3b06be761 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:15.16291047 +0000 UTC m=+66.289773871 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dmw5" (UniqueName: "kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5") pod "network-check-target-jmsx7" (UID: "75a2c327-cac2-4f27-b466-43f3b06be761") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 11:10:43.312077 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.312006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:43.312213 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.312006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:43.312213 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.312137    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmsx7" podUID="75a2c327-cac2-4f27-b466-43f3b06be761"
Jul 23 11:10:43.312213 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.312006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:43.312369 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.312230    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:10:43.312428 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.312371    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xkjn" podUID="9f32602e-69a4-48a7-8841-0e1ef0600081"
Jul 23 11:10:43.697285 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.697256    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeReady"
Jul 23 11:10:43.697778 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.697375    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 11:10:43.733452 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.733426    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-579754786b-8kwcj"]
Jul 23 11:10:43.736148 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.736129    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.739501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.739463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 11:10:43.739501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.739487    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 11:10:43.739934 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.739914    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j422v\""
Jul 23 11:10:43.740055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.739949    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 11:10:43.746554 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.746530    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5mwxv"]
Jul 23 11:10:43.746717 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.746631    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 11:10:43.749304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.749278    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h968h"]
Jul 23 11:10:43.749304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.749301    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.752360 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.752078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:43.752360 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.752140    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 11:10:43.752360 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.752148    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 11:10:43.752360 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.752151    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxmt4\""
Jul 23 11:10:43.754702 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.754681    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 11:10:43.755146 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.755124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-565pp\""
Jul 23 11:10:43.755146 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.755141    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 11:10:43.755398 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.755376    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 11:10:43.758693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.758670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579754786b-8kwcj"]
Jul 23 11:10:43.761836 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.761817    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mwxv"]
Jul 23 11:10:43.764846 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.764771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h968h"]
Jul 23 11:10:43.868896 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.868827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgtb\" (UniqueName: \"kubernetes.io/projected/1c5e155a-84d3-4e55-b8d7-00d71a6652a5-kube-api-access-vqgtb\") pod \"ingress-canary-h968h\" (UID: \"1c5e155a-84d3-4e55-b8d7-00d71a6652a5\") " pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:43.868896 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.868871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-bound-sa-token\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.868919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e155a-84d3-4e55-b8d7-00d71a6652a5-cert\") pod \"ingress-canary-h968h\" (UID: \"1c5e155a-84d3-4e55-b8d7-00d71a6652a5\") " pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:43.869078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.868942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-ca-trust-extracted\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.868958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a586995-b097-4f70-8338-3bcae2cb2a4e-config-volume\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.869078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-trusted-ca\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-installation-pull-secrets\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.869380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a586995-b097-4f70-8338-3bcae2cb2a4e-tmp-dir\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.869380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hwkb\" (UniqueName: \"kubernetes.io/projected/8a586995-b097-4f70-8338-3bcae2cb2a4e-kube-api-access-8hwkb\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.869380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-image-registry-private-configuration\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ngql\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-kube-api-access-5ngql\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.869380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.869283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-certificates\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970139 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e155a-84d3-4e55-b8d7-00d71a6652a5-cert\") pod \"ingress-canary-h968h\" (UID: \"1c5e155a-84d3-4e55-b8d7-00d71a6652a5\") " pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:43.970271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-ca-trust-extracted\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a586995-b097-4f70-8338-3bcae2cb2a4e-config-volume\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.970271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-trusted-ca\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-installation-pull-secrets\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.970271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a586995-b097-4f70-8338-3bcae2cb2a4e-tmp-dir\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hwkb\" (UniqueName: \"kubernetes.io/projected/8a586995-b097-4f70-8338-3bcae2cb2a4e-kube-api-access-8hwkb\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-image-registry-private-configuration\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngql\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-kube-api-access-5ngql\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-certificates\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgtb\" (UniqueName: \"kubernetes.io/projected/1c5e155a-84d3-4e55-b8d7-00d71a6652a5-kube-api-access-vqgtb\") pod \"ingress-canary-h968h\" (UID: \"1c5e155a-84d3-4e55-b8d7-00d71a6652a5\") " pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-bound-sa-token\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.970530 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.970503    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:43.970902 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.970565    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:10:44.470545488 +0000 UTC m=+35.597408904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:43.970902 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.970570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-ca-trust-extracted\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.971011 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.970934    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:43.971011 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.970949    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:10:43.971011 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:43.970997    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:44.470979198 +0000 UTC m=+35.597842617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:10:43.971160 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.971057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a586995-b097-4f70-8338-3bcae2cb2a4e-tmp-dir\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.971296 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.971270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-trusted-ca\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.971296 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.971280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-certificates\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.971567 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.971525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a586995-b097-4f70-8338-3bcae2cb2a4e-config-volume\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.974853 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.974831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-installation-pull-secrets\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.974940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.974853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5e155a-84d3-4e55-b8d7-00d71a6652a5-cert\") pod \"ingress-canary-h968h\" (UID: \"1c5e155a-84d3-4e55-b8d7-00d71a6652a5\") " pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:43.974940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.974860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-image-registry-private-configuration\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.981099 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.980584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hwkb\" (UniqueName: \"kubernetes.io/projected/8a586995-b097-4f70-8338-3bcae2cb2a4e-kube-api-access-8hwkb\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:43.981099 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.981094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ngql\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-kube-api-access-5ngql\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.982037 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.982012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-bound-sa-token\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:43.982504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:43.982484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgtb\" (UniqueName: \"kubernetes.io/projected/1c5e155a-84d3-4e55-b8d7-00d71a6652a5-kube-api-access-vqgtb\") pod \"ingress-canary-h968h\" (UID: \"1c5e155a-84d3-4e55-b8d7-00d71a6652a5\") " pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:44.068338 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:44.068309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h968h"
Jul 23 11:10:44.219099 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:44.219069    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h968h"]
Jul 23 11:10:44.223512 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:10:44.223480    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5e155a_84d3_4e55_b8d7_00d71a6652a5.slice/crio-9d1411a429d7efa21da964bf57a681efc597bfc5898117926c69bb57e741aa6f WatchSource:0}: Error finding container 9d1411a429d7efa21da964bf57a681efc597bfc5898117926c69bb57e741aa6f: Status 404 returned error can't find the container with id 9d1411a429d7efa21da964bf57a681efc597bfc5898117926c69bb57e741aa6f
Jul 23 11:10:44.472325 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:44.472245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h968h" event={"ID":"1c5e155a-84d3-4e55-b8d7-00d71a6652a5","Type":"ContainerStarted","Data":"9d1411a429d7efa21da964bf57a681efc597bfc5898117926c69bb57e741aa6f"}
Jul 23 11:10:44.475634 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:44.475593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:44.475756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:44.475652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:44.475816 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:44.475761    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:44.475816 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:44.475797    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:44.475816 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:44.475812    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:10:44.475938 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:44.475827    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:10:45.47580874 +0000 UTC m=+36.602672162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:44.475938 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:44.475859    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:45.475843697 +0000 UTC m=+36.602707115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:10:45.311556 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.311520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:10:45.312027 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.311532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:10:45.312027 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.311532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:10:45.315865 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.315840    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 11:10:45.316010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.315888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 11:10:45.316010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.315897    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twtsh\""
Jul 23 11:10:45.316010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.315903    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 11:10:45.316010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.315849    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg9k4\""
Jul 23 11:10:45.316010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.315845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 11:10:45.484753 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.484722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:45.484897 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:45.484771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:45.484897 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:45.484883    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:45.484996 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:45.484925    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:45.484996 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:45.484939    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:10:45.484996 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:45.484952    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:10:47.484930562 +0000 UTC m=+38.611793965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:45.484996 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:45.484984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:47.484973228 +0000 UTC m=+38.611836637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:10:46.480638 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:46.480591    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerStarted","Data":"a2d9ec14145f74c5a079ca0fec32a281e9f124e3ff50c2c2da3f8b6d430bd4ff"}
Jul 23 11:10:47.487338 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:47.487132    2578 generic.go:356] "Generic (PLEG): container finished" podID="9413a10a-efcd-48c3-bc00-8be7e2d8d849" containerID="a2d9ec14145f74c5a079ca0fec32a281e9f124e3ff50c2c2da3f8b6d430bd4ff" exitCode=0
Jul 23 11:10:47.487778 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:47.487208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerDied","Data":"a2d9ec14145f74c5a079ca0fec32a281e9f124e3ff50c2c2da3f8b6d430bd4ff"}
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:47.501628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:47.501679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:47.501817    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:47.501833    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:47.501881    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:51.501863783 +0000 UTC m=+42.628727209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:47.501959    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:47.502142 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:47.502007    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:10:51.501990881 +0000 UTC m=+42.628854301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:47.572081 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:47.572035    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:47.794842 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:47.794796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:48.492954 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:48.492916    2578 generic.go:356] "Generic (PLEG): container finished" podID="9413a10a-efcd-48c3-bc00-8be7e2d8d849" containerID="552c940c0cd38123acb6bd62053ce718de769ee6b89589d9e6ad60ed31bef2b6" exitCode=0
Jul 23 11:10:48.493408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:48.492975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerDied","Data":"552c940c0cd38123acb6bd62053ce718de769ee6b89589d9e6ad60ed31bef2b6"}
Jul 23 11:10:48.692141 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:48.692106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:49.498232 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.498204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" event={"ID":"9413a10a-efcd-48c3-bc00-8be7e2d8d849","Type":"ContainerStarted","Data":"933aed661695b327e89ce7c7a00ff47b4ef116d4bf65303834172aee7b933cd5"}
Jul 23 11:10:49.499540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.499517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h968h" event={"ID":"1c5e155a-84d3-4e55-b8d7-00d71a6652a5","Type":"ContainerStarted","Data":"ebb21436365bde849c9a068dae66fc5486eba734c023e8ee0891db78badea0d0"}
Jul 23 11:10:49.525351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.525310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gb6sq" podStartSLOduration=13.492371267 podStartE2EDuration="40.525296828s" totalImagesPullingTime="27.032925561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:49.524008495 +0000 UTC m=+40.650871918" watchObservedRunningTime="2026-07-23 11:10:49.525296828 +0000 UTC m=+40.652160252"
Jul 23 11:10:49.541339 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.541299    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h968h" podStartSLOduration=2.106781481 podStartE2EDuration="6.541286637s" totalImagesPullingTime="4.434505156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:10:49.540102595 +0000 UTC m=+40.666966013" watchObservedRunningTime="2026-07-23 11:10:49.541286637 +0000 UTC m=+40.668150060"
Jul 23 11:10:49.660422 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.660385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:49.760456 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.760421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:49.860257 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:49.860232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:51.526547 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:51.526513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:51.526547 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:51.526552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:51.526950 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:51.526663    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:51.526950 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:51.526679    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:10:51.526950 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:51.526722    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:10:59.526709128 +0000 UTC m=+50.653572543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:10:51.526950 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:51.526663    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:51.526950 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:51.526803    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:10:59.526788646 +0000 UTC m=+50.653652049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:52.097967 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:52.097930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:52.165761 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:52.165732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:54.011543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:54.011512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:10:59.582639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:59.582583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:10:59.583013 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:10:59.582647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:10:59.583013 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:59.582705    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:10:59.583013 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:59.582776    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:11:15.582761822 +0000 UTC m=+66.709625223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:10:59.583013 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:59.582794    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:10:59.583013 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:59.582811    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:10:59.583013 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:10:59.582873    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:15.58285994 +0000 UTC m=+66.709723348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:11:04.690340 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:04.690302    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:08.469286 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:08.469261    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zdz9"
Jul 23 11:11:08.627391 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:08.627361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:08.728500 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:08.728433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:08.827870 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:08.827836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:08.928867 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:08.928838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:09.098234 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:09.098215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:09.154415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:09.154393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:15.092681 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.092635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:11:15.093154 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.092714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:11:15.095778 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.095755    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 11:11:15.095834 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.095796    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 11:11:15.102893 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.102866    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 11:11:15.103008 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.102944    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:12:19.102925027 +0000 UTC m=+130.229788429 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : secret "metrics-daemon-secret" not found
Jul 23 11:11:15.106384 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.106366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f32602e-69a4-48a7-8841-0e1ef0600081-original-pull-secret\") pod \"global-pull-secret-syncer-6xkjn\" (UID: \"9f32602e-69a4-48a7-8841-0e1ef0600081\") " pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:11:15.193965 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.193915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:11:15.197004 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.196985    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 11:11:15.208138 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.208119    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 11:11:15.217085 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.217062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dmw5\" (UniqueName: \"kubernetes.io/projected/75a2c327-cac2-4f27-b466-43f3b06be761-kube-api-access-9dmw5\") pod \"network-check-target-jmsx7\" (UID: \"75a2c327-cac2-4f27-b466-43f3b06be761\") " pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:11:15.325906 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.325880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twtsh\""
Jul 23 11:11:15.333512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.333491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:11:15.335807 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.335790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xkjn"
Jul 23 11:11:15.467527 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.467500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jmsx7"]
Jul 23 11:11:15.471741 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:11:15.471717    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a2c327_cac2_4f27_b466_43f3b06be761.slice/crio-f147c4f8ff21688486d7b713b42f8aa16afc546f3bc082ff6d6a3aa70e0e1cbb WatchSource:0}: Error finding container f147c4f8ff21688486d7b713b42f8aa16afc546f3bc082ff6d6a3aa70e0e1cbb: Status 404 returned error can't find the container with id f147c4f8ff21688486d7b713b42f8aa16afc546f3bc082ff6d6a3aa70e0e1cbb
Jul 23 11:11:15.485927 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.485907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xkjn"]
Jul 23 11:11:15.486874 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:11:15.486852    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f32602e_69a4_48a7_8841_0e1ef0600081.slice/crio-a2f285947a53fa453835201d8f685c64ab7d5730bbeb552698536e3548ebb527 WatchSource:0}: Error finding container a2f285947a53fa453835201d8f685c64ab7d5730bbeb552698536e3548ebb527: Status 404 returned error can't find the container with id a2f285947a53fa453835201d8f685c64ab7d5730bbeb552698536e3548ebb527
Jul 23 11:11:15.555693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.555656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xkjn" event={"ID":"9f32602e-69a4-48a7-8841-0e1ef0600081","Type":"ContainerStarted","Data":"a2f285947a53fa453835201d8f685c64ab7d5730bbeb552698536e3548ebb527"}
Jul 23 11:11:15.556722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.556691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jmsx7" event={"ID":"75a2c327-cac2-4f27-b466-43f3b06be761","Type":"ContainerStarted","Data":"f147c4f8ff21688486d7b713b42f8aa16afc546f3bc082ff6d6a3aa70e0e1cbb"}
Jul 23 11:11:15.597254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.597225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:11:15.597353 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:15.597258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:11:15.597395 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.597369    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:11:15.597395 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.597375    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:11:15.597454 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.597427    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:11:47.597412725 +0000 UTC m=+98.724276147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:11:15.597504 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.597378    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:11:15.597504 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:15.597498    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:11:47.597487313 +0000 UTC m=+98.724350715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:11:18.723976 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.723944    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"]
Jul 23 11:11:18.727838 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.727820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:18.730834 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.730806    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 11:11:18.731878 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.731859    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 11:11:18.731952 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.731911    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 11:11:18.732330 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.732207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xvj55\""
Jul 23 11:11:18.733796 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.733766    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 11:11:18.735808 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.735765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"]
Jul 23 11:11:18.821530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.821497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79cfc6a1-953a-45fd-bba3-8c5dcf6a3513-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8474597dc6-99cpk\" (UID: \"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:18.821530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.821533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9bk\" (UniqueName: \"kubernetes.io/projected/79cfc6a1-953a-45fd-bba3-8c5dcf6a3513-kube-api-access-pw9bk\") pod \"managed-serviceaccount-addon-agent-8474597dc6-99cpk\" (UID: \"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:18.922926 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.922877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79cfc6a1-953a-45fd-bba3-8c5dcf6a3513-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8474597dc6-99cpk\" (UID: \"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:18.922926 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.922921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9bk\" (UniqueName: \"kubernetes.io/projected/79cfc6a1-953a-45fd-bba3-8c5dcf6a3513-kube-api-access-pw9bk\") pod \"managed-serviceaccount-addon-agent-8474597dc6-99cpk\" (UID: \"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:18.925677 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.925650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79cfc6a1-953a-45fd-bba3-8c5dcf6a3513-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8474597dc6-99cpk\" (UID: \"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:18.933070 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:18.933040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9bk\" (UniqueName: \"kubernetes.io/projected/79cfc6a1-953a-45fd-bba3-8c5dcf6a3513-kube-api-access-pw9bk\") pod \"managed-serviceaccount-addon-agent-8474597dc6-99cpk\" (UID: \"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:19.042860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:19.042828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"
Jul 23 11:11:20.566775 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:20.566748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk"]
Jul 23 11:11:20.569926 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:11:20.569903    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79cfc6a1_953a_45fd_bba3_8c5dcf6a3513.slice/crio-cebd91be9ccfe2883a9294826f0a3c29dbcdb0f366c09348107ceb0af7c7fcd0 WatchSource:0}: Error finding container cebd91be9ccfe2883a9294826f0a3c29dbcdb0f366c09348107ceb0af7c7fcd0: Status 404 returned error can't find the container with id cebd91be9ccfe2883a9294826f0a3c29dbcdb0f366c09348107ceb0af7c7fcd0
Jul 23 11:11:20.571583 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:20.571485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jmsx7" event={"ID":"75a2c327-cac2-4f27-b466-43f3b06be761","Type":"ContainerStarted","Data":"114fbbb57f5fde824637b122cdcc3bc3e172f7a81232676bed9dff78af23770d"}
Jul 23 11:11:20.571682 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:20.571663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:11:21.576625 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:21.576571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xkjn" event={"ID":"9f32602e-69a4-48a7-8841-0e1ef0600081","Type":"ContainerStarted","Data":"2ad009c692b8a60b8438ec6d573477538bd2741342be39a1212e6183e7bf0396"}
Jul 23 11:11:21.578062 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:21.578023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk" event={"ID":"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513","Type":"ContainerStarted","Data":"cebd91be9ccfe2883a9294826f0a3c29dbcdb0f366c09348107ceb0af7c7fcd0"}
Jul 23 11:11:21.595222 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:21.595172    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6xkjn" podStartSLOduration=67.629527524 podStartE2EDuration="1m12.595155982s" totalImagesPullingTime="4.965628458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:11:21.594001437 +0000 UTC m=+72.720864886" watchObservedRunningTime="2026-07-23 11:11:21.595155982 +0000 UTC m=+72.722019409"
Jul 23 11:11:21.595359 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:21.595298    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jmsx7" podStartSLOduration=67.630355314 podStartE2EDuration="1m12.59529149s" totalImagesPullingTime="4.964936176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:11:20.597458022 +0000 UTC m=+71.724321467" watchObservedRunningTime="2026-07-23 11:11:21.59529149 +0000 UTC m=+72.722154947"
Jul 23 11:11:23.585013 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:23.584931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk" event={"ID":"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513","Type":"ContainerStarted","Data":"346fec25a0a337356ebf1be1013ef55795596afeb5c3b920957772a40795ba97"}
Jul 23 11:11:23.603768 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:23.603722    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk" podStartSLOduration=2.8553151789999998 podStartE2EDuration="5.603708205s" totalImagesPullingTime="2.748393026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:11:23.603049661 +0000 UTC m=+74.729913084" watchObservedRunningTime="2026-07-23 11:11:23.603708205 +0000 UTC m=+74.730571629"
Jul 23 11:11:29.139169 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:29.139130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:29.197426 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:29.197396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:11:47.615813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:47.615778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:11:47.615813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:47.615817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:11:47.616309 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:47.615927    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:11:47.616309 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:47.615937    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:11:47.616309 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:47.615936    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:11:47.616309 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:47.615984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:12:51.615971524 +0000 UTC m=+162.742834926 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:11:47.616309 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:11:47.616009    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:12:51.615991569 +0000 UTC m=+162.742854985 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:11:51.580677 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:11:51.580638    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jmsx7"
Jul 23 11:12:19.117701 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:12:19.117670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:12:19.118174 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:19.117785    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 11:12:19.118174 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:19.117842    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs podName:2949fccc-8b43-42a4-89e2-48d257ab3736 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:21.117828733 +0000 UTC m=+252.244692134 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs") pod "network-metrics-daemon-b8svt" (UID: "2949fccc-8b43-42a4-89e2-48d257ab3736") : secret "metrics-daemon-secret" not found
Jul 23 11:12:46.749365 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:46.749324    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-579754786b-8kwcj" podUID="9769dcd6-1c5a-4efa-9dd0-da33d0221f99"
Jul 23 11:12:46.760433 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:46.760403    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5mwxv" podUID="8a586995-b097-4f70-8338-3bcae2cb2a4e"
Jul 23 11:12:46.774084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:12:46.774058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:12:46.774191 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:12:46.774058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:12:48.329659 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:48.329623    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b8svt" podUID="2949fccc-8b43-42a4-89e2-48d257ab3736"
Jul 23 11:12:51.619658 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:12:51.619600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:12:51.619658 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:12:51.619659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") pod \"image-registry-579754786b-8kwcj\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") " pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:12:51.620133 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:51.619751    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 11:12:51.620133 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:51.619766    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 11:12:51.620133 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:51.619775    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579754786b-8kwcj: secret "image-registry-tls" not found
Jul 23 11:12:51.620133 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:51.619823    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls podName:8a586995-b097-4f70-8338-3bcae2cb2a4e nodeName:}" failed. No retries permitted until 2026-07-23 11:14:53.619805598 +0000 UTC m=+284.746668999 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls") pod "dns-default-5mwxv" (UID: "8a586995-b097-4f70-8338-3bcae2cb2a4e") : secret "dns-default-metrics-tls" not found
Jul 23 11:12:51.620133 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:12:51.619838    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls podName:9769dcd6-1c5a-4efa-9dd0-da33d0221f99 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:53.619832024 +0000 UTC m=+284.746695425 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls") pod "image-registry-579754786b-8kwcj" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99") : secret "image-registry-tls" not found
Jul 23 11:13:03.312328 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:03.312249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:13:23.858472 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:23.858443    2578 generic.go:356] "Generic (PLEG): container finished" podID="79cfc6a1-953a-45fd-bba3-8c5dcf6a3513" containerID="346fec25a0a337356ebf1be1013ef55795596afeb5c3b920957772a40795ba97" exitCode=255
Jul 23 11:13:23.858966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:23.858488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk" event={"ID":"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513","Type":"ContainerDied","Data":"346fec25a0a337356ebf1be1013ef55795596afeb5c3b920957772a40795ba97"}
Jul 23 11:13:23.863549 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:23.863532    2578 scope.go:117] "RemoveContainer" containerID="346fec25a0a337356ebf1be1013ef55795596afeb5c3b920957772a40795ba97"
Jul 23 11:13:24.862480 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:24.862446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8474597dc6-99cpk" event={"ID":"79cfc6a1-953a-45fd-bba3-8c5dcf6a3513","Type":"ContainerStarted","Data":"6e72e9a89db7c2498d68c4249b4451d6070613cf557cbb8f74652dec20284b87"}
Jul 23 11:13:58.681033 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.681003    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"]
Jul 23 11:13:58.684036 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.684022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"
Jul 23 11:13:58.686734 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.686713    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8mwzd\""
Jul 23 11:13:58.686964 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.686947    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.687841 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.687829    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.695244 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.695225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"]
Jul 23 11:13:58.738994 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.738971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l88b\" (UniqueName: \"kubernetes.io/projected/c295923b-2916-4988-907b-f04dec19385f-kube-api-access-2l88b\") pod \"volume-data-source-validator-78cf4c6f6-ws5mf\" (UID: \"c295923b-2916-4988-907b-f04dec19385f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"
Jul 23 11:13:58.787824 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.787804    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"]
Jul 23 11:13:58.790596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.790581    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-pqmr6"]
Jul 23 11:13:58.790715 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.790697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:58.793306 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.793292    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-569c94756d-ml9wr"]
Jul 23 11:13:58.793440 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.793423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.794236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.794215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.794306 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.794238    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-85rkd\""
Jul 23 11:13:58.794447 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.794430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 11:13:58.794574 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.794561    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.795920 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.795902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.796586 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.796566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 11:13:58.796701 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.796632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 11:13:58.797064 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.797046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ktgjs\""
Jul 23 11:13:58.797896 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.797877    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.798163 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.798133    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.799662 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.799643    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 11:13:58.799759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.799712    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 11:13:58.799759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.799727    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l6mnh\""
Jul 23 11:13:58.799864 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.799776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 11:13:58.799864 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.799847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 11:13:58.799981 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.799901    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 11:13:58.800050 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.800038    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 11:13:58.801831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.801812    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 11:13:58.803048 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.802981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-pqmr6"]
Jul 23 11:13:58.804040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.804023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-569c94756d-ml9wr"]
Jul 23 11:13:58.810207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.810186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"]
Jul 23 11:13:58.839786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-default-certificate\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.839883 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:58.839883 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.839883 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-serving-cert\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.839979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7zv\" (UniqueName: \"kubernetes.io/projected/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-kube-api-access-kh7zv\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:58.839979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l88b\" (UniqueName: \"kubernetes.io/projected/c295923b-2916-4988-907b-f04dec19385f-kube-api-access-2l88b\") pod \"volume-data-source-validator-78cf4c6f6-ws5mf\" (UID: \"c295923b-2916-4988-907b-f04dec19385f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"
Jul 23 11:13:58.839979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-trusted-ca\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.840080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.839976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-config\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.840080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.840035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4h48\" (UniqueName: \"kubernetes.io/projected/68096475-59bd-489d-bbf3-75abe8d33dbe-kube-api-access-b4h48\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.840080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.840059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-stats-auth\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.840080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.840076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.840214 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.840094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbsj\" (UniqueName: \"kubernetes.io/projected/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-kube-api-access-sfbsj\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.849699 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.849678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l88b\" (UniqueName: \"kubernetes.io/projected/c295923b-2916-4988-907b-f04dec19385f-kube-api-access-2l88b\") pod \"volume-data-source-validator-78cf4c6f6-ws5mf\" (UID: \"c295923b-2916-4988-907b-f04dec19385f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"
Jul 23 11:13:58.940381 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-default-certificate\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.940381 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:58.940529 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.940529 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-serving-cert\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.940529 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7zv\" (UniqueName: \"kubernetes.io/projected/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-kube-api-access-kh7zv\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:58.940529 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:58.940464    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 11:13:58.940529 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:58.940531    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls podName:b6fc8ec5-3692-4393-8f51-9800ccf3e6c6 nodeName:}" failed. No retries permitted until 2026-07-23 11:13:59.440511614 +0000 UTC m=+230.567375022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-69wsf" (UID: "b6fc8ec5-3692-4393-8f51-9800ccf3e6c6") : secret "samples-operator-tls" not found
Jul 23 11:13:58.940813 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:58.940558    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 11:13:58.940813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-trusted-ca\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.940813 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:58.940646    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:13:59.440627078 +0000 UTC m=+230.567490488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : secret "router-metrics-certs-default" not found
Jul 23 11:13:58.940813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-config\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.940813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4h48\" (UniqueName: \"kubernetes.io/projected/68096475-59bd-489d-bbf3-75abe8d33dbe-kube-api-access-b4h48\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.940813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.940768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-stats-auth\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.941255 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.941077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.941571 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:58.941510    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:13:59.441487762 +0000 UTC m=+230.568351182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : configmap references non-existent config key: service-ca.crt
Jul 23 11:13:58.945770 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.942030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-config\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.945827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.942086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-trusted-ca\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.945827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.943409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-serving-cert\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.945827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.943562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-default-certificate\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.946011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.945877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbsj\" (UniqueName: \"kubernetes.io/projected/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-kube-api-access-sfbsj\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.948410 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.948390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-stats-auth\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.949543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.949521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7zv\" (UniqueName: \"kubernetes.io/projected/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-kube-api-access-kh7zv\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:58.954055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.954034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4h48\" (UniqueName: \"kubernetes.io/projected/68096475-59bd-489d-bbf3-75abe8d33dbe-kube-api-access-b4h48\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:58.954548 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.954526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbsj\" (UniqueName: \"kubernetes.io/projected/b055d2c6-e3c0-4ebd-94f4-a16bb027142b-kube-api-access-sfbsj\") pod \"console-operator-565b7b569d-pqmr6\" (UID: \"b055d2c6-e3c0-4ebd-94f4-a16bb027142b\") " pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:58.982130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.982104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:13:58.992897 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:58.992884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"
Jul 23 11:13:59.077304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.077272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:13:59.107145 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.107120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:13:59.112513 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.112493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf"]
Jul 23 11:13:59.115449 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:13:59.115430    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc295923b_2916_4988_907b_f04dec19385f.slice/crio-d0d8477ea3828375421785067628331242f5ae98168cb34b1bacfd92a3a80e6f WatchSource:0}: Error finding container d0d8477ea3828375421785067628331242f5ae98168cb34b1bacfd92a3a80e6f: Status 404 returned error can't find the container with id d0d8477ea3828375421785067628331242f5ae98168cb34b1bacfd92a3a80e6f
Jul 23 11:13:59.244120 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.244052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-pqmr6"]
Jul 23 11:13:59.251799 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:13:59.251778    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb055d2c6_e3c0_4ebd_94f4_a16bb027142b.slice/crio-490ca1b4dcd246d9e327b48544e4aee5df527ddac6ec3b3139c4193f68489443 WatchSource:0}: Error finding container 490ca1b4dcd246d9e327b48544e4aee5df527ddac6ec3b3139c4193f68489443: Status 404 returned error can't find the container with id 490ca1b4dcd246d9e327b48544e4aee5df527ddac6ec3b3139c4193f68489443
Jul 23 11:13:59.450494 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.450469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:59.450641 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.450508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:13:59.450641 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.450527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:13:59.450641 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:59.450602    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 11:13:59.450641 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:59.450630    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 11:13:59.450851 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:59.450655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:00.450643357 +0000 UTC m=+231.577506758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : secret "router-metrics-certs-default" not found
Jul 23 11:13:59.450851 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:59.450679    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:00.450660956 +0000 UTC m=+231.577524369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : configmap references non-existent config key: service-ca.crt
Jul 23 11:13:59.450851 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:13:59.450696    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls podName:b6fc8ec5-3692-4393-8f51-9800ccf3e6c6 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:00.45068943 +0000 UTC m=+231.577552835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-69wsf" (UID: "b6fc8ec5-3692-4393-8f51-9800ccf3e6c6") : secret "samples-operator-tls" not found
Jul 23 11:13:59.944220 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.944167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf" event={"ID":"c295923b-2916-4988-907b-f04dec19385f","Type":"ContainerStarted","Data":"d0d8477ea3828375421785067628331242f5ae98168cb34b1bacfd92a3a80e6f"}
Jul 23 11:13:59.945190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:13:59.945149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" event={"ID":"b055d2c6-e3c0-4ebd-94f4-a16bb027142b","Type":"ContainerStarted","Data":"490ca1b4dcd246d9e327b48544e4aee5df527ddac6ec3b3139c4193f68489443"}
Jul 23 11:14:00.457740 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:00.457698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:00.457908 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:00.457771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:14:00.457908 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:00.457805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:00.457908 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:00.457885    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:02.457861792 +0000 UTC m=+233.584725203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : configmap references non-existent config key: service-ca.crt
Jul 23 11:14:00.458078 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:00.457937    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 11:14:00.458078 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:00.457984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:02.457972139 +0000 UTC m=+233.584835540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : secret "router-metrics-certs-default" not found
Jul 23 11:14:00.458078 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:00.457940    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 11:14:00.458078 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:00.458020    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls podName:b6fc8ec5-3692-4393-8f51-9800ccf3e6c6 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:02.458013278 +0000 UTC m=+233.584876679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-69wsf" (UID: "b6fc8ec5-3692-4393-8f51-9800ccf3e6c6") : secret "samples-operator-tls" not found
Jul 23 11:14:00.950001 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:00.949962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf" event={"ID":"c295923b-2916-4988-907b-f04dec19385f","Type":"ContainerStarted","Data":"dad37758af387a8b4c6e0fa906aab8ed9db639efb0595f0c9add940408d6a6d8"}
Jul 23 11:14:00.971962 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:00.971911    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ws5mf" podStartSLOduration=1.818273164 podStartE2EDuration="2.971891978s" totalImagesPullingTime="1.153618814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:00.969857251 +0000 UTC m=+232.096720674" watchObservedRunningTime="2026-07-23 11:14:00.971891978 +0000 UTC m=+232.098755404"
Jul 23 11:14:01.072049 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.072015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:01.146784 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.146760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:01.955122 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.955086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" event={"ID":"b055d2c6-e3c0-4ebd-94f4-a16bb027142b","Type":"ContainerStarted","Data":"27f565e3668451ab49e439403128996a64bc96261bb5ab193b9ae8d8e5f61b08"}
Jul 23 11:14:01.955548 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.955328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:14:01.956754 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.956715    2578 patch_prober.go:28] interesting pod/console-operator-565b7b569d-pqmr6 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body=
Jul 23 11:14:01.956850 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.956781    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" podUID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused"
Jul 23 11:14:01.973561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:01.973522    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" podStartSLOduration=1.372375666 podStartE2EDuration="3.97350857s" totalImagesPullingTime="2.601132904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:01.972590183 +0000 UTC m=+233.099453606" watchObservedRunningTime="2026-07-23 11:14:01.97350857 +0000 UTC m=+233.100371998"
Jul 23 11:14:02.474135 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.474094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:02.474336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.474154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:14:02.474336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.474203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:02.474336 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:02.474262    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:06.474239708 +0000 UTC m=+237.601103112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : configmap references non-existent config key: service-ca.crt
Jul 23 11:14:02.474336 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:02.474309    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 11:14:02.474514 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:02.474349    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls podName:b6fc8ec5-3692-4393-8f51-9800ccf3e6c6 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:06.474338034 +0000 UTC m=+237.601201440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-69wsf" (UID: "b6fc8ec5-3692-4393-8f51-9800ccf3e6c6") : secret "samples-operator-tls" not found
Jul 23 11:14:02.474514 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:02.474310    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 11:14:02.474514 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:02.474399    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:06.4743901 +0000 UTC m=+237.601253517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : secret "router-metrics-certs-default" not found
Jul 23 11:14:02.962893 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.962862    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/0.log"
Jul 23 11:14:02.963253 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.962906    2578 generic.go:356] "Generic (PLEG): container finished" podID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b" containerID="27f565e3668451ab49e439403128996a64bc96261bb5ab193b9ae8d8e5f61b08" exitCode=255
Jul 23 11:14:02.963253 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.962934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" event={"ID":"b055d2c6-e3c0-4ebd-94f4-a16bb027142b","Type":"ContainerDied","Data":"27f565e3668451ab49e439403128996a64bc96261bb5ab193b9ae8d8e5f61b08"}
Jul 23 11:14:02.963253 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:02.963183    2578 scope.go:117] "RemoveContainer" containerID="27f565e3668451ab49e439403128996a64bc96261bb5ab193b9ae8d8e5f61b08"
Jul 23 11:14:03.926792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.926756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:03.930695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.930669    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lvl9r"]
Jul 23 11:14:03.933668 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.933652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:03.937247 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.937228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 11:14:03.938077 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.938059    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 11:14:03.938185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.938063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 11:14:03.938185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.938067    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r4rm6\""
Jul 23 11:14:03.944164 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.944148    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 11:14:03.956502 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.956480    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lvl9r"]
Jul 23 11:14:03.967505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.967486    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:14:03.968016 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.967998    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/0.log"
Jul 23 11:14:03.968076 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.968039    2578 generic.go:356] "Generic (PLEG): container finished" podID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b" containerID="aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7" exitCode=255
Jul 23 11:14:03.968115 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.968069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" event={"ID":"b055d2c6-e3c0-4ebd-94f4-a16bb027142b","Type":"ContainerDied","Data":"aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7"}
Jul 23 11:14:03.968155 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.968120    2578 scope.go:117] "RemoveContainer" containerID="27f565e3668451ab49e439403128996a64bc96261bb5ab193b9ae8d8e5f61b08"
Jul 23 11:14:03.968354 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.968336    2578 scope.go:117] "RemoveContainer" containerID="aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7"
Jul 23 11:14:03.968525 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:03.968508    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqmr6_openshift-console-operator(b055d2c6-e3c0-4ebd-94f4-a16bb027142b)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" podUID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b"
Jul 23 11:14:03.983944 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.983926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:03.984024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.983964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:03.984024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.983982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgbrz\" (UniqueName: \"kubernetes.io/projected/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-api-access-sgbrz\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:03.984158 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.984073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f8ce6d1-a39a-4633-9109-e3e04595e711-data-volume\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:03.984158 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:03.984121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f8ce6d1-a39a-4633-9109-e3e04595e711-crio-socket\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.000696 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.000669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:04.084785 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.084757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.084899 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.084800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.084899 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.084824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgbrz\" (UniqueName: \"kubernetes.io/projected/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-api-access-sgbrz\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.084899 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.084879    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.084987 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.084921    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.084987 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.084974    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:04.584957083 +0000 UTC m=+235.711820504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.085066 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.085010    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:04.584992201 +0000 UTC m=+235.711855606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.085066 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.085052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f8ce6d1-a39a-4633-9109-e3e04595e711-data-volume\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.085242 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.085226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f8ce6d1-a39a-4633-9109-e3e04595e711-crio-socket\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.085359 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.085342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f8ce6d1-a39a-4633-9109-e3e04595e711-crio-socket\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.085417 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.085388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f8ce6d1-a39a-4633-9109-e3e04595e711-data-volume\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.096455 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.096427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgbrz\" (UniqueName: \"kubernetes.io/projected/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-api-access-sgbrz\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.214149 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.214095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:04.313393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.313368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:04.372538 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.372516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:04.590079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.590061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.590195 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.590094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:04.590267 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.590192    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.590267 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.590256    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:05.590237482 +0000 UTC m=+236.717100885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:04.590393 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.590294    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.590393 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.590345    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:05.590329102 +0000 UTC m=+236.717192503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:04.661404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.661385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:04.745287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.745265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:04.971708 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.971646    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:14:04.972074 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:04.972001    2578 scope.go:117] "RemoveContainer" containerID="aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7"
Jul 23 11:14:04.972198 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:04.972178    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqmr6_openshift-console-operator(b055d2c6-e3c0-4ebd-94f4-a16bb027142b)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" podUID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b"
Jul 23 11:14:05.201484 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:05.201456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:05.299708 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:05.299680    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:05.596938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:05.596868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:05.596938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:05.596907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:05.597087 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:05.596985    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:05.597087 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:05.597036    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:05.597087 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:05.597043    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:07.597028078 +0000 UTC m=+238.723891479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:05.597087 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:05.597073    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:07.597062773 +0000 UTC m=+238.723926174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:05.709668 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:05.709644    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2xgb_aab206a7-a67f-4b16-9d4d-55775dc248c9/dns-node-resolver/0.log"
Jul 23 11:14:06.278510 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:06.278485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:06.502890 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:06.502861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:14:06.503051 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:06.502900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:06.503051 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:06.502965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:06.503051 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:06.502995    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 11:14:06.503188 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:06.503058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls podName:b6fc8ec5-3692-4393-8f51-9800ccf3e6c6 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:14.50303709 +0000 UTC m=+245.629900491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-69wsf" (UID: "b6fc8ec5-3692-4393-8f51-9800ccf3e6c6") : secret "samples-operator-tls" not found
Jul 23 11:14:06.503188 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:06.503074    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:14.503067948 +0000 UTC m=+245.629931350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : configmap references non-existent config key: service-ca.crt
Jul 23 11:14:06.503188 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:06.503059    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 11:14:06.503188 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:06.503098    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:14.503093081 +0000 UTC m=+245.629956482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : secret "router-metrics-certs-default" not found
Jul 23 11:14:07.111446 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:07.111420    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vphwl_369dab9d-4a01-4c58-b914-a51165a15b46/node-ca/0.log"
Jul 23 11:14:07.608537 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:07.608513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:07.608982 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:07.608550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:07.608982 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:07.608650    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:07.608982 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:07.608683    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:07.608982 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:07.608719    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:11.608700734 +0000 UTC m=+242.735564151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:07.608982 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:07.608739    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:11.608730277 +0000 UTC m=+242.735593684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:07.710315 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:07.710293    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h968h_1c5e155a-84d3-4e55-b8d7-00d71a6652a5/serve-healthcheck-canary/0.log"
Jul 23 11:14:08.831420 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:08.831392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:09.107441 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.107412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:14:09.107725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.107713    2578 scope.go:117] "RemoveContainer" containerID="aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7"
Jul 23 11:14:09.107851 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:09.107834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqmr6_openshift-console-operator(b055d2c6-e3c0-4ebd-94f4-a16bb027142b)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" podUID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b"
Jul 23 11:14:09.411456 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.411390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:09.509022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.508994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:09.669824 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.669767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:09.767865 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.767842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:09.841809 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:09.841766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:10.291669 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:10.291642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:11.328402 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.328376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:11.398743 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.398716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:11.640181 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.640113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:11.640181 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.640149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:11.640322 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:11.640236    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 11:14:11.640322 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:11.640255    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:11.640322 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:11.640297    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:19.64028265 +0000 UTC m=+250.767146052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : configmap "kube-rbac-proxy" not found
Jul 23 11:14:11.640322 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:11.640312    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls podName:2f8ce6d1-a39a-4633-9109-e3e04595e711 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:19.640306226 +0000 UTC m=+250.767169627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lvl9r" (UID: "2f8ce6d1-a39a-4633-9109-e3e04595e711") : secret "insights-runtime-extractor-tls" not found
Jul 23 11:14:11.807252 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.807225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:11.906546 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.906487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:11.955197 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.955178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:14:11.955476 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:11.955464    2578 scope.go:117] "RemoveContainer" containerID="aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7"
Jul 23 11:14:11.955601 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:11.955585    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqmr6_openshift-console-operator(b055d2c6-e3c0-4ebd-94f4-a16bb027142b)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" podUID="b055d2c6-e3c0-4ebd-94f4-a16bb027142b"
Jul 23 11:14:12.085786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:12.085755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:12.278973 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:12.278943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:12.356594 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:12.356563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:12.685492 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:12.685405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:13.277900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:13.277865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:13.438672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:13.438640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:13.539125 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:13.539064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:13.692519 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:13.692495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:14.076226 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.076201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:14.177768 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.177720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:14.282775 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.282752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:14.561194 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.561151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:14.561532 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.561229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:14:14.561532 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.561272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:14.561532 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:14.561298    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle podName:68096475-59bd-489d-bbf3-75abe8d33dbe nodeName:}" failed. No retries permitted until 2026-07-23 11:14:30.561281641 +0000 UTC m=+261.688145046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle") pod "router-default-569c94756d-ml9wr" (UID: "68096475-59bd-489d-bbf3-75abe8d33dbe") : configmap references non-existent config key: service-ca.crt
Jul 23 11:14:14.563531 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.563512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68096475-59bd-489d-bbf3-75abe8d33dbe-metrics-certs\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:14.563630 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.563579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6fc8ec5-3692-4393-8f51-9800ccf3e6c6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-69wsf\" (UID: \"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:14:14.703000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.702977    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-85rkd\""
Jul 23 11:14:14.710566 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.710543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"
Jul 23 11:14:14.834414 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.834333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf"]
Jul 23 11:14:14.887847 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.887824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:14.998190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:14.998165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf" event={"ID":"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6","Type":"ContainerStarted","Data":"4cf3c5809641d8d401d69f190840f687291f9f047af01af9237a83c69c4df077"}
Jul 23 11:14:15.478992 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:15.478961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:15.675729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:15.675691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:15.873937 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:15.873906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:16.088533 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:16.088501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:16.286816 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:16.286784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:16.687134 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:16.687049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:17.139810 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:17.139775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:17.282854 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:17.282807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:18.008706 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:18.008673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf" event={"ID":"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6","Type":"ContainerStarted","Data":"d844f79d7640f7aa6026ef0b21afacada267378a539214aa1e8bccb390edcdc3"}
Jul 23 11:14:18.009058 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:18.008719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf" event={"ID":"b6fc8ec5-3692-4393-8f51-9800ccf3e6c6","Type":"ContainerStarted","Data":"29ae094c852f6a1ab645ee10fe50ff1de4851bf30bab579febb8237428b29893"}
Jul 23 11:14:18.030289 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:18.030244    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-69wsf" podStartSLOduration=17.467003478 podStartE2EDuration="20.030230485s" totalImagesPullingTime="2.563227007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:18.02876575 +0000 UTC m=+249.155629172" watchObservedRunningTime="2026-07-23 11:14:18.030230485 +0000 UTC m=+249.157093909"
Jul 23 11:14:18.532397 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:18.532368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:18.620107 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:18.620083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:18.937648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:18.937571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:19.512543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.512512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:19.680000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.679972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:19.701037 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.701013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:19.701179 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.701042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:19.701529 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.701512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f8ce6d1-a39a-4633-9109-e3e04595e711-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:19.703177 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.703159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f8ce6d1-a39a-4633-9109-e3e04595e711-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lvl9r\" (UID: \"2f8ce6d1-a39a-4633-9109-e3e04595e711\") " pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:19.844446 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.844380    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r4rm6\""
Jul 23 11:14:19.852904 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.852880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lvl9r"
Jul 23 11:14:19.891479 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.891454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:19.977903 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:19.977876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lvl9r"]
Jul 23 11:14:19.981429 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:19.981399    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8ce6d1_a39a_4633_9109_e3e04595e711.slice/crio-2eb091bf80779158d742b2f2d1a18ff7d9a16cb97b1460aedf0b81386b1c948e WatchSource:0}: Error finding container 2eb091bf80779158d742b2f2d1a18ff7d9a16cb97b1460aedf0b81386b1c948e: Status 404 returned error can't find the container with id 2eb091bf80779158d742b2f2d1a18ff7d9a16cb97b1460aedf0b81386b1c948e
Jul 23 11:14:20.016507 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:20.016483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvl9r" event={"ID":"2f8ce6d1-a39a-4633-9109-e3e04595e711","Type":"ContainerStarted","Data":"2eb091bf80779158d742b2f2d1a18ff7d9a16cb97b1460aedf0b81386b1c948e"}
Jul 23 11:14:20.078154 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:20.078134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:21.211307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.211274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:14:21.214006 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.213974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2949fccc-8b43-42a4-89e2-48d257ab3736-metrics-certs\") pod \"network-metrics-daemon-b8svt\" (UID: \"2949fccc-8b43-42a4-89e2-48d257ab3736\") " pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:14:21.316127 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.316095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kg9k4\""
Jul 23 11:14:21.324141 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.324115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b8svt"
Jul 23 11:14:21.455585 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.455554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b8svt"]
Jul 23 11:14:21.458865 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:21.458836    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2949fccc_8b43_42a4_89e2_48d257ab3736.slice/crio-790137732a35396b59740dd28a305b6aa7b9090195a6206b548b584e29367103 WatchSource:0}: Error finding container 790137732a35396b59740dd28a305b6aa7b9090195a6206b548b584e29367103: Status 404 returned error can't find the container with id 790137732a35396b59740dd28a305b6aa7b9090195a6206b548b584e29367103
Jul 23 11:14:21.606275 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.606240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:21.707458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:21.707424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:22.024960 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:22.024926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b8svt" event={"ID":"2949fccc-8b43-42a4-89e2-48d257ab3736","Type":"ContainerStarted","Data":"790137732a35396b59740dd28a305b6aa7b9090195a6206b548b584e29367103"}
Jul 23 11:14:23.030688 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:23.030657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b8svt" event={"ID":"2949fccc-8b43-42a4-89e2-48d257ab3736","Type":"ContainerStarted","Data":"947aaffe6891f66cd01c8fe29df2414377f9d6aa48a680bfe3f3340461478678"}
Jul 23 11:14:23.066791 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:23.066757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:23.145914 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:23.145809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:23.311646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:23.311600    2578 scope.go:117] "RemoveContainer" containerID="aad3935a1c1399dda7dcebc509d272e9c21b6dda3f30b66e76bf5a98ce4310c7"
Jul 23 11:14:24.036304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:24.036265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b8svt" event={"ID":"2949fccc-8b43-42a4-89e2-48d257ab3736","Type":"ContainerStarted","Data":"37ae510d0f2ad0aaad4b672a832c90dcf10a6f9994d89d979049392d2be1ae6f"}
Jul 23 11:14:24.058140 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:24.058091    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b8svt" podStartSLOduration=253.655575835 podStartE2EDuration="4m15.058073329s" totalImagesPullingTime="1.402497494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:24.057319335 +0000 UTC m=+255.184182786" watchObservedRunningTime="2026-07-23 11:14:24.058073329 +0000 UTC m=+255.184936755"
Jul 23 11:14:26.044064 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.043987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvl9r" event={"ID":"2f8ce6d1-a39a-4633-9109-e3e04595e711","Type":"ContainerStarted","Data":"1b081445a5dc8a4f852a5dc352314a58ca2920ad833a192b069780f7c96b9f17"}
Jul 23 11:14:26.045703 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.045683    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:14:26.045797 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.045728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6" event={"ID":"b055d2c6-e3c0-4ebd-94f4-a16bb027142b","Type":"ContainerStarted","Data":"dc48f5c20ffb6a8dd7c718fe4469274ccf2ee30abb114fbca2117a746d5fe366"}
Jul 23 11:14:26.046020 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.045995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:14:26.366012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.365942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-pqmr6"
Jul 23 11:14:26.553339 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.553279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:26.652687 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.652532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:26.757093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.757057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:26.896935 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:26.896903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:27.231495 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:27.231459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:27.332847 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:27.332819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:27.638962 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:27.638923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.061596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.061558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.244148 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.244112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.320262 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.320186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.567035 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.567008    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579754786b-8kwcj"]
Jul 23 11:14:28.567223 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:28.567206    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-579754786b-8kwcj" podUID="9769dcd6-1c5a-4efa-9dd0-da33d0221f99"
Jul 23 11:14:28.609497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.609418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.665136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.665097    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc4c86759-4ngsd"]
Jul 23 11:14:28.671314 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.671294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.687811 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.687759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc4c86759-4ngsd"]
Jul 23 11:14:28.698392 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.698350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.770741 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7923730d-7e26-48be-ab03-1fb72df85234-image-registry-private-configuration\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.770860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7923730d-7e26-48be-ab03-1fb72df85234-installation-pull-secrets\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.770896 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7923730d-7e26-48be-ab03-1fb72df85234-ca-trust-extracted\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.770926 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7923730d-7e26-48be-ab03-1fb72df85234-registry-certificates\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.770926 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7923730d-7e26-48be-ab03-1fb72df85234-trusted-ca\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.771003 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-registry-tls\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.771003 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.770993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbzh\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-kube-api-access-5rbzh\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.771061 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.771029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-bound-sa-token\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.843189 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.843160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:28.872269 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7923730d-7e26-48be-ab03-1fb72df85234-ca-trust-extracted\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872269 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7923730d-7e26-48be-ab03-1fb72df85234-registry-certificates\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872269 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7923730d-7e26-48be-ab03-1fb72df85234-trusted-ca\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-registry-tls\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbzh\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-kube-api-access-5rbzh\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-bound-sa-token\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872631 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7923730d-7e26-48be-ab03-1fb72df85234-image-registry-private-configuration\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872631 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7923730d-7e26-48be-ab03-1fb72df85234-installation-pull-secrets\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.872765 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.872748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7923730d-7e26-48be-ab03-1fb72df85234-ca-trust-extracted\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.873232 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.873199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7923730d-7e26-48be-ab03-1fb72df85234-registry-certificates\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.873479 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.873457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7923730d-7e26-48be-ab03-1fb72df85234-trusted-ca\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.875461 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.875414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7923730d-7e26-48be-ab03-1fb72df85234-image-registry-private-configuration\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.875598 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.875572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-registry-tls\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.875678 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.875659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7923730d-7e26-48be-ab03-1fb72df85234-installation-pull-secrets\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.890561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.890543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-bound-sa-token\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.890967 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.890947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbzh\" (UniqueName: \"kubernetes.io/projected/7923730d-7e26-48be-ab03-1fb72df85234-kube-api-access-5rbzh\") pod \"image-registry-fc4c86759-4ngsd\" (UID: \"7923730d-7e26-48be-ab03-1fb72df85234\") " pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:28.986923 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.986898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j422v\""
Jul 23 11:14:28.991119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:28.991099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:29.061625 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.061587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:14:29.071022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.071000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:14:29.121348 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.121321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:29.175577 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175518    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-certificates\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.175699 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175600    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-ca-trust-extracted\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.175699 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-trusted-ca\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.175699 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175690    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ngql\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-kube-api-access-5ngql\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.175879 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175857    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:14:29.175918 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175883    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:14:29.175918 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-bound-sa-token\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.175997 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175939    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-installation-pull-secrets\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.175997 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.175974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-image-registry-private-configuration\") pod \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\" (UID: \"9769dcd6-1c5a-4efa-9dd0-da33d0221f99\") "
Jul 23 11:14:29.176139 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.176113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:14:29.176219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.176199    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-trusted-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.176270 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.176225    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-certificates\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.176270 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.176240    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-ca-trust-extracted\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.178460 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.178433    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:14:29.178558 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.178522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-kube-api-access-5ngql" (OuterVolumeSpecName: "kube-api-access-5ngql") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "kube-api-access-5ngql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:14:29.178633 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.178589    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:14:29.178886 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.178851    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9769dcd6-1c5a-4efa-9dd0-da33d0221f99" (UID: "9769dcd6-1c5a-4efa-9dd0-da33d0221f99"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:14:29.276851 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.276707    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-bound-sa-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.276851 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.276725    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-installation-pull-secrets\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.276851 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.276734    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-image-registry-private-configuration\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.276851 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.276744    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ngql\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-kube-api-access-5ngql\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:29.328201 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:29.328181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc4c86759-4ngsd"]
Jul 23 11:14:29.330274 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:29.330249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7923730d_7e26_48be_ab03_1fb72df85234.slice/crio-edf1990ca8443e11bcf478b97b6d15b0ca56d5a9d12d9345fc4642bd3926040d WatchSource:0}: Error finding container edf1990ca8443e11bcf478b97b6d15b0ca56d5a9d12d9345fc4642bd3926040d: Status 404 returned error can't find the container with id edf1990ca8443e11bcf478b97b6d15b0ca56d5a9d12d9345fc4642bd3926040d
Jul 23 11:14:30.065452 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.065416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:30.067713 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.067653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvl9r" event={"ID":"2f8ce6d1-a39a-4633-9109-e3e04595e711","Type":"ContainerStarted","Data":"658a329c95c7854609001f497d61a43378425ad653010a0f67b90d5d9e911d10"}
Jul 23 11:14:30.069283 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.069258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd" event={"ID":"7923730d-7e26-48be-ab03-1fb72df85234","Type":"ContainerStarted","Data":"50d1cefa3f368a7197a4d4a42f6d0bc00f024886066cbce30d019017d82e14e2"}
Jul 23 11:14:30.069412 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.069313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd" event={"ID":"7923730d-7e26-48be-ab03-1fb72df85234","Type":"ContainerStarted","Data":"edf1990ca8443e11bcf478b97b6d15b0ca56d5a9d12d9345fc4642bd3926040d"}
Jul 23 11:14:30.069412 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.069326    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579754786b-8kwcj"
Jul 23 11:14:30.069591 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.069570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:30.093143 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.093088    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd" podStartSLOduration=2.093075265 podStartE2EDuration="2.093075265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:30.092006469 +0000 UTC m=+261.218869914" watchObservedRunningTime="2026-07-23 11:14:30.093075265 +0000 UTC m=+261.219938687"
Jul 23 11:14:30.127364 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.127339    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579754786b-8kwcj"]
Jul 23 11:14:30.134233 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.134210    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-579754786b-8kwcj"]
Jul 23 11:14:30.169807 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.169778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:30.284647 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.284623    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9769dcd6-1c5a-4efa-9dd0-da33d0221f99-registry-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:14:30.587212 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.587161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:30.587843 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.587817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68096475-59bd-489d-bbf3-75abe8d33dbe-service-ca-bundle\") pod \"router-default-569c94756d-ml9wr\" (UID: \"68096475-59bd-489d-bbf3-75abe8d33dbe\") " pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:30.617923 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.617894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l6mnh\""
Jul 23 11:14:30.624206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.624185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:30.771545 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:30.771514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-569c94756d-ml9wr"]
Jul 23 11:14:30.775094 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:30.775063    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68096475_59bd_489d_bbf3_75abe8d33dbe.slice/crio-39cea9b050b6c5f6020a29f5976f8142027cd632f509c7303c4ad6a81e68567a WatchSource:0}: Error finding container 39cea9b050b6c5f6020a29f5976f8142027cd632f509c7303c4ad6a81e68567a: Status 404 returned error can't find the container with id 39cea9b050b6c5f6020a29f5976f8142027cd632f509c7303c4ad6a81e68567a
Jul 23 11:14:31.074798 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:31.074764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-569c94756d-ml9wr" event={"ID":"68096475-59bd-489d-bbf3-75abe8d33dbe","Type":"ContainerStarted","Data":"1bd514ea8a3c1a5ac8b4ffbd9b354fc13ec3e8e5df933007f951354431bb818e"}
Jul 23 11:14:31.074976 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:31.074819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-569c94756d-ml9wr" event={"ID":"68096475-59bd-489d-bbf3-75abe8d33dbe","Type":"ContainerStarted","Data":"39cea9b050b6c5f6020a29f5976f8142027cd632f509c7303c4ad6a81e68567a"}
Jul 23 11:14:31.100924 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:31.100867    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-569c94756d-ml9wr" podStartSLOduration=33.100848879 podStartE2EDuration="33.100848879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:31.0989424 +0000 UTC m=+262.225805839" watchObservedRunningTime="2026-07-23 11:14:31.100848879 +0000 UTC m=+262.227712305"
Jul 23 11:14:31.316222 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:31.316192    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9769dcd6-1c5a-4efa-9dd0-da33d0221f99" path="/var/lib/kubelet/pods/9769dcd6-1c5a-4efa-9dd0-da33d0221f99/volumes"
Jul 23 11:14:31.624640 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:31.624590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:31.627235 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:31.627209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:32.078505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:32.078469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:32.079745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:32.079723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-569c94756d-ml9wr"
Jul 23 11:14:33.083011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:33.082980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lvl9r" event={"ID":"2f8ce6d1-a39a-4633-9109-e3e04595e711","Type":"ContainerStarted","Data":"9153974ad8309daadfe6d52ecfdeebdff6cac299520733f655eda0aaef19768b"}
Jul 23 11:14:33.102338 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:33.102192    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lvl9r" podStartSLOduration=17.344127406 podStartE2EDuration="30.102174272s" totalImagesPullingTime="12.758046866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 11:14:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:33.101734279 +0000 UTC m=+264.228597724" watchObservedRunningTime="2026-07-23 11:14:33.102174272 +0000 UTC m=+264.229037697"
Jul 23 11:14:34.284027 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.283997    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dfb6fd9c9-6xsgn"]
Jul 23 11:14:34.286906 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.286889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.293436 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.293413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 11:14:34.293564 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.293435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 11:14:34.293564 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.293413    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 11:14:34.293564 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.293469    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 11:14:34.294051 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.294036    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 11:14:34.294820 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.294806    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 11:14:34.294894 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.294876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bqhsh\""
Jul 23 11:14:34.294940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.294894    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 11:14:34.299351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.299330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dfb6fd9c9-6xsgn"]
Jul 23 11:14:34.418292 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.418258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-serving-cert\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.418404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.418305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-service-ca\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.418404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.418354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-oauth-serving-cert\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.418507 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.418413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-oauth-config\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.418507 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.418458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srx99\" (UniqueName: \"kubernetes.io/projected/4d763889-a109-4b86-a617-ebcab95cb6fa-kube-api-access-srx99\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.418507 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.418500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-console-config\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.519751 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.519729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-oauth-config\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.519839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.519759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srx99\" (UniqueName: \"kubernetes.io/projected/4d763889-a109-4b86-a617-ebcab95cb6fa-kube-api-access-srx99\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.519839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.519777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-console-config\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.519839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.519832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-serving-cert\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.519966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.519855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-service-ca\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.519966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.519880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-oauth-serving-cert\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.520408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.520389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-console-config\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.520504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.520456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-service-ca\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.520543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.520507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-oauth-serving-cert\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.522067 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.522041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-oauth-config\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.522200 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.522183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-serving-cert\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.528972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.528950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srx99\" (UniqueName: \"kubernetes.io/projected/4d763889-a109-4b86-a617-ebcab95cb6fa-kube-api-access-srx99\") pod \"console-dfb6fd9c9-6xsgn\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") " pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.594933 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.594883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:34.737318 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:34.737243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dfb6fd9c9-6xsgn"]
Jul 23 11:14:34.739644 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:34.739599    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d763889_a109_4b86_a617_ebcab95cb6fa.slice/crio-f37fc945f36fda30b253353251811a5bb45341e8a8f51020c9f5ed75cff13974 WatchSource:0}: Error finding container f37fc945f36fda30b253353251811a5bb45341e8a8f51020c9f5ed75cff13974: Status 404 returned error can't find the container with id f37fc945f36fda30b253353251811a5bb45341e8a8f51020c9f5ed75cff13974
Jul 23 11:14:35.089833 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.089797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfb6fd9c9-6xsgn" event={"ID":"4d763889-a109-4b86-a617-ebcab95cb6fa","Type":"ContainerStarted","Data":"f37fc945f36fda30b253353251811a5bb45341e8a8f51020c9f5ed75cff13974"}
Jul 23 11:14:35.766851 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.766815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:35.936239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.936209    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"]
Jul 23 11:14:35.939481 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.939458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:35.942132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.942112    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 11:14:35.942337 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.942316    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4fdc7\""
Jul 23 11:14:35.948355 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.948242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"]
Jul 23 11:14:35.948797 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:35.948727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:36.027572 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.027489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:36.030648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.030520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-kvvbh\" (UID: \"3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:36.131250 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.131218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-kvvbh\" (UID: \"3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:36.131388 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:36.131352    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 11:14:36.131449 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:36.131413    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41-tls-certificates podName:3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:36.63139574 +0000 UTC m=+267.758259149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-kvvbh" (UID: "3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 11:14:36.191215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.191135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:36.468111 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.468037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:36.544642 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.544599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:36.635420 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.635389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-kvvbh\" (UID: \"3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:36.638078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.638057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-kvvbh\" (UID: \"3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:36.852165 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:36.852129    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:37.811592 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:37.811562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"]
Jul 23 11:14:37.816973 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:37.816952    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce6a924_5ffb_4b4e_b7ca_bfe42ab25d41.slice/crio-b31f7a5a700e2841213fadc9d99ce5cb06c273fcb5e497e8dfebb02353efa692 WatchSource:0}: Error finding container b31f7a5a700e2841213fadc9d99ce5cb06c273fcb5e497e8dfebb02353efa692: Status 404 returned error can't find the container with id b31f7a5a700e2841213fadc9d99ce5cb06c273fcb5e497e8dfebb02353efa692
Jul 23 11:14:38.101561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:38.101523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfb6fd9c9-6xsgn" event={"ID":"4d763889-a109-4b86-a617-ebcab95cb6fa","Type":"ContainerStarted","Data":"343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372"}
Jul 23 11:14:38.102596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:38.102577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh" event={"ID":"3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41","Type":"ContainerStarted","Data":"b31f7a5a700e2841213fadc9d99ce5cb06c273fcb5e497e8dfebb02353efa692"}
Jul 23 11:14:38.121658 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:38.121575    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dfb6fd9c9-6xsgn" podStartSLOduration=1.117413659 podStartE2EDuration="4.121561478s" totalImagesPullingTime="3.004147819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:38.120906977 +0000 UTC m=+269.247770400" watchObservedRunningTime="2026-07-23 11:14:38.121561478 +0000 UTC m=+269.248424901"
Jul 23 11:14:40.110763 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:40.110729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh" event={"ID":"3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41","Type":"ContainerStarted","Data":"f085feb4f792860760f102f06192c27ce9b459bf85a138d541c4f9004b6a7d42"}
Jul 23 11:14:40.111171 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:40.110912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:40.115213 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:40.115193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh"
Jul 23 11:14:40.131042 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:40.130998    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-kvvbh" podStartSLOduration=3.040304878 podStartE2EDuration="5.130982025s" totalImagesPullingTime="2.090677147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:40.129904995 +0000 UTC m=+271.256768420" watchObservedRunningTime="2026-07-23 11:14:40.130982025 +0000 UTC m=+271.257845449"
Jul 23 11:14:40.723112 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:40.723078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:40.876141 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:40.876111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:41.104245 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:41.104215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:41.177421 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:41.177387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:41.278269 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:41.278233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:42.673031 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:42.672994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:42.868558 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:42.868505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:43.958455 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:43.958421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:44.595492 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:44.595459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:44.595677 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:44.595518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:14:44.596780 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:44.596760    2578 patch_prober.go:28] interesting pod/console-dfb6fd9c9-6xsgn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body=
Jul 23 11:14:44.596823 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:44.596799    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-dfb6fd9c9-6xsgn" podUID="4d763889-a109-4b86-a617-ebcab95cb6fa" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused"
Jul 23 11:14:46.077208 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:46.077160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:46.177260 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:46.177224    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:47.092805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:47.092774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:47.190497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:47.190455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:47.290362 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:47.290316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:48.995959 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:48.995927    2578 patch_prober.go:28] interesting pod/image-registry-fc4c86759-4ngsd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 11:14:48.996307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:48.995974    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd" podUID="7923730d-7e26-48be-ab03-1fb72df85234" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 11:14:49.774714 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:49.774639    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5mwxv" podUID="8a586995-b097-4f70-8338-3bcae2cb2a4e"
Jul 23 11:14:49.870170 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:49.870132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:50.146122 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:50.146041    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:14:51.078579 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:51.078553    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fc4c86759-4ngsd"
Jul 23 11:14:51.134660 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:51.134627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:51.215400 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:51.215365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:51.315868 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:51.315839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:51.400365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:51.400290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.206280 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.206244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.339722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.339690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.371511 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.371490    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"]
Jul 23 11:14:52.378150 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.378131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.381751 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.381733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 11:14:52.381914 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.381738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 11:14:52.382730 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.382713    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 11:14:52.382824 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.382713    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 11:14:52.382824 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.382739    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 11:14:52.383119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.383104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vd6ql\""
Jul 23 11:14:52.395771 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.395744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"]
Jul 23 11:14:52.411644 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.411620    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-brc27"]
Jul 23 11:14:52.415618 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.415582    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.418324 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.418305    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 11:14:52.418407 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.418306    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 11:14:52.418407 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.418309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 11:14:52.418407 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.418311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rvfbn\""
Jul 23 11:14:52.425681 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.425662    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k6d9c"]
Jul 23 11:14:52.429485 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.429471    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.437452 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:52.437423    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret"
Jul 23 11:14:52.437539 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:52.437459    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-bfcwj\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfcwj\"" type="*v1.Secret"
Jul 23 11:14:52.437856 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:52.437824    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Jul 23 11:14:52.438172 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.438151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-brc27"]
Jul 23 11:14:52.438430 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:52.438407    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret"
Jul 23 11:14:52.455220 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.455186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.554353 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.554522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.554522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.554522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-wtmp\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.554522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-root\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-tls\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-textfile\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.554710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-metrics-client-ca\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh2m2\" (UniqueName: \"kubernetes.io/projected/4497f9e5-a6cf-4a34-913c-c1f759b87452-kube-api-access-rh2m2\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-sys\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5k7\" (UniqueName: \"kubernetes.io/projected/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-api-access-wm5k7\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98pw7\" (UniqueName: \"kubernetes.io/projected/d0b91f50-c496-4449-b88f-e3dd9ffd861b-kube-api-access-98pw7\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.555012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.554940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4497f9e5-a6cf-4a34-913c-c1f759b87452-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.571714 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.571690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.655388 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98pw7\" (UniqueName: \"kubernetes.io/projected/d0b91f50-c496-4449-b88f-e3dd9ffd861b-kube-api-access-98pw7\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655388 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4497f9e5-a6cf-4a34-913c-c1f759b87452-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-wtmp\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-root\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655570 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-tls\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-textfile\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-metrics-client-ca\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh2m2\" (UniqueName: \"kubernetes.io/projected/4497f9e5-a6cf-4a34-913c-c1f759b87452-kube-api-access-rh2m2\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-sys\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.655925 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5k7\" (UniqueName: \"kubernetes.io/projected/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-api-access-wm5k7\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.655917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-wtmp\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-textfile\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4497f9e5-a6cf-4a34-913c-c1f759b87452-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656267    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-root\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.656380 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b91f50-c496-4449-b88f-e3dd9ffd861b-sys\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.656717 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:52.656526    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 23 11:14:52.656717 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:52.656602    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-tls podName:4497f9e5-a6cf-4a34-913c-c1f759b87452 nodeName:}" failed. No retries permitted until 2026-07-23 11:14:53.156585825 +0000 UTC m=+284.283449235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-7bkws" (UID: "4497f9e5-a6cf-4a34-913c-c1f759b87452") : secret "openshift-state-metrics-tls" not found
Jul 23 11:14:52.656717 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.656717 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.656709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-metrics-client-ca\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.657136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.657113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.658310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.658291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.658415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.658401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.658472 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.658404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.666331 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.666309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98pw7\" (UniqueName: \"kubernetes.io/projected/d0b91f50-c496-4449-b88f-e3dd9ffd861b-kube-api-access-98pw7\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:52.666743 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.666726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5k7\" (UniqueName: \"kubernetes.io/projected/67a5ee68-4ffb-4bc3-a29d-c463ee81fce2-kube-api-access-wm5k7\") pod \"kube-state-metrics-56c5594674-brc27\" (UID: \"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.668121 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.668100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh2m2\" (UniqueName: \"kubernetes.io/projected/4497f9e5-a6cf-4a34-913c-c1f759b87452-kube-api-access-rh2m2\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:52.723389 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.723369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27"
Jul 23 11:14:52.770482 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.770446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.854880 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.854703    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-brc27"]
Jul 23 11:14:52.857406 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:52.857372    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a5ee68_4ffb_4bc3_a29d_c463ee81fce2.slice/crio-10680d322f7f1f5ee09165af62bd0d30cc16f6cbabc2885f041ae60ef29efb02 WatchSource:0}: Error finding container 10680d322f7f1f5ee09165af62bd0d30cc16f6cbabc2885f041ae60ef29efb02: Status 404 returned error can't find the container with id 10680d322f7f1f5ee09165af62bd0d30cc16f6cbabc2885f041ae60ef29efb02
Jul 23 11:14:52.857705 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.857673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:52.956928 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:52.956901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:53.159274 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.159193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:53.160760 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.160733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27" event={"ID":"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2","Type":"ContainerStarted","Data":"10680d322f7f1f5ee09165af62bd0d30cc16f6cbabc2885f041ae60ef29efb02"}
Jul 23 11:14:53.161695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.161677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4497f9e5-a6cf-4a34-913c-c1f759b87452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-7bkws\" (UID: \"4497f9e5-a6cf-4a34-913c-c1f759b87452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:53.267596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.267578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 11:14:53.279073 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.279052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-tls\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:53.287095 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.287081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"
Jul 23 11:14:53.333523 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.333469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:53.416750 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.416728    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws"]
Jul 23 11:14:53.417884 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:53.417859    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4497f9e5_a6cf_4a34_913c_c1f759b87452.slice/crio-ac5d0054db78cc48af4fe5ff76b60c3de7fd3b3274e00611d1f606997512517e WatchSource:0}: Error finding container ac5d0054db78cc48af4fe5ff76b60c3de7fd3b3274e00611d1f606997512517e: Status 404 returned error can't find the container with id ac5d0054db78cc48af4fe5ff76b60c3de7fd3b3274e00611d1f606997512517e
Jul 23 11:14:53.418818 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.418778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:53.504119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.504095    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 11:14:53.508069 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.508049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 11:14:53.509000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.508977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.511516 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.511501    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9ncm2\""
Jul 23 11:14:53.512682 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.512668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 11:14:53.512798 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.512787    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 11:14:53.512996 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.512978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 11:14:53.513042 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.512978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 11:14:53.513080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.513038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 11:14:53.513129 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.513044    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 11:14:53.513405 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.513393    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 11:14:53.513545 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.513533    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 11:14:53.513723 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.513709    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 11:14:53.519950 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.519922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:53.524853 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.524835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 11:14:53.562409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a83c791-9693-45a8-886a-6266951e2569-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a83c791-9693-45a8-886a-6266951e2569-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcx9\" (UniqueName: \"kubernetes.io/projected/5a83c791-9693-45a8-886a-6266951e2569-kube-api-access-ndcx9\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a83c791-9693-45a8-886a-6266951e2569-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-web-config\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562714 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a83c791-9693-45a8-886a-6266951e2569-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562714 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562846 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a83c791-9693-45a8-886a-6266951e2569-config-out\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.562874 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.562853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.656438 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:53.656411    2578 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition
Jul 23 11:14:53.656567 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:14:53.656494    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-accelerators-collector-config podName:d0b91f50-c496-4449-b88f-e3dd9ffd861b nodeName:}" failed. No retries permitted until 2026-07-23 11:14:54.156472368 +0000 UTC m=+285.283335776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-accelerators-collector-config") pod "node-exporter-k6d9c" (UID: "d0b91f50-c496-4449-b88f-e3dd9ffd861b") : failed to sync configmap cache: timed out waiting for the condition
Jul 23 11:14:53.663409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a83c791-9693-45a8-886a-6266951e2569-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a83c791-9693-45a8-886a-6266951e2569-config-out\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:14:53.663837 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663837 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a83c791-9693-45a8-886a-6266951e2569-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663837 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a83c791-9693-45a8-886a-6266951e2569-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcx9\" (UniqueName: \"kubernetes.io/projected/5a83c791-9693-45a8-886a-6266951e2569-kube-api-access-ndcx9\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a83c791-9693-45a8-886a-6266951e2569-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-web-config\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.663980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.663926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.665478 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.664359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a83c791-9693-45a8-886a-6266951e2569-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.665478 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.664760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a83c791-9693-45a8-886a-6266951e2569-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.665478 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.665067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a83c791-9693-45a8-886a-6266951e2569-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.667963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.667498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.667963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.667634    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.667963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.667902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.667963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.667927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.668564 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.668547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a83c791-9693-45a8-886a-6266951e2569-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.669274 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.668715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-web-config\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.669274 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.669116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.669493 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.669460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a586995-b097-4f70-8338-3bcae2cb2a4e-metrics-tls\") pod \"dns-default-5mwxv\" (UID: \"8a586995-b097-4f70-8338-3bcae2cb2a4e\") " pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:14:53.669905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.669887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a83c791-9693-45a8-886a-6266951e2569-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.670116 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.670095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a83c791-9693-45a8-886a-6266951e2569-config-out\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.674840 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.674819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcx9\" (UniqueName: \"kubernetes.io/projected/5a83c791-9693-45a8-886a-6266951e2569-kube-api-access-ndcx9\") pod \"alertmanager-main-0\" (UID: \"5a83c791-9693-45a8-886a-6266951e2569\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.720856 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.720836    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 11:14:53.734533 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.734509    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dfb6fd9c9-6xsgn"]
Jul 23 11:14:53.748833 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.748814    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxmt4\""
Jul 23 11:14:53.757231 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.757214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:14:53.827586 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.827563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 11:14:53.910972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.910945    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5mwxv"]
Jul 23 11:14:53.913862 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:53.913830    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a586995_b097_4f70_8338_3bcae2cb2a4e.slice/crio-4aba11e1ab2e8be5b77a5d0dc589fa71e3cf382045a9b96c8ee159ccef806b09 WatchSource:0}: Error finding container 4aba11e1ab2e8be5b77a5d0dc589fa71e3cf382045a9b96c8ee159ccef806b09: Status 404 returned error can't find the container with id 4aba11e1ab2e8be5b77a5d0dc589fa71e3cf382045a9b96c8ee159ccef806b09
Jul 23 11:14:53.984078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.984049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfcwj\""
Jul 23 11:14:53.989447 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:53.989419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 11:14:53.993410 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:53.993385    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a83c791_9693_45a8_886a_6266951e2569.slice/crio-d6d8dba56b838ac89fcf994f1caaa60d38581c061bc91c35ff35c0ac6aaf84aa WatchSource:0}: Error finding container d6d8dba56b838ac89fcf994f1caaa60d38581c061bc91c35ff35c0ac6aaf84aa: Status 404 returned error can't find the container with id d6d8dba56b838ac89fcf994f1caaa60d38581c061bc91c35ff35c0ac6aaf84aa
Jul 23 11:14:54.166351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.166268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"d6d8dba56b838ac89fcf994f1caaa60d38581c061bc91c35ff35c0ac6aaf84aa"}
Jul 23 11:14:54.167635 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.167570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mwxv" event={"ID":"8a586995-b097-4f70-8338-3bcae2cb2a4e","Type":"ContainerStarted","Data":"4aba11e1ab2e8be5b77a5d0dc589fa71e3cf382045a9b96c8ee159ccef806b09"}
Jul 23 11:14:54.168150 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.168120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:54.168721 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.168697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b91f50-c496-4449-b88f-e3dd9ffd861b-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6d9c\" (UID: \"d0b91f50-c496-4449-b88f-e3dd9ffd861b\") " pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:54.169788 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.169761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws" event={"ID":"4497f9e5-a6cf-4a34-913c-c1f759b87452","Type":"ContainerStarted","Data":"a1c9a63c4dd1d93d81324407b2955116617e3ee64d2b7962539832d3a27c77e3"}
Jul 23 11:14:54.169879 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.169820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws" event={"ID":"4497f9e5-a6cf-4a34-913c-c1f759b87452","Type":"ContainerStarted","Data":"06ed9eb78b8c6b4804ded5b802de3b5cd161092d6bb5651398d04435fc343d7b"}
Jul 23 11:14:54.169879 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.169855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws" event={"ID":"4497f9e5-a6cf-4a34-913c-c1f759b87452","Type":"ContainerStarted","Data":"ac5d0054db78cc48af4fe5ff76b60c3de7fd3b3274e00611d1f606997512517e"}
Jul 23 11:14:54.202186 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.202128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:54.237467 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.237443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k6d9c"
Jul 23 11:14:54.300741 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.300715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:54.401641 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:54.401583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:54.637479 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:54.637452    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b91f50_c496_4449_b88f_e3dd9ffd861b.slice/crio-14bfc1f3b13ee0f878d8219894dfbd9bdb0f07a42b6091685b6133d89aff1080 WatchSource:0}: Error finding container 14bfc1f3b13ee0f878d8219894dfbd9bdb0f07a42b6091685b6133d89aff1080: Status 404 returned error can't find the container with id 14bfc1f3b13ee0f878d8219894dfbd9bdb0f07a42b6091685b6133d89aff1080
Jul 23 11:14:55.183557 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.183479    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27" event={"ID":"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2","Type":"ContainerStarted","Data":"b6a40ef16e16cb413f9521065d095d37fc0dad95a1a9aa373f1b5ad1aa4e8d7b"}
Jul 23 11:14:55.184648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.184555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27" event={"ID":"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2","Type":"ContainerStarted","Data":"fac9c148f6d16a71c89fe21a97e3a7df56ed1c0e593ddf62c3e88dc1cdffce68"}
Jul 23 11:14:55.184648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.184594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27" event={"ID":"67a5ee68-4ffb-4bc3-a29d-c463ee81fce2","Type":"ContainerStarted","Data":"43e60a1ffc8740bf419ab1e75f7184d6a840459e6104ead42d427afc2c815c11"}
Jul 23 11:14:55.186900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.186876    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws" event={"ID":"4497f9e5-a6cf-4a34-913c-c1f759b87452","Type":"ContainerStarted","Data":"069a1e5a089fcbf7686f0179750c300be964ba81f28767a1e8dff2f645be7997"}
Jul 23 11:14:55.189307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.189276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6d9c" event={"ID":"d0b91f50-c496-4449-b88f-e3dd9ffd861b","Type":"ContainerStarted","Data":"14bfc1f3b13ee0f878d8219894dfbd9bdb0f07a42b6091685b6133d89aff1080"}
Jul 23 11:14:55.211886 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.211460    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-brc27" podStartSLOduration=1.434189439 podStartE2EDuration="3.211440246s" totalImagesPullingTime="1.777250807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:55.208834231 +0000 UTC m=+286.335697681" watchObservedRunningTime="2026-07-23 11:14:55.211440246 +0000 UTC m=+286.338303670"
Jul 23 11:14:55.240046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.238085    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-7bkws" podStartSLOduration=2.136421294 podStartE2EDuration="3.238065685s" totalImagesPullingTime="1.101644391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:55.237900859 +0000 UTC m=+286.364764285" watchObservedRunningTime="2026-07-23 11:14:55.238065685 +0000 UTC m=+286.364929113"
Jul 23 11:14:55.476588 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.476511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:55.548182 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.548150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:55.615559 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.615524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:55.955438 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:55.955401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:56.485993 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:56.485918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:57.147246 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.147211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:57.198141 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.198113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mwxv" event={"ID":"8a586995-b097-4f70-8338-3bcae2cb2a4e","Type":"ContainerStarted","Data":"0f9c6b21c48b75696a1c2d491d00c16ef491f8de3598ab8a18d44941247af07e"}
Jul 23 11:14:57.198287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.198162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5mwxv" event={"ID":"8a586995-b097-4f70-8338-3bcae2cb2a4e","Type":"ContainerStarted","Data":"e96471a172f9671218b710803c804c961449ddb67ef113d71eae4fd833950723"}
Jul 23 11:14:57.198287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.198216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:14:57.199775 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.199754    2578 generic.go:356] "Generic (PLEG): container finished" podID="d0b91f50-c496-4449-b88f-e3dd9ffd861b" containerID="51fcaa0b7dba92054bd6f200a7fdc834571741b89c2d33a33697e97384cf701a" exitCode=0
Jul 23 11:14:57.199874 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.199779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6d9c" event={"ID":"d0b91f50-c496-4449-b88f-e3dd9ffd861b","Type":"ContainerDied","Data":"51fcaa0b7dba92054bd6f200a7fdc834571741b89c2d33a33697e97384cf701a"}
Jul 23 11:14:57.201327 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.201306    2578 generic.go:356] "Generic (PLEG): container finished" podID="5a83c791-9693-45a8-886a-6266951e2569" containerID="04a15aa870846b56eb6474e0f6688e34de97e7d4e61b2003c496fa1652896e75" exitCode=0
Jul 23 11:14:57.201413 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.201377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerDied","Data":"04a15aa870846b56eb6474e0f6688e34de97e7d4e61b2003c496fa1652896e75"}
Jul 23 11:14:57.208449 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.208425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:57.222288 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.222246    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5mwxv" podStartSLOduration=251.932533368 podStartE2EDuration="4m14.222234014s" totalImagesPullingTime="2.289700646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:57.221269276 +0000 UTC m=+288.348132700" watchObservedRunningTime="2026-07-23 11:14:57.222234014 +0000 UTC m=+288.349097438"
Jul 23 11:14:57.266812 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.266791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:57.674780 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.674706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bb49f8956-pc4d6"]
Jul 23 11:14:57.688556 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.688531    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.691324 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.691302    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb49f8956-pc4d6"]
Jul 23 11:14:57.696492 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.696471    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 11:14:57.696986 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.696967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-serving-cert\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.697086 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.697001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcm7x\" (UniqueName: \"kubernetes.io/projected/05937068-d3da-4e9a-b725-8e249f22463a-kube-api-access-qcm7x\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.697086 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.697029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-console-config\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.697086 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.697070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-trusted-ca-bundle\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.697237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.697137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-service-ca\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.697237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.697182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-oauth-serving-cert\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.697237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.697226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-oauth-config\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798015 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.797983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-service-ca\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-oauth-serving-cert\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-oauth-config\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798521 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-serving-cert\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798521 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcm7x\" (UniqueName: \"kubernetes.io/projected/05937068-d3da-4e9a-b725-8e249f22463a-kube-api-access-qcm7x\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798521 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-console-config\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798521 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-trusted-ca-bundle\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.798871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.798792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-service-ca\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.799180 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.799159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-trusted-ca-bundle\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.799803 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.799777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-console-config\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.799945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.799899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-oauth-serving-cert\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.801917 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.801871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-serving-cert\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.806512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.806485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-oauth-config\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.811398 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.811368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcm7x\" (UniqueName: \"kubernetes.io/projected/05937068-d3da-4e9a-b725-8e249f22463a-kube-api-access-qcm7x\") pod \"console-6bb49f8956-pc4d6\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") " pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:57.905931 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.905891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:57.980047 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.979985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:57.999065 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:57.999044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:14:58.178979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:58.178949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bb49f8956-pc4d6"]
Jul 23 11:14:58.182437 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:14:58.182407    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05937068_d3da_4e9a_b725_8e249f22463a.slice/crio-af5987161b21246968544851350c21a7bc1208651fea43f3169562eda6c7560b WatchSource:0}: Error finding container af5987161b21246968544851350c21a7bc1208651fea43f3169562eda6c7560b: Status 404 returned error can't find the container with id af5987161b21246968544851350c21a7bc1208651fea43f3169562eda6c7560b
Jul 23 11:14:58.211596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:58.211567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6d9c" event={"ID":"d0b91f50-c496-4449-b88f-e3dd9ffd861b","Type":"ContainerStarted","Data":"9f329ea2270522caea8b07c2e035c7d865334b2c31a857267544f0fba9a6ada7"}
Jul 23 11:14:58.211725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:58.211660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6d9c" event={"ID":"d0b91f50-c496-4449-b88f-e3dd9ffd861b","Type":"ContainerStarted","Data":"833962633d33bc36f216464bb47ff2b332d64461554d9e9fca2ecf78faaefc90"}
Jul 23 11:14:58.213774 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:58.213716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb49f8956-pc4d6" event={"ID":"05937068-d3da-4e9a-b725-8e249f22463a","Type":"ContainerStarted","Data":"af5987161b21246968544851350c21a7bc1208651fea43f3169562eda6c7560b"}
Jul 23 11:14:58.239711 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:58.239666    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k6d9c" podStartSLOduration=4.597110227 podStartE2EDuration="6.239647657s" totalImagesPullingTime="1.565946s" totalInitContainerRuntime="76.59143ms" isStatefulPod=true podCreationTimestamp="2026-07-23 11:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:58.235787791 +0000 UTC m=+289.362651214" watchObservedRunningTime="2026-07-23 11:14:58.239647657 +0000 UTC m=+289.366511081"
Jul 23 11:14:58.995287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:58.995237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:59.219748 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:59.219714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb49f8956-pc4d6" event={"ID":"05937068-d3da-4e9a-b725-8e249f22463a","Type":"ContainerStarted","Data":"f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd"}
Jul 23 11:14:59.281958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:59.281911    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bb49f8956-pc4d6" podStartSLOduration=2.281892181 podStartE2EDuration="2.281892181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:14:59.280648134 +0000 UTC m=+290.407511570" watchObservedRunningTime="2026-07-23 11:14:59.281892181 +0000 UTC m=+290.408755666"
Jul 23 11:14:59.444409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:59.444380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:14:59.544473 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:14:59.544444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:00.227077 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.227045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"7f0a5f823cdc759bd27da8ed7e5bb58a626f780f7ada68a647d2376f08540aee"}
Jul 23 11:15:00.227408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.227113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"85d6d1a106e85b45c3bf12a15da55b9021dc4c078463297e4d46adbeb01332a2"}
Jul 23 11:15:00.227408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.227139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"b3406c5b63de2540e98d79db21978cb8e27d05948664d25e8fc652c93d852690"}
Jul 23 11:15:00.227408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.227163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"cc8efc8247fcac34b2f68623d78059a1b4cfaa57881bed4287950aaa167433e5"}
Jul 23 11:15:00.227408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.227190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"f7f2e0212b809b0d286c3d5a79c266ead261c8b1b354e4ba16654c44ad4240a9"}
Jul 23 11:15:00.833731 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.833679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:00.933877 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:00.933837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:02.237968 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:02.237935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a83c791-9693-45a8-886a-6266951e2569","Type":"ContainerStarted","Data":"039b2f07aa264c20fe931a8ddead0f9c121cfddde9c34e0a0514945f8d1da308"}
Jul 23 11:15:02.272920 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:02.272865    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.574129743 podStartE2EDuration="9.272850433s" totalImagesPullingTime="5.681005846s" totalInitContainerRuntime="17.714844ms" isStatefulPod=false podCreationTimestamp="2026-07-23 11:14:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:15:02.271254595 +0000 UTC m=+293.398118048" watchObservedRunningTime="2026-07-23 11:15:02.272850433 +0000 UTC m=+293.399713856"
Jul 23 11:15:02.315687 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:02.315653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:02.418705 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:02.418668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:04.317799 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.317766    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb49f8956-pc4d6"]
Jul 23 11:15:04.368813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.368780    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58db8f4f7c-v6vgs"]
Jul 23 11:15:04.383114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.383084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.385178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.385122    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58db8f4f7c-v6vgs"]
Jul 23 11:15:04.453791 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-config\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.453966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7nvq\" (UniqueName: \"kubernetes.io/projected/c354e3bd-8f59-47d8-9902-928c9d0bf44c-kube-api-access-q7nvq\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.453966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-service-ca\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.453966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-oauth-serving-cert\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.453966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-trusted-ca-bundle\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.453966 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-oauth-config\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.454165 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.453983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-serving-cert\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555104 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-oauth-config\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555104 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-serving-cert\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-config\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7nvq\" (UniqueName: \"kubernetes.io/projected/c354e3bd-8f59-47d8-9902-928c9d0bf44c-kube-api-access-q7nvq\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-service-ca\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-oauth-serving-cert\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.555593 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-trusted-ca-bundle\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.556012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-config\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.556119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.555989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-oauth-serving-cert\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.556119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.556065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-service-ca\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.556555 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.556531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-trusted-ca-bundle\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.557938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.557912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-serving-cert\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.557938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.557929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-oauth-config\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.563666 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.563644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7nvq\" (UniqueName: \"kubernetes.io/projected/c354e3bd-8f59-47d8-9902-928c9d0bf44c-kube-api-access-q7nvq\") pod \"console-58db8f4f7c-v6vgs\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") " pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.694146 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.694065    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:04.832190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:04.832163    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58db8f4f7c-v6vgs"]
Jul 23 11:15:04.833778 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:15:04.833748    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc354e3bd_8f59_47d8_9902_928c9d0bf44c.slice/crio-8a7f68f902eec7b2e431feb0ae2c33086e89314c9e395090bd08e0c3cf29197a WatchSource:0}: Error finding container 8a7f68f902eec7b2e431feb0ae2c33086e89314c9e395090bd08e0c3cf29197a: Status 404 returned error can't find the container with id 8a7f68f902eec7b2e431feb0ae2c33086e89314c9e395090bd08e0c3cf29197a
Jul 23 11:15:05.254368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:05.254311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db8f4f7c-v6vgs" event={"ID":"c354e3bd-8f59-47d8-9902-928c9d0bf44c","Type":"ContainerStarted","Data":"2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5"}
Jul 23 11:15:05.254528 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:05.254378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db8f4f7c-v6vgs" event={"ID":"c354e3bd-8f59-47d8-9902-928c9d0bf44c","Type":"ContainerStarted","Data":"8a7f68f902eec7b2e431feb0ae2c33086e89314c9e395090bd08e0c3cf29197a"}
Jul 23 11:15:05.279068 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:05.279020    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58db8f4f7c-v6vgs" podStartSLOduration=1.279005105 podStartE2EDuration="1.279005105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:15:05.277361308 +0000 UTC m=+296.404224732" watchObservedRunningTime="2026-07-23 11:15:05.279005105 +0000 UTC m=+296.405868528"
Jul 23 11:15:06.271458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:06.271425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:06.371619 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:06.371560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:07.216385 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:07.216356    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5mwxv"
Jul 23 11:15:07.999423 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:07.999391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:15:09.204866 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:09.204835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:15:09.205347 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:09.204837    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:15:09.221499 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:09.221478    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 11:15:09.913873 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:09.913836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:09.977732 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:09.977707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:14.694844 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:14.694813    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:14.695290 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:14.694897    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:14.699507 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:14.699487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:15.300703 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:15.300673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:15:15.470719 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:15.470683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:15.570952 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:15.570879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:15.672032 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:15.672000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:16.357827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:16.357797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:18.753792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:18.753753    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dfb6fd9c9-6xsgn" podUID="4d763889-a109-4b86-a617-ebcab95cb6fa" containerName="console" containerID="cri-o://343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372" gracePeriod=15
Jul 23 11:15:18.998428 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:18.998405    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:15:19.067889 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.067860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-service-ca\") pod \"4d763889-a109-4b86-a617-ebcab95cb6fa\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") "
Jul 23 11:15:19.068044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.067907    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srx99\" (UniqueName: \"kubernetes.io/projected/4d763889-a109-4b86-a617-ebcab95cb6fa-kube-api-access-srx99\") pod \"4d763889-a109-4b86-a617-ebcab95cb6fa\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") "
Jul 23 11:15:19.068044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.067932    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-console-config\") pod \"4d763889-a109-4b86-a617-ebcab95cb6fa\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") "
Jul 23 11:15:19.068044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.067968    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-oauth-config\") pod \"4d763889-a109-4b86-a617-ebcab95cb6fa\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") "
Jul 23 11:15:19.068044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.068001    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-serving-cert\") pod \"4d763889-a109-4b86-a617-ebcab95cb6fa\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") "
Jul 23 11:15:19.068251 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.068168    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-oauth-serving-cert\") pod \"4d763889-a109-4b86-a617-ebcab95cb6fa\" (UID: \"4d763889-a109-4b86-a617-ebcab95cb6fa\") "
Jul 23 11:15:19.068307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.068253    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d763889-a109-4b86-a617-ebcab95cb6fa" (UID: "4d763889-a109-4b86-a617-ebcab95cb6fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:19.068401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.068378    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-console-config" (OuterVolumeSpecName: "console-config") pod "4d763889-a109-4b86-a617-ebcab95cb6fa" (UID: "4d763889-a109-4b86-a617-ebcab95cb6fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:19.068503 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.068432    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:19.068634 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.068533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d763889-a109-4b86-a617-ebcab95cb6fa" (UID: "4d763889-a109-4b86-a617-ebcab95cb6fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:19.070272 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.070254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d763889-a109-4b86-a617-ebcab95cb6fa" (UID: "4d763889-a109-4b86-a617-ebcab95cb6fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:15:19.070532 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.070513    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d763889-a109-4b86-a617-ebcab95cb6fa" (UID: "4d763889-a109-4b86-a617-ebcab95cb6fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:15:19.070590 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.070537    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d763889-a109-4b86-a617-ebcab95cb6fa-kube-api-access-srx99" (OuterVolumeSpecName: "kube-api-access-srx99") pod "4d763889-a109-4b86-a617-ebcab95cb6fa" (UID: "4d763889-a109-4b86-a617-ebcab95cb6fa"). InnerVolumeSpecName "kube-api-access-srx99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:15:19.169136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.169094    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srx99\" (UniqueName: \"kubernetes.io/projected/4d763889-a109-4b86-a617-ebcab95cb6fa-kube-api-access-srx99\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:19.169136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.169131    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:19.169136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.169140    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:19.169363 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.169167    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d763889-a109-4b86-a617-ebcab95cb6fa-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:19.169363 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.169175    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d763889-a109-4b86-a617-ebcab95cb6fa-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:19.313692 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.313663    2578 generic.go:356] "Generic (PLEG): container finished" podID="4d763889-a109-4b86-a617-ebcab95cb6fa" containerID="343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372" exitCode=0
Jul 23 11:15:19.313842 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.313765    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dfb6fd9c9-6xsgn"
Jul 23 11:15:19.316405 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.316383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfb6fd9c9-6xsgn" event={"ID":"4d763889-a109-4b86-a617-ebcab95cb6fa","Type":"ContainerDied","Data":"343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372"}
Jul 23 11:15:19.316505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.316419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dfb6fd9c9-6xsgn" event={"ID":"4d763889-a109-4b86-a617-ebcab95cb6fa","Type":"ContainerDied","Data":"f37fc945f36fda30b253353251811a5bb45341e8a8f51020c9f5ed75cff13974"}
Jul 23 11:15:19.316505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.316439    2578 scope.go:117] "RemoveContainer" containerID="343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372"
Jul 23 11:15:19.325520 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.325504    2578 scope.go:117] "RemoveContainer" containerID="343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372"
Jul 23 11:15:19.325781 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:15:19.325762    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372\": container with ID starting with 343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372 not found: ID does not exist" containerID="343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372"
Jul 23 11:15:19.325825 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.325789    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372"} err="failed to get container status \"343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372\": rpc error: code = NotFound desc = could not find container \"343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372\": container with ID starting with 343580e48610cbea875ee89dff2c4f6e1fe7b68844a39f6fe68ab5fa26216372 not found: ID does not exist"
Jul 23 11:15:19.339601 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.339579    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dfb6fd9c9-6xsgn"]
Jul 23 11:15:19.343763 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:19.343744    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dfb6fd9c9-6xsgn"]
Jul 23 11:15:21.316036 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:21.316008    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d763889-a109-4b86-a617-ebcab95cb6fa" path="/var/lib/kubelet/pods/4d763889-a109-4b86-a617-ebcab95cb6fa/volumes"
Jul 23 11:15:29.339541 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.339504    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bb49f8956-pc4d6" podUID="05937068-d3da-4e9a-b725-8e249f22463a" containerName="console" containerID="cri-o://f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd" gracePeriod=15
Jul 23 11:15:29.575013 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.574992    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:15:29.640672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcm7x\" (UniqueName: \"kubernetes.io/projected/05937068-d3da-4e9a-b725-8e249f22463a-kube-api-access-qcm7x\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.640672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640652    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-oauth-serving-cert\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.640860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-serving-cert\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.640860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-console-config\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.640860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-oauth-config\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.640860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640754    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-trusted-ca-bundle\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.640860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.640805    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-service-ca\") pod \"05937068-d3da-4e9a-b725-8e249f22463a\" (UID: \"05937068-d3da-4e9a-b725-8e249f22463a\") "
Jul 23 11:15:29.641256 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.641214    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-console-config" (OuterVolumeSpecName: "console-config") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:29.641256 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.641231    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:29.641256 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.641248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:29.641447 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.641320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-service-ca" (OuterVolumeSpecName: "service-ca") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:15:29.642795 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.642765    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:15:29.642795 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.642784    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:15:29.642916 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.642841    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05937068-d3da-4e9a-b725-8e249f22463a-kube-api-access-qcm7x" (OuterVolumeSpecName: "kube-api-access-qcm7x") pod "05937068-d3da-4e9a-b725-8e249f22463a" (UID: "05937068-d3da-4e9a-b725-8e249f22463a"). InnerVolumeSpecName "kube-api-access-qcm7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:15:29.742071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742037    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:29.742071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742063    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcm7x\" (UniqueName: \"kubernetes.io/projected/05937068-d3da-4e9a-b725-8e249f22463a-kube-api-access-qcm7x\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:29.742071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742072    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:29.742071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742081    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:29.742294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742090    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:29.742294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742098    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05937068-d3da-4e9a-b725-8e249f22463a-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:29.742294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:29.742105    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05937068-d3da-4e9a-b725-8e249f22463a-trusted-ca-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:15:30.355500 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.355464    2578 generic.go:356] "Generic (PLEG): container finished" podID="05937068-d3da-4e9a-b725-8e249f22463a" containerID="f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd" exitCode=0
Jul 23 11:15:30.355904 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.355524    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bb49f8956-pc4d6"
Jul 23 11:15:30.355904 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.355530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb49f8956-pc4d6" event={"ID":"05937068-d3da-4e9a-b725-8e249f22463a","Type":"ContainerDied","Data":"f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd"}
Jul 23 11:15:30.355904 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.355577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bb49f8956-pc4d6" event={"ID":"05937068-d3da-4e9a-b725-8e249f22463a","Type":"ContainerDied","Data":"af5987161b21246968544851350c21a7bc1208651fea43f3169562eda6c7560b"}
Jul 23 11:15:30.355904 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.355627    2578 scope.go:117] "RemoveContainer" containerID="f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd"
Jul 23 11:15:30.364296 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.364280    2578 scope.go:117] "RemoveContainer" containerID="f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd"
Jul 23 11:15:30.364546 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:15:30.364524    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd\": container with ID starting with f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd not found: ID does not exist" containerID="f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd"
Jul 23 11:15:30.364589 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.364553    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd"} err="failed to get container status \"f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd\": rpc error: code = NotFound desc = could not find container \"f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd\": container with ID starting with f791d1ea4b7aecc0b88c48fbccc2984219bca727255bcd54c21f6f6975710cdd not found: ID does not exist"
Jul 23 11:15:30.380284 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.380260    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bb49f8956-pc4d6"]
Jul 23 11:15:30.387711 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:30.387691    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bb49f8956-pc4d6"]
Jul 23 11:15:31.316235 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:31.316207    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05937068-d3da-4e9a-b725-8e249f22463a" path="/var/lib/kubelet/pods/05937068-d3da-4e9a-b725-8e249f22463a/volumes"
Jul 23 11:15:36.288182 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:36.288146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:36.362169 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:36.362139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:36.925598 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:36.925559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:15:37.025864 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:15:37.025839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:01.927141 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:01.927060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:02.026554 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:02.026520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:08.749861 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:08.749830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:08.853709 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:08.853679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:16.522762 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.522730    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88784b4b-xzdhd"]
Jul 23 11:16:16.523239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.523059    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05937068-d3da-4e9a-b725-8e249f22463a" containerName="console"
Jul 23 11:16:16.523239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.523072    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="05937068-d3da-4e9a-b725-8e249f22463a" containerName="console"
Jul 23 11:16:16.523239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.523087    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d763889-a109-4b86-a617-ebcab95cb6fa" containerName="console"
Jul 23 11:16:16.523239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.523092    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d763889-a109-4b86-a617-ebcab95cb6fa" containerName="console"
Jul 23 11:16:16.523239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.523149    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="05937068-d3da-4e9a-b725-8e249f22463a" containerName="console"
Jul 23 11:16:16.523239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.523159    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d763889-a109-4b86-a617-ebcab95cb6fa" containerName="console"
Jul 23 11:16:16.527598 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.527575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.536928 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.536906    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88784b4b-xzdhd"]
Jul 23 11:16:16.571958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.571920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:16.609000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.608974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-serving-cert\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.609000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.609000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-service-ca\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.609178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.609017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-oauth-serving-cert\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.609178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.609034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-trusted-ca-bundle\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.609178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.609161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-config\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.609338 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.609197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgz5\" (UniqueName: \"kubernetes.io/projected/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-kube-api-access-ktgz5\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.609338 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.609251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-oauth-config\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.664657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.664623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:16.710317 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-oauth-config\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.710403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-serving-cert\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.710403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-service-ca\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.710403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-oauth-serving-cert\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.710403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-trusted-ca-bundle\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.710540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-config\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.710540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.710444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgz5\" (UniqueName: \"kubernetes.io/projected/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-kube-api-access-ktgz5\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.711088 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.711061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-oauth-serving-cert\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.711185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.711150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-service-ca\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.711235 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.711188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-config\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.711377 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.711359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-trusted-ca-bundle\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.712856 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.712831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-oauth-config\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.712930 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.712856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-serving-cert\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.719787 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.719766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgz5\" (UniqueName: \"kubernetes.io/projected/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-kube-api-access-ktgz5\") pod \"console-88784b4b-xzdhd\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") " pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.837772 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.837724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:16.961659 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:16.961582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88784b4b-xzdhd"]
Jul 23 11:16:16.963778 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:16:16.963737    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35857bcb_b83e_4629_afcf_6fda7d2a2dcb.slice/crio-72619b73395de2d4ee884f0bb3a8cd994a4ea26a831e5dc214ca2cd1f011ac81 WatchSource:0}: Error finding container 72619b73395de2d4ee884f0bb3a8cd994a4ea26a831e5dc214ca2cd1f011ac81: Status 404 returned error can't find the container with id 72619b73395de2d4ee884f0bb3a8cd994a4ea26a831e5dc214ca2cd1f011ac81
Jul 23 11:16:17.534894 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:17.534863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88784b4b-xzdhd" event={"ID":"35857bcb-b83e-4629-afcf-6fda7d2a2dcb","Type":"ContainerStarted","Data":"634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341"}
Jul 23 11:16:17.535240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:17.534908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88784b4b-xzdhd" event={"ID":"35857bcb-b83e-4629-afcf-6fda7d2a2dcb","Type":"ContainerStarted","Data":"72619b73395de2d4ee884f0bb3a8cd994a4ea26a831e5dc214ca2cd1f011ac81"}
Jul 23 11:16:17.556148 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:17.556108    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88784b4b-xzdhd" podStartSLOduration=1.556094656 podStartE2EDuration="1.556094656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:16:17.555327865 +0000 UTC m=+368.682191290" watchObservedRunningTime="2026-07-23 11:16:17.556094656 +0000 UTC m=+368.682958080"
Jul 23 11:16:20.710669 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:20.710629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:20.829063 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:20.829029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:26.838844 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:26.838807    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:26.839212 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:26.838866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:26.843438 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:26.843412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:27.576497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:27.576471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:16:27.625279 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:27.625235    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58db8f4f7c-v6vgs"]
Jul 23 11:16:27.737898 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:27.737860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:27.840624 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:27.840501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:27.924729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:27.924694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:30.334371 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:30.334334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:36.271313 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:36.271277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:36.375088 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:36.375056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:16:52.649032 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:52.648982    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58db8f4f7c-v6vgs" podUID="c354e3bd-8f59-47d8-9902-928c9d0bf44c" containerName="console" containerID="cri-o://2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5" gracePeriod=15
Jul 23 11:16:52.893263 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:52.893239    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:16:53.001697 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001630    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-service-ca\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.001697 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001679    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-trusted-ca-bundle\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.001852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-serving-cert\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.001852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-oauth-config\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.001852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001756    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-config\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.001852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7nvq\" (UniqueName: \"kubernetes.io/projected/c354e3bd-8f59-47d8-9902-928c9d0bf44c-kube-api-access-q7nvq\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.001852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.001817    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-oauth-serving-cert\") pod \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\" (UID: \"c354e3bd-8f59-47d8-9902-928c9d0bf44c\") "
Jul 23 11:16:53.002140 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.002111    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-service-ca" (OuterVolumeSpecName: "service-ca") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:16:53.002228 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.002199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-config" (OuterVolumeSpecName: "console-config") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:16:53.002305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.002279    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:16:53.002305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.002294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:16:53.003792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.003771    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:16:53.003887 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.003869    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c354e3bd-8f59-47d8-9902-928c9d0bf44c-kube-api-access-q7nvq" (OuterVolumeSpecName: "kube-api-access-q7nvq") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "kube-api-access-q7nvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:16:53.003928 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.003904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c354e3bd-8f59-47d8-9902-928c9d0bf44c" (UID: "c354e3bd-8f59-47d8-9902-928c9d0bf44c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:16:53.102927 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102893    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-trusted-ca-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.102927 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102925    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.102927 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102936    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.103084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102946    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.103084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102956    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7nvq\" (UniqueName: \"kubernetes.io/projected/c354e3bd-8f59-47d8-9902-928c9d0bf44c-kube-api-access-q7nvq\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.103084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102964    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.103084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.102972    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c354e3bd-8f59-47d8-9902-928c9d0bf44c-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:16:53.678646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.678563    2578 generic.go:356] "Generic (PLEG): container finished" podID="c354e3bd-8f59-47d8-9902-928c9d0bf44c" containerID="2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5" exitCode=0
Jul 23 11:16:53.678646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.678615    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58db8f4f7c-v6vgs"
Jul 23 11:16:53.678646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.678631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db8f4f7c-v6vgs" event={"ID":"c354e3bd-8f59-47d8-9902-928c9d0bf44c","Type":"ContainerDied","Data":"2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5"}
Jul 23 11:16:53.679044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.678670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58db8f4f7c-v6vgs" event={"ID":"c354e3bd-8f59-47d8-9902-928c9d0bf44c","Type":"ContainerDied","Data":"8a7f68f902eec7b2e431feb0ae2c33086e89314c9e395090bd08e0c3cf29197a"}
Jul 23 11:16:53.679044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.678690    2578 scope.go:117] "RemoveContainer" containerID="2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5"
Jul 23 11:16:53.686786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.686769    2578 scope.go:117] "RemoveContainer" containerID="2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5"
Jul 23 11:16:53.687069 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:16:53.687049    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5\": container with ID starting with 2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5 not found: ID does not exist" containerID="2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5"
Jul 23 11:16:53.687128 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.687075    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5"} err="failed to get container status \"2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5\": rpc error: code = NotFound desc = could not find container \"2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5\": container with ID starting with 2c47b24b9285c0ee0956f6b4ea9005cdbd3f5090441673acf27d2e0baf8600f5 not found: ID does not exist"
Jul 23 11:16:53.696695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.696674    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58db8f4f7c-v6vgs"]
Jul 23 11:16:53.700690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:53.700671    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58db8f4f7c-v6vgs"]
Jul 23 11:16:55.316866 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:16:55.316827    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c354e3bd-8f59-47d8-9902-928c9d0bf44c" path="/var/lib/kubelet/pods/c354e3bd-8f59-47d8-9902-928c9d0bf44c/volumes"
Jul 23 11:17:04.364107 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:04.364074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:04.466198 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:04.466164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:32.820469 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:32.820383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:33.600834 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:33.600793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:50.475956 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:50.475918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:54.652460 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:54.652424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:55.646945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:55.646906    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:58.270211 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:58.270174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:58.331643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:58.331596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:59.676088 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:59.676043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:59.819523 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:59.819483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:17:59.912756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:17:59.912725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:02.190921 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:02.190889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:02.403571 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:02.403536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:05.050002 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:05.049960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:05.114653 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:05.114597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:08.648356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:08.648324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:08.949002 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:08.948914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:09.741899 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:09.741869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:12.556854 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:12.556804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:12.651749 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:12.651712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:14.587688 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.587652    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"]
Jul 23 11:18:14.588062 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.587947    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c354e3bd-8f59-47d8-9902-928c9d0bf44c" containerName="console"
Jul 23 11:18:14.588062 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.587957    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c354e3bd-8f59-47d8-9902-928c9d0bf44c" containerName="console"
Jul 23 11:18:14.588062 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.588005    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c354e3bd-8f59-47d8-9902-928c9d0bf44c" containerName="console"
Jul 23 11:18:14.590854 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.590837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.598008 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.597981    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-w8tsz\""
Jul 23 11:18:14.599072 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.599057    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 11:18:14.599123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.599101    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 11:18:14.613835 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.613807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"]
Jul 23 11:18:14.663565 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.663528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcvq\" (UniqueName: \"kubernetes.io/projected/01c6c31d-3742-449e-aaeb-ff32914b731b-kube-api-access-fwcvq\") pod \"openshift-lws-operator-fd8ccff4c-w7kjx\" (UID: \"01c6c31d-3742-449e-aaeb-ff32914b731b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.663732 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.663579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01c6c31d-3742-449e-aaeb-ff32914b731b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w7kjx\" (UID: \"01c6c31d-3742-449e-aaeb-ff32914b731b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.763972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.763936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcvq\" (UniqueName: \"kubernetes.io/projected/01c6c31d-3742-449e-aaeb-ff32914b731b-kube-api-access-fwcvq\") pod \"openshift-lws-operator-fd8ccff4c-w7kjx\" (UID: \"01c6c31d-3742-449e-aaeb-ff32914b731b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.764155 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.764004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01c6c31d-3742-449e-aaeb-ff32914b731b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w7kjx\" (UID: \"01c6c31d-3742-449e-aaeb-ff32914b731b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.764401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.764378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01c6c31d-3742-449e-aaeb-ff32914b731b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w7kjx\" (UID: \"01c6c31d-3742-449e-aaeb-ff32914b731b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.773108 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.773086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcvq\" (UniqueName: \"kubernetes.io/projected/01c6c31d-3742-449e-aaeb-ff32914b731b-kube-api-access-fwcvq\") pod \"openshift-lws-operator-fd8ccff4c-w7kjx\" (UID: \"01c6c31d-3742-449e-aaeb-ff32914b731b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:14.899291 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:14.899214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"
Jul 23 11:18:15.028405 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:15.028382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx"]
Jul 23 11:18:15.030494 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:18:15.030468    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01c6c31d_3742_449e_aaeb_ff32914b731b.slice/crio-05caffc2db58a16380ac1add42a1f0e8663e719c7dae8b8166d3e1dc03264c82 WatchSource:0}: Error finding container 05caffc2db58a16380ac1add42a1f0e8663e719c7dae8b8166d3e1dc03264c82: Status 404 returned error can't find the container with id 05caffc2db58a16380ac1add42a1f0e8663e719c7dae8b8166d3e1dc03264c82
Jul 23 11:18:15.031973 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:15.031955    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:18:15.991875 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:15.991839    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx" event={"ID":"01c6c31d-3742-449e-aaeb-ff32914b731b","Type":"ContainerStarted","Data":"05caffc2db58a16380ac1add42a1f0e8663e719c7dae8b8166d3e1dc03264c82"}
Jul 23 11:18:19.007011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:19.006975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx" event={"ID":"01c6c31d-3742-449e-aaeb-ff32914b731b","Type":"ContainerStarted","Data":"6951e2780bfcdd8bd78d5a07c72ee34a0b6f6cfde0aacc7b8a192e9d9cc40282"}
Jul 23 11:18:19.024691 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:19.024646    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w7kjx" podStartSLOduration=1.6418721889999999 podStartE2EDuration="5.024630532s" totalImagesPullingTime="3.382758343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:19.024141754 +0000 UTC m=+490.151005179" watchObservedRunningTime="2026-07-23 11:18:19.024630532 +0000 UTC m=+490.151493957"
Jul 23 11:18:20.117893 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:20.117858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:20.218148 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:20.218111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:21.956185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:21.956152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:37.289629 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:37.289572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:37.500401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:37.500369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:37.609234 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:37.609148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.126532 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.126503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.247226 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.247186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.373747 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.373713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.505308 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.505235    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"]
Jul 23 11:18:38.511340 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.511313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.514139 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.514121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 11:18:38.514326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.514306    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 11:18:38.514386 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.514370    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6vh5\""
Jul 23 11:18:38.514679 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.514664    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 11:18:38.516162 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.516144    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 11:18:38.523479 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.523431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"]
Jul 23 11:18:38.661682 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.661646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp96q\" (UniqueName: \"kubernetes.io/projected/bfe4374b-316b-4c26-bea9-699dfd48e6d2-kube-api-access-mp96q\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.661845 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.661692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfe4374b-316b-4c26-bea9-699dfd48e6d2-tmp\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.661845 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.661710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfe4374b-316b-4c26-bea9-699dfd48e6d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.661845 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.661815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfe4374b-316b-4c26-bea9-699dfd48e6d2-manifests\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.661961 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.661853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe4374b-316b-4c26-bea9-699dfd48e6d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.691993 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.691961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.763148 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.763118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfe4374b-316b-4c26-bea9-699dfd48e6d2-tmp\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.763273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.763154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfe4374b-316b-4c26-bea9-699dfd48e6d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.763273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.763199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfe4374b-316b-4c26-bea9-699dfd48e6d2-manifests\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.763273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.763224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe4374b-316b-4c26-bea9-699dfd48e6d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.763384 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.763290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp96q\" (UniqueName: \"kubernetes.io/projected/bfe4374b-316b-4c26-bea9-699dfd48e6d2-kube-api-access-mp96q\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.763788 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.763758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfe4374b-316b-4c26-bea9-699dfd48e6d2-manifests\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.765406 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.765387    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfe4374b-316b-4c26-bea9-699dfd48e6d2-tmp\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.765919 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.765898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfe4374b-316b-4c26-bea9-699dfd48e6d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.766460 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.766440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe4374b-316b-4c26-bea9-699dfd48e6d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.777784 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.777761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp96q\" (UniqueName: \"kubernetes.io/projected/bfe4374b-316b-4c26-bea9-699dfd48e6d2-kube-api-access-mp96q\") pod \"opendatahub-operator-controller-manager-684564f56d-bqrzq\" (UID: \"bfe4374b-316b-4c26-bea9-699dfd48e6d2\") " pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.788883 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.788855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.822981 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.822955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:38.884538 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.884456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:38.952804 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.952781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"]
Jul 23 11:18:38.955502 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:18:38.955467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe4374b_316b_4c26_bea9_699dfd48e6d2.slice/crio-d2a5278d90186bf6836db74573d751f4201f934167b5e679c7bffc4c08ca7619 WatchSource:0}: Error finding container d2a5278d90186bf6836db74573d751f4201f934167b5e679c7bffc4c08ca7619: Status 404 returned error can't find the container with id d2a5278d90186bf6836db74573d751f4201f934167b5e679c7bffc4c08ca7619
Jul 23 11:18:38.956340 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:38.956311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:39.033151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:39.033075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:39.085563 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:39.085531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq" event={"ID":"bfe4374b-316b-4c26-bea9-699dfd48e6d2","Type":"ContainerStarted","Data":"d2a5278d90186bf6836db74573d751f4201f934167b5e679c7bffc4c08ca7619"}
Jul 23 11:18:39.134987 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:39.134943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:39.238303 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:39.238270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:43.108265 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:43.108229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq" event={"ID":"bfe4374b-316b-4c26-bea9-699dfd48e6d2","Type":"ContainerStarted","Data":"1c480a9c50764768cac4ac3a8357adb7c235fe64d71c62782301e426ffc586f1"}
Jul 23 11:18:44.114085 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:44.114044    2578 generic.go:356] "Generic (PLEG): container finished" podID="bfe4374b-316b-4c26-bea9-699dfd48e6d2" containerID="1c480a9c50764768cac4ac3a8357adb7c235fe64d71c62782301e426ffc586f1" exitCode=0
Jul 23 11:18:44.114464 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:44.114137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq" event={"ID":"bfe4374b-316b-4c26-bea9-699dfd48e6d2","Type":"ContainerDied","Data":"1c480a9c50764768cac4ac3a8357adb7c235fe64d71c62782301e426ffc586f1"}
Jul 23 11:18:45.120297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:45.120257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq" event={"ID":"bfe4374b-316b-4c26-bea9-699dfd48e6d2","Type":"ContainerStarted","Data":"bdd1899eda73f4d2059a751b5f0cc273e3e510d7b69fdd06ecad6a5d2480a687"}
Jul 23 11:18:45.120675 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:45.120424    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:45.147224 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:45.147174    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq" podStartSLOduration=2.512293218 podStartE2EDuration="7.147157751s" totalImagesPullingTime="3.606258789s" totalInitContainerRuntime="1.028605744s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:18:45.144894978 +0000 UTC m=+516.271758403" watchObservedRunningTime="2026-07-23 11:18:45.147157751 +0000 UTC m=+516.274021174"
Jul 23 11:18:50.041475 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:50.041435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:50.142803 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:50.142767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:56.126208 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:56.126177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-684564f56d-bqrzq"
Jul 23 11:18:58.235592 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.235538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:58.332622 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.332575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:58.693026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.692985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:58.763827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.763797    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"]
Jul 23 11:18:58.772185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.772158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.775244 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.775218    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 11:18:58.775685 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.775666    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 11:18:58.776965 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.776947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hbvxd\""
Jul 23 11:18:58.780630 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.780597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"]
Jul 23 11:18:58.834374 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.834343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787385ca-bc72-4875-87ca-31783768bc6b-tls-certs\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.834522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.834381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/787385ca-bc72-4875-87ca-31783768bc6b-tmp\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.834522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.834403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzsql\" (UniqueName: \"kubernetes.io/projected/787385ca-bc72-4875-87ca-31783768bc6b-kube-api-access-vzsql\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.935093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.935056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787385ca-bc72-4875-87ca-31783768bc6b-tls-certs\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.935093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.935090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/787385ca-bc72-4875-87ca-31783768bc6b-tmp\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.935281 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.935109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzsql\" (UniqueName: \"kubernetes.io/projected/787385ca-bc72-4875-87ca-31783768bc6b-kube-api-access-vzsql\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.937368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.937332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/787385ca-bc72-4875-87ca-31783768bc6b-tmp\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.937716 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.937698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787385ca-bc72-4875-87ca-31783768bc6b-tls-certs\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.949556 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.949491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzsql\" (UniqueName: \"kubernetes.io/projected/787385ca-bc72-4875-87ca-31783768bc6b-kube-api-access-vzsql\") pod \"kube-auth-proxy-5fffd658f5-dqjfr\" (UID: \"787385ca-bc72-4875-87ca-31783768bc6b\") " pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:58.992287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:58.992254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:59.015206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.015175    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-52f5x"]
Jul 23 11:18:59.019660 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.019643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.023199 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.023178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 11:18:59.023305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.023228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f4nj9\""
Jul 23 11:18:59.033896 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.033876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-52f5x"]
Jul 23 11:18:59.035569 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.035547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjppz\" (UniqueName: \"kubernetes.io/projected/82c4a4cf-8181-416e-b223-6fa822ac03e3-kube-api-access-pjppz\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.035696 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.035598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c4a4cf-8181-416e-b223-6fa822ac03e3-cert\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.082932 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.082897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"
Jul 23 11:18:59.089894 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.089860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:59.136303 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.136262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjppz\" (UniqueName: \"kubernetes.io/projected/82c4a4cf-8181-416e-b223-6fa822ac03e3-kube-api-access-pjppz\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.136455 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.136311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c4a4cf-8181-416e-b223-6fa822ac03e3-cert\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.136514 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:18:59.136460    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 11:18:59.136567 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:18:59.136515    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c4a4cf-8181-416e-b223-6fa822ac03e3-cert podName:82c4a4cf-8181-416e-b223-6fa822ac03e3 nodeName:}" failed. No retries permitted until 2026-07-23 11:18:59.636498708 +0000 UTC m=+530.763362110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/82c4a4cf-8181-416e-b223-6fa822ac03e3-cert") pod "odh-model-controller-7998c67dc4-52f5x" (UID: "82c4a4cf-8181-416e-b223-6fa822ac03e3") : secret "odh-model-controller-webhook-cert" not found
Jul 23 11:18:59.169321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.169293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjppz\" (UniqueName: \"kubernetes.io/projected/82c4a4cf-8181-416e-b223-6fa822ac03e3-kube-api-access-pjppz\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.194060 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.194009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:59.247958 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:18:59.247933    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787385ca_bc72_4875_87ca_31783768bc6b.slice/crio-851e71dfda4fdfc69c4a40d65a53c38efa45a12cb80add9408213c762a01b86e WatchSource:0}: Error finding container 851e71dfda4fdfc69c4a40d65a53c38efa45a12cb80add9408213c762a01b86e: Status 404 returned error can't find the container with id 851e71dfda4fdfc69c4a40d65a53c38efa45a12cb80add9408213c762a01b86e
Jul 23 11:18:59.248827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.248794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr"]
Jul 23 11:18:59.476831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.476794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:59.640623 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.640570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c4a4cf-8181-416e-b223-6fa822ac03e3-cert\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.643033 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.643009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82c4a4cf-8181-416e-b223-6fa822ac03e3-cert\") pod \"odh-model-controller-7998c67dc4-52f5x\" (UID: \"82c4a4cf-8181-416e-b223-6fa822ac03e3\") " pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:18:59.652411 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.652385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:18:59.929860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:18:59.929778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:19:00.092755 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.092547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-52f5x"]
Jul 23 11:19:00.095085 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:19:00.095035    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c4a4cf_8181_416e_b223_6fa822ac03e3.slice/crio-32cc6b6999889cb8b5eddea944e3072f94d11ba8bdea667a05bde8fb1f57ef43 WatchSource:0}: Error finding container 32cc6b6999889cb8b5eddea944e3072f94d11ba8bdea667a05bde8fb1f57ef43: Status 404 returned error can't find the container with id 32cc6b6999889cb8b5eddea944e3072f94d11ba8bdea667a05bde8fb1f57ef43
Jul 23 11:19:00.129597 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.129564    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lgchh"]
Jul 23 11:19:00.133145 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.133113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:00.133272 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.133239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.135895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.135844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 11:19:00.135895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.135875    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7jh8d\""
Jul 23 11:19:00.145215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.144359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lgchh"]
Jul 23 11:19:00.145215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.144764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ps9r\" (UniqueName: \"kubernetes.io/projected/bf0223d1-5635-4f2d-b403-d026cfab0be9-kube-api-access-6ps9r\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.145215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.144867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0223d1-5635-4f2d-b403-d026cfab0be9-tls-certs\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.189378 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.189285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x" event={"ID":"82c4a4cf-8181-416e-b223-6fa822ac03e3","Type":"ContainerStarted","Data":"32cc6b6999889cb8b5eddea944e3072f94d11ba8bdea667a05bde8fb1f57ef43"}
Jul 23 11:19:00.190580 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.190551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr" event={"ID":"787385ca-bc72-4875-87ca-31783768bc6b","Type":"ContainerStarted","Data":"851e71dfda4fdfc69c4a40d65a53c38efa45a12cb80add9408213c762a01b86e"}
Jul 23 11:19:00.246091 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.246052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0223d1-5635-4f2d-b403-d026cfab0be9-tls-certs\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.246243 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.246144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ps9r\" (UniqueName: \"kubernetes.io/projected/bf0223d1-5635-4f2d-b403-d026cfab0be9-kube-api-access-6ps9r\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.246243 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:00.246177    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 23 11:19:00.246368 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:00.246248    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf0223d1-5635-4f2d-b403-d026cfab0be9-tls-certs podName:bf0223d1-5635-4f2d-b403-d026cfab0be9 nodeName:}" failed. No retries permitted until 2026-07-23 11:19:00.746225379 +0000 UTC m=+531.873088784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bf0223d1-5635-4f2d-b403-d026cfab0be9-tls-certs") pod "model-serving-api-54d89bd5fc-lgchh" (UID: "bf0223d1-5635-4f2d-b403-d026cfab0be9") : secret "model-serving-api-tls" not found
Jul 23 11:19:00.273024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.272990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ps9r\" (UniqueName: \"kubernetes.io/projected/bf0223d1-5635-4f2d-b403-d026cfab0be9-kube-api-access-6ps9r\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.421485 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.421446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:00.422180 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.422155    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"]
Jul 23 11:19:00.425765 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.425744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.428960 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.428931    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 11:19:00.428960 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.428945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 11:19:00.429164 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.428941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 11:19:00.429164 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.429024    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dh9p7\""
Jul 23 11:19:00.429668 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.429645    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 11:19:00.444116 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.444058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"]
Jul 23 11:19:00.453612 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.453583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.453737 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.453697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-istio-token\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.453802 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.453734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.453855 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.453810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grbm9\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-kube-api-access-grbm9\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.453938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.453913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-cacerts\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.454038 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.453987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7ff396d-34de-4b56-b92a-385381c0c355-local-certs\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.454038 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.454012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.507152 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.507107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:00.555091 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-cacerts\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.555248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7ff396d-34de-4b56-b92a-385381c0c355-local-certs\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.555248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.555248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.555248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-istio-token\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.555248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.555248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.555236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grbm9\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-kube-api-access-grbm9\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.556065 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.556039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.558080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.558049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-cacerts\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.558080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.558062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.558080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.558059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7ff396d-34de-4b56-b92a-385381c0c355-local-certs\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.558244 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.558101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.563869 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.563848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grbm9\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-kube-api-access-grbm9\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.563990 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.563970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-istio-token\") pod \"istiod-openshift-gateway-7574459656-r7vtv\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.738842 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.738762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:00.756821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.756791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0223d1-5635-4f2d-b403-d026cfab0be9-tls-certs\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.759873 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.759846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf0223d1-5635-4f2d-b403-d026cfab0be9-tls-certs\") pod \"model-serving-api-54d89bd5fc-lgchh\" (UID: \"bf0223d1-5635-4f2d-b403-d026cfab0be9\") " pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:00.919943 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:00.919909    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"]
Jul 23 11:19:00.923124 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:19:00.923091    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ff396d_34de_4b56_b92a_385381c0c355.slice/crio-1521d2439f933f44d15849752c13574f713820e8671531f9c1ae6ada3088d642 WatchSource:0}: Error finding container 1521d2439f933f44d15849752c13574f713820e8671531f9c1ae6ada3088d642: Status 404 returned error can't find the container with id 1521d2439f933f44d15849752c13574f713820e8671531f9c1ae6ada3088d642
Jul 23 11:19:01.048031 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:01.047983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:01.200107 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:01.200029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" event={"ID":"f7ff396d-34de-4b56-b92a-385381c0c355","Type":"ContainerStarted","Data":"1521d2439f933f44d15849752c13574f713820e8671531f9c1ae6ada3088d642"}
Jul 23 11:19:01.207419 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:01.207387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lgchh"]
Jul 23 11:19:01.209812 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:19:01.209785    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0223d1_5635_4f2d_b403_d026cfab0be9.slice/crio-5056978aff5d0625bdc6b6bfa75945c00a7b261264f843a59767b0654459efb5 WatchSource:0}: Error finding container 5056978aff5d0625bdc6b6bfa75945c00a7b261264f843a59767b0654459efb5: Status 404 returned error can't find the container with id 5056978aff5d0625bdc6b6bfa75945c00a7b261264f843a59767b0654459efb5
Jul 23 11:19:01.607792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:01.607755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:02.206155 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:02.206113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh" event={"ID":"bf0223d1-5635-4f2d-b403-d026cfab0be9","Type":"ContainerStarted","Data":"5056978aff5d0625bdc6b6bfa75945c00a7b261264f843a59767b0654459efb5"}
Jul 23 11:19:05.434705 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:05.434660    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:19:05.435061 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:05.434736    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:19:06.105591 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.105555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:06.229843 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.229806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" event={"ID":"f7ff396d-34de-4b56-b92a-385381c0c355","Type":"ContainerStarted","Data":"df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47"}
Jul 23 11:19:06.230551 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.230525    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:06.231793 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.231760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh" event={"ID":"bf0223d1-5635-4f2d-b403-d026cfab0be9","Type":"ContainerStarted","Data":"ea3454975ac49342315a2a3215516d8593efdcef4a0ba502e36016eb5015581c"}
Jul 23 11:19:06.231897 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.231840    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:06.232236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.232212    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-r7vtv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 11:19:06.232320 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.232285    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" podUID="f7ff396d-34de-4b56-b92a-385381c0c355" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 11:19:06.233575 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.233547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x" event={"ID":"82c4a4cf-8181-416e-b223-6fa822ac03e3","Type":"ContainerStarted","Data":"3e0f56fad2fdd8c53c18ec70f096d407bfdeddb1d7511170fd0f27462365af30"}
Jul 23 11:19:06.233680 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.233645    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:19:06.235394 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.235371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr" event={"ID":"787385ca-bc72-4875-87ca-31783768bc6b","Type":"ContainerStarted","Data":"8eab18fba38bc147d0327f4d7c1181f1aae9d8ed2579a65852efedbbbaab9655"}
Jul 23 11:19:06.275597 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.275530    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" podStartSLOduration=1.766790355 podStartE2EDuration="6.275509359s" totalImagesPullingTime="4.508719004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:06.271202199 +0000 UTC m=+537.398065628" watchObservedRunningTime="2026-07-23 11:19:06.275509359 +0000 UTC m=+537.402372786"
Jul 23 11:19:06.292090 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.292041    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fffd658f5-dqjfr" podStartSLOduration=2.182203715 podStartE2EDuration="8.292026903s" totalImagesPullingTime="6.109823188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:06.2905964 +0000 UTC m=+537.417459824" watchObservedRunningTime="2026-07-23 11:19:06.292026903 +0000 UTC m=+537.418890326"
Jul 23 11:19:06.310422 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.310367    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh" podStartSLOduration=2.14754082 podStartE2EDuration="6.310346503s" totalImagesPullingTime="4.162805683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:06.307159154 +0000 UTC m=+537.434022577" watchObservedRunningTime="2026-07-23 11:19:06.310346503 +0000 UTC m=+537.437209928"
Jul 23 11:19:06.345483 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.345437    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x" podStartSLOduration=3.07836111 podStartE2EDuration="8.345422966s" totalImagesPullingTime="5.267061856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:06.343513876 +0000 UTC m=+537.470377300" watchObservedRunningTime="2026-07-23 11:19:06.345422966 +0000 UTC m=+537.472286389"
Jul 23 11:19:06.487787 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.487683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:06.601393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.601345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:06.694059 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.694027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:06.797028 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:06.796991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:07.240890 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:07.240815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:11.130080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.129599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:11.201014 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.200971    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"]
Jul 23 11:19:11.206138 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.206113    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.209820 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.209798    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 11:19:11.209958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.209834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7ktf7\""
Jul 23 11:19:11.212820 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.212776    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"]
Jul 23 11:19:11.216638 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.216307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.216954 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.216937    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"]
Jul 23 11:19:11.219492 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.219468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9fw2b\""
Jul 23 11:19:11.219756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.219738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 11:19:11.230139 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.230115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"]
Jul 23 11:19:11.256508 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.256483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c5ddce-cdfc-4a47-9537-44d20050b08a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.256644 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.256516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gmm\" (UniqueName: \"kubernetes.io/projected/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-kube-api-access-42gmm\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.256644 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.256537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dcqv\" (UniqueName: \"kubernetes.io/projected/d6c5ddce-cdfc-4a47-9537-44d20050b08a-kube-api-access-8dcqv\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.256644 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.256621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-cert\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.357536 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.357500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcqv\" (UniqueName: \"kubernetes.io/projected/d6c5ddce-cdfc-4a47-9537-44d20050b08a-kube-api-access-8dcqv\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.357741 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.357545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-cert\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.357788 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:11.357745    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 11:19:11.357819 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:11.357806    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-cert podName:e06a4e7e-1ff6-4821-80c9-4b44a868ecf6 nodeName:}" failed. No retries permitted until 2026-07-23 11:19:11.857786707 +0000 UTC m=+542.984650109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-cert") pod "kserve-controller-manager-d6f4b65b8-rqwzb" (UID: "e06a4e7e-1ff6-4821-80c9-4b44a868ecf6") : secret "kserve-webhook-server-cert" not found
Jul 23 11:19:11.357819 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.357747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c5ddce-cdfc-4a47-9537-44d20050b08a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.357819 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:11.357813    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 11:19:11.357938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.357857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gmm\" (UniqueName: \"kubernetes.io/projected/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-kube-api-access-42gmm\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.357974 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:11.357938    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c5ddce-cdfc-4a47-9537-44d20050b08a-cert podName:d6c5ddce-cdfc-4a47-9537-44d20050b08a nodeName:}" failed. No retries permitted until 2026-07-23 11:19:11.857920563 +0000 UTC m=+542.984783968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d6c5ddce-cdfc-4a47-9537-44d20050b08a-cert") pod "llmisvc-controller-manager-777c6bd7d5-6fl8h" (UID: "d6c5ddce-cdfc-4a47-9537-44d20050b08a") : secret "llmisvc-webhook-server-cert" not found
Jul 23 11:19:11.383564 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.383499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gmm\" (UniqueName: \"kubernetes.io/projected/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-kube-api-access-42gmm\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.389797 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.389770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dcqv\" (UniqueName: \"kubernetes.io/projected/d6c5ddce-cdfc-4a47-9537-44d20050b08a-kube-api-access-8dcqv\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.862856 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.862821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c5ddce-cdfc-4a47-9537-44d20050b08a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:11.863029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.862871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-cert\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.865323 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.865295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e06a4e7e-1ff6-4821-80c9-4b44a868ecf6-cert\") pod \"kserve-controller-manager-d6f4b65b8-rqwzb\" (UID: \"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:11.865431 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:11.865382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6c5ddce-cdfc-4a47-9537-44d20050b08a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6fl8h\" (UID: \"d6c5ddce-cdfc-4a47-9537-44d20050b08a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:12.119036 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:12.118953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:12.127260 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:12.127236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:12.258335 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:12.258303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"]
Jul 23 11:19:12.260757 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:19:12.260718    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06a4e7e_1ff6_4821_80c9_4b44a868ecf6.slice/crio-601d95ae70d45ef6245e1587229b2559b767ba247604b05c715f9dd56880e274 WatchSource:0}: Error finding container 601d95ae70d45ef6245e1587229b2559b767ba247604b05c715f9dd56880e274: Status 404 returned error can't find the container with id 601d95ae70d45ef6245e1587229b2559b767ba247604b05c715f9dd56880e274
Jul 23 11:19:12.282706 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:12.282686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"]
Jul 23 11:19:12.283386 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:19:12.283363    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd6c5ddce_cdfc_4a47_9537_44d20050b08a.slice/crio-4c0fa21bac0397217d791cc9866031c2616504b3c39d74324d5639575dc077bc WatchSource:0}: Error finding container 4c0fa21bac0397217d791cc9866031c2616504b3c39d74324d5639575dc077bc: Status 404 returned error can't find the container with id 4c0fa21bac0397217d791cc9866031c2616504b3c39d74324d5639575dc077bc
Jul 23 11:19:13.270021 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:13.269975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb" event={"ID":"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6","Type":"ContainerStarted","Data":"601d95ae70d45ef6245e1587229b2559b767ba247604b05c715f9dd56880e274"}
Jul 23 11:19:13.271287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:13.271258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h" event={"ID":"d6c5ddce-cdfc-4a47-9537-44d20050b08a","Type":"ContainerStarted","Data":"4c0fa21bac0397217d791cc9866031c2616504b3c39d74324d5639575dc077bc"}
Jul 23 11:19:13.292439 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:13.292410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:13.691091 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:13.691022    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"]
Jul 23 11:19:13.691253 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:13.691211    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" podUID="f7ff396d-34de-4b56-b92a-385381c0c355" containerName="discovery" containerID="cri-o://df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47" gracePeriod=30
Jul 23 11:19:14.012277 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.012244    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:14.084215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084182    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-istio-token\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.084401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grbm9\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-kube-api-access-grbm9\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.084401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084288    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7ff396d-34de-4b56-b92a-385381c0c355-local-certs\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.084401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-cacerts\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.084568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084360    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-dns-cert\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.084568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-kubeconfig\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.084568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.084529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-ca-configmap\") pod \"f7ff396d-34de-4b56-b92a-385381c0c355\" (UID: \"f7ff396d-34de-4b56-b92a-385381c0c355\") "
Jul 23 11:19:14.085245 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.085186    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:19:14.087764 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.087720    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:19:14.087764 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.087738    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:19:14.087923 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.087896    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:19:14.087923 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.087901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ff396d-34de-4b56-b92a-385381c0c355-local-certs" (OuterVolumeSpecName: "local-certs") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:19:14.088029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.088010    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-cacerts" (OuterVolumeSpecName: "cacerts") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:19:14.088240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.088207    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-kube-api-access-grbm9" (OuterVolumeSpecName: "kube-api-access-grbm9") pod "f7ff396d-34de-4b56-b92a-385381c0c355" (UID: "f7ff396d-34de-4b56-b92a-385381c0c355"). InnerVolumeSpecName "kube-api-access-grbm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:19:14.185999 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.185968    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.185999 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.185999    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grbm9\" (UniqueName: \"kubernetes.io/projected/f7ff396d-34de-4b56-b92a-385381c0c355-kube-api-access-grbm9\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.185999 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.186009    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7ff396d-34de-4b56-b92a-385381c0c355-local-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.186240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.186019    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-cacerts\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.186240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.186031    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-dns-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.186240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.186043    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7ff396d-34de-4b56-b92a-385381c0c355-istio-kubeconfig\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.186240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.186057    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7ff396d-34de-4b56-b92a-385381c0c355-istio-csr-ca-configmap\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:19:14.279058 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.279023    2578 generic.go:356] "Generic (PLEG): container finished" podID="f7ff396d-34de-4b56-b92a-385381c0c355" containerID="df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47" exitCode=0
Jul 23 11:19:14.279503 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.279081    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"
Jul 23 11:19:14.279503 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.279148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" event={"ID":"f7ff396d-34de-4b56-b92a-385381c0c355","Type":"ContainerDied","Data":"df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47"}
Jul 23 11:19:14.279503 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.279227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv" event={"ID":"f7ff396d-34de-4b56-b92a-385381c0c355","Type":"ContainerDied","Data":"1521d2439f933f44d15849752c13574f713820e8671531f9c1ae6ada3088d642"}
Jul 23 11:19:14.279503 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.279254    2578 scope.go:117] "RemoveContainer" containerID="df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47"
Jul 23 11:19:14.309343 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.309312    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"]
Jul 23 11:19:14.315759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.315732    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r7vtv"]
Jul 23 11:19:14.774533 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.774321    2578 scope.go:117] "RemoveContainer" containerID="df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47"
Jul 23 11:19:14.774809 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:19:14.774784    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47\": container with ID starting with df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47 not found: ID does not exist" containerID="df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47"
Jul 23 11:19:14.774905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:14.774824    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47"} err="failed to get container status \"df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47\": rpc error: code = NotFound desc = could not find container \"df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47\": container with ID starting with df41cb6a4fafd0ce3de85b4bdcb459fbf32009467dd6d5b7b3db2ce69474fc47 not found: ID does not exist"
Jul 23 11:19:15.317917 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:15.317890    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7ff396d-34de-4b56-b92a-385381c0c355" path="/var/lib/kubelet/pods/f7ff396d-34de-4b56-b92a-385381c0c355/volumes"
Jul 23 11:19:16.292533 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:16.292500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb" event={"ID":"e06a4e7e-1ff6-4821-80c9-4b44a868ecf6","Type":"ContainerStarted","Data":"45e829827499cc923a80cdb0bd3f7e56e96eb49b2a82b73f383a62f2b7cadf28"}
Jul 23 11:19:16.292713 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:16.292577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:16.294088 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:16.294067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h" event={"ID":"d6c5ddce-cdfc-4a47-9537-44d20050b08a","Type":"ContainerStarted","Data":"e0d05de4b01966014dd6673454da41fde57a16dbd573e24b2c6bec12fa85f4cf"}
Jul 23 11:19:16.294203 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:16.294119    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:16.311997 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:16.311956    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb" podStartSLOduration=2.551524191 podStartE2EDuration="5.311941537s" totalImagesPullingTime="2.760417346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:16.310699037 +0000 UTC m=+547.437562484" watchObservedRunningTime="2026-07-23 11:19:16.311941537 +0000 UTC m=+547.438804961"
Jul 23 11:19:16.333363 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:16.333315    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h" podStartSLOduration=1.514004417 podStartE2EDuration="5.33330179s" totalImagesPullingTime="3.819297373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:19:16.332562041 +0000 UTC m=+547.459425464" watchObservedRunningTime="2026-07-23 11:19:16.33330179 +0000 UTC m=+547.460165263"
Jul 23 11:19:17.242842 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:17.242811    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-52f5x"
Jul 23 11:19:17.245505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:17.245480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lgchh"
Jul 23 11:19:47.303524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:47.303492    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6fl8h"
Jul 23 11:19:47.306874 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:47.306855    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rqwzb"
Jul 23 11:19:58.301013 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:58.300977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:58.374831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:58.374762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:19:59.810320 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.810285    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7hc9c"]
Jul 23 11:19:59.810712 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.810654    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ff396d-34de-4b56-b92a-385381c0c355" containerName="discovery"
Jul 23 11:19:59.810712 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.810667    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ff396d-34de-4b56-b92a-385381c0c355" containerName="discovery"
Jul 23 11:19:59.810790 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.810736    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7ff396d-34de-4b56-b92a-385381c0c355" containerName="discovery"
Jul 23 11:19:59.822821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.822797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:19:59.826028 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.826006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hwmqg\""
Jul 23 11:19:59.827040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.827026    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 11:19:59.829478 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.829459    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 11:19:59.834209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.834182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7hc9c"]
Jul 23 11:19:59.869910 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.869878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbg6x\" (UniqueName: \"kubernetes.io/projected/0326abc2-ea43-41d6-8232-d001ac3b6ea4-kube-api-access-cbg6x\") pod \"kuadrant-operator-catalog-7hc9c\" (UID: \"0326abc2-ea43-41d6-8232-d001ac3b6ea4\") " pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:19:59.970789 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.970754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbg6x\" (UniqueName: \"kubernetes.io/projected/0326abc2-ea43-41d6-8232-d001ac3b6ea4-kube-api-access-cbg6x\") pod \"kuadrant-operator-catalog-7hc9c\" (UID: \"0326abc2-ea43-41d6-8232-d001ac3b6ea4\") " pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:19:59.979043 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:19:59.979014    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbg6x\" (UniqueName: \"kubernetes.io/projected/0326abc2-ea43-41d6-8232-d001ac3b6ea4-kube-api-access-cbg6x\") pod \"kuadrant-operator-catalog-7hc9c\" (UID: \"0326abc2-ea43-41d6-8232-d001ac3b6ea4\") " pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:20:00.128632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.128525    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7hc9c"]
Jul 23 11:20:00.128906 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.128887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:20:00.259927 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.259905    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7hc9c"]
Jul 23 11:20:00.262433 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:00.262401    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0326abc2_ea43_41d6_8232_d001ac3b6ea4.slice/crio-b4befb228317bfd398cb057e9152790c6ee2e523a205ff63cfb84c9d6e8c5a2a WatchSource:0}: Error finding container b4befb228317bfd398cb057e9152790c6ee2e523a205ff63cfb84c9d6e8c5a2a: Status 404 returned error can't find the container with id b4befb228317bfd398cb057e9152790c6ee2e523a205ff63cfb84c9d6e8c5a2a
Jul 23 11:20:00.339419 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.339391    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjkbq"]
Jul 23 11:20:00.344186 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.344166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:00.351265 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.351240    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjkbq"]
Jul 23 11:20:00.362193 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.362156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:00.374316 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.374292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qmd\" (UniqueName: \"kubernetes.io/projected/b7decbd9-8951-4fd4-b148-86efe397f686-kube-api-access-t5qmd\") pod \"kuadrant-operator-catalog-sjkbq\" (UID: \"b7decbd9-8951-4fd4-b148-86efe397f686\") " pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:00.425263 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.425189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:00.475368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.475336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qmd\" (UniqueName: \"kubernetes.io/projected/b7decbd9-8951-4fd4-b148-86efe397f686-kube-api-access-t5qmd\") pod \"kuadrant-operator-catalog-sjkbq\" (UID: \"b7decbd9-8951-4fd4-b148-86efe397f686\") " pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:00.484065 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.484041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qmd\" (UniqueName: \"kubernetes.io/projected/b7decbd9-8951-4fd4-b148-86efe397f686-kube-api-access-t5qmd\") pod \"kuadrant-operator-catalog-sjkbq\" (UID: \"b7decbd9-8951-4fd4-b148-86efe397f686\") " pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:00.493862 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.493839    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c" event={"ID":"0326abc2-ea43-41d6-8232-d001ac3b6ea4","Type":"ContainerStarted","Data":"b4befb228317bfd398cb057e9152790c6ee2e523a205ff63cfb84c9d6e8c5a2a"}
Jul 23 11:20:00.565199 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.565165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:00.654629 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.654575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:00.790749 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:00.790719    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7decbd9_8951_4fd4_b148_86efe397f686.slice/crio-cd41945e5ccb6e33254e118f0828b87a906d9b3cbae83eddfe006857fc2c72ac WatchSource:0}: Error finding container cd41945e5ccb6e33254e118f0828b87a906d9b3cbae83eddfe006857fc2c72ac: Status 404 returned error can't find the container with id cd41945e5ccb6e33254e118f0828b87a906d9b3cbae83eddfe006857fc2c72ac
Jul 23 11:20:00.791265 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.791239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjkbq"]
Jul 23 11:20:00.865020 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:00.864982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:01.500410 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:01.500367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq" event={"ID":"b7decbd9-8951-4fd4-b148-86efe397f686","Type":"ContainerStarted","Data":"cd41945e5ccb6e33254e118f0828b87a906d9b3cbae83eddfe006857fc2c72ac"}
Jul 23 11:20:02.508129 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:02.508071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c" event={"ID":"0326abc2-ea43-41d6-8232-d001ac3b6ea4","Type":"ContainerStarted","Data":"dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2"}
Jul 23 11:20:02.508129 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:02.508074    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c" podUID="0326abc2-ea43-41d6-8232-d001ac3b6ea4" containerName="registry-server" containerID="cri-o://dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2" gracePeriod=2
Jul 23 11:20:02.509712 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:02.509689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq" event={"ID":"b7decbd9-8951-4fd4-b148-86efe397f686","Type":"ContainerStarted","Data":"489ee69519e6f9ea51ff291959f0b0c91fd6b3d1ac8d6db6039357be67f1bf42"}
Jul 23 11:20:02.524595 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:02.524489    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c" podStartSLOduration=1.361280568 podStartE2EDuration="3.524473877s" totalImagesPullingTime="2.163193309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:02.522930366 +0000 UTC m=+593.649793790" watchObservedRunningTime="2026-07-23 11:20:02.524473877 +0000 UTC m=+593.651337297"
Jul 23 11:20:02.540720 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:02.540671    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq" podStartSLOduration=0.905142307 podStartE2EDuration="2.540654707s" totalImagesPullingTime="1.6355124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:02.538978431 +0000 UTC m=+593.665841856" watchObservedRunningTime="2026-07-23 11:20:02.540654707 +0000 UTC m=+593.667518131"
Jul 23 11:20:04.648068 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:04.648046    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7hc9c_0326abc2-ea43-41d6-8232-d001ac3b6ea4/registry-server/0.log"
Jul 23 11:20:04.650324 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:04.650308    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:20:04.714839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:04.714785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbg6x\" (UniqueName: \"kubernetes.io/projected/0326abc2-ea43-41d6-8232-d001ac3b6ea4-kube-api-access-cbg6x\") pod \"0326abc2-ea43-41d6-8232-d001ac3b6ea4\" (UID: \"0326abc2-ea43-41d6-8232-d001ac3b6ea4\") "
Jul 23 11:20:04.716920 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:04.716899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0326abc2-ea43-41d6-8232-d001ac3b6ea4-kube-api-access-cbg6x" (OuterVolumeSpecName: "kube-api-access-cbg6x") pod "0326abc2-ea43-41d6-8232-d001ac3b6ea4" (UID: "0326abc2-ea43-41d6-8232-d001ac3b6ea4"). InnerVolumeSpecName "kube-api-access-cbg6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:20:04.815505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:04.815410    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbg6x\" (UniqueName: \"kubernetes.io/projected/0326abc2-ea43-41d6-8232-d001ac3b6ea4-kube-api-access-cbg6x\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:05.524784 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.524755    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7hc9c_0326abc2-ea43-41d6-8232-d001ac3b6ea4/registry-server/0.log"
Jul 23 11:20:05.524935 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.524798    2578 generic.go:356] "Generic (PLEG): container finished" podID="0326abc2-ea43-41d6-8232-d001ac3b6ea4" containerID="dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2" exitCode=137
Jul 23 11:20:05.524935 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.524835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c" event={"ID":"0326abc2-ea43-41d6-8232-d001ac3b6ea4","Type":"ContainerDied","Data":"dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2"}
Jul 23 11:20:05.524935 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.524862    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c"
Jul 23 11:20:05.524935 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.524922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7hc9c" event={"ID":"0326abc2-ea43-41d6-8232-d001ac3b6ea4","Type":"ContainerDied","Data":"b4befb228317bfd398cb057e9152790c6ee2e523a205ff63cfb84c9d6e8c5a2a"}
Jul 23 11:20:05.525094 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.524946    2578 scope.go:117] "RemoveContainer" containerID="dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2"
Jul 23 11:20:05.533876 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.533859    2578 scope.go:117] "RemoveContainer" containerID="dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2"
Jul 23 11:20:05.534151 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:05.534133    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2\": container with ID starting with dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2 not found: ID does not exist" containerID="dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2"
Jul 23 11:20:05.534197 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.534159    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2"} err="failed to get container status \"dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2\": rpc error: code = NotFound desc = could not find container \"dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2\": container with ID starting with dc657a0918509e3594c8d62aa48e5c0116e39d11ea4ea29f76c9fb4faec4bbe2 not found: ID does not exist"
Jul 23 11:20:05.542114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.542090    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7hc9c"]
Jul 23 11:20:05.546350 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:05.546329    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7hc9c"]
Jul 23 11:20:07.317257 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:07.317227    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0326abc2-ea43-41d6-8232-d001ac3b6ea4" path="/var/lib/kubelet/pods/0326abc2-ea43-41d6-8232-d001ac3b6ea4/volumes"
Jul 23 11:20:09.240571 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:09.240441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:20:09.240920 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:09.240588    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:20:10.192661 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.192624    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65444d4566-92k4p"]
Jul 23 11:20:10.194963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.193225    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0326abc2-ea43-41d6-8232-d001ac3b6ea4" containerName="registry-server"
Jul 23 11:20:10.194963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.193247    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0326abc2-ea43-41d6-8232-d001ac3b6ea4" containerName="registry-server"
Jul 23 11:20:10.194963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.193331    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0326abc2-ea43-41d6-8232-d001ac3b6ea4" containerName="registry-server"
Jul 23 11:20:10.196423 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.196396    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.208915 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.208891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65444d4566-92k4p"]
Jul 23 11:20:10.261180 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-oauth-config\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.261506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-oauth-serving-cert\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.261506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-config\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.261506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-service-ca\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.261506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-trusted-ca-bundle\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.261506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mn2m\" (UniqueName: \"kubernetes.io/projected/3e65f506-975b-4170-b2db-ab9859d1d9b5-kube-api-access-5mn2m\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.261506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.261379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-serving-cert\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.263075 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.263047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:10.330202 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.330175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:10.362310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-oauth-config\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.362425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-oauth-serving-cert\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.362425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-config\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.362425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-service-ca\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.362425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-trusted-ca-bundle\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.362655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mn2m\" (UniqueName: \"kubernetes.io/projected/3e65f506-975b-4170-b2db-ab9859d1d9b5-kube-api-access-5mn2m\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.362655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.362492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-serving-cert\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.363192 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.363169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-service-ca\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.363192 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.363179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-config\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.363192 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.363186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-oauth-serving-cert\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.363356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.363312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e65f506-975b-4170-b2db-ab9859d1d9b5-trusted-ca-bundle\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.365330 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.365304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-serving-cert\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.365406 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.365308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e65f506-975b-4170-b2db-ab9859d1d9b5-console-oauth-config\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.373011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.372992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mn2m\" (UniqueName: \"kubernetes.io/projected/3e65f506-975b-4170-b2db-ab9859d1d9b5-kube-api-access-5mn2m\") pod \"console-65444d4566-92k4p\" (UID: \"3e65f506-975b-4170-b2db-ab9859d1d9b5\") " pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.506708 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.506635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:10.643510 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.643488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65444d4566-92k4p"]
Jul 23 11:20:10.645377 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:10.645346    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e65f506_975b_4170_b2db_ab9859d1d9b5.slice/crio-2ff7702b833867d78cbd89c2dc6830c309335a65318ccf8f94aba9d952dda076 WatchSource:0}: Error finding container 2ff7702b833867d78cbd89c2dc6830c309335a65318ccf8f94aba9d952dda076: Status 404 returned error can't find the container with id 2ff7702b833867d78cbd89c2dc6830c309335a65318ccf8f94aba9d952dda076
Jul 23 11:20:10.654809 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.654793    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:10.654890 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.654829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:10.679378 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:10.679356    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:11.556993 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:11.556943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65444d4566-92k4p" event={"ID":"3e65f506-975b-4170-b2db-ab9859d1d9b5","Type":"ContainerStarted","Data":"22f81b236e2cb37c1e5ad7c98cac966923cf0b8c2a38a118657873f29e56282c"}
Jul 23 11:20:11.557431 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:11.557008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65444d4566-92k4p" event={"ID":"3e65f506-975b-4170-b2db-ab9859d1d9b5","Type":"ContainerStarted","Data":"2ff7702b833867d78cbd89c2dc6830c309335a65318ccf8f94aba9d952dda076"}
Jul 23 11:20:11.579036 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:11.578975    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65444d4566-92k4p" podStartSLOduration=1.578955127 podStartE2EDuration="1.578955127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:11.577522596 +0000 UTC m=+602.704386040" watchObservedRunningTime="2026-07-23 11:20:11.578955127 +0000 UTC m=+602.705818551"
Jul 23 11:20:11.579701 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:11.579681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sjkbq"
Jul 23 11:20:20.506902 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.506868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:20.507305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.506944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:20.511817 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.511796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:20.609317 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.609294    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65444d4566-92k4p"
Jul 23 11:20:20.664548 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.664517    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88784b4b-xzdhd"]
Jul 23 11:20:20.822208 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.822174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:20.917617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.917587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:20.979411 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:20.979379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:29.284223 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:29.284177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:31.972639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:31.972546    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"]
Jul 23 11:20:31.980265 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:31.980247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:31.983043 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:31.983026    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pst44\""
Jul 23 11:20:31.985909 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:31.985884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"]
Jul 23 11:20:32.057980 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.057945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwxr\" (UniqueName: \"kubernetes.io/projected/edcbe970-b649-4dd2-892f-92d8ff53556e-kube-api-access-ddwxr\") pod \"limitador-operator-controller-manager-859d7b78bd-cffpd\" (UID: \"edcbe970-b649-4dd2-892f-92d8ff53556e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:32.158940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.158908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwxr\" (UniqueName: \"kubernetes.io/projected/edcbe970-b649-4dd2-892f-92d8ff53556e-kube-api-access-ddwxr\") pod \"limitador-operator-controller-manager-859d7b78bd-cffpd\" (UID: \"edcbe970-b649-4dd2-892f-92d8ff53556e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:32.169040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.169011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwxr\" (UniqueName: \"kubernetes.io/projected/edcbe970-b649-4dd2-892f-92d8ff53556e-kube-api-access-ddwxr\") pod \"limitador-operator-controller-manager-859d7b78bd-cffpd\" (UID: \"edcbe970-b649-4dd2-892f-92d8ff53556e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:32.291399 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.291369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:32.428475 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.428449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"]
Jul 23 11:20:32.430217 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:32.430186    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedcbe970_b649_4dd2_892f_92d8ff53556e.slice/crio-d685dc43f8af1f5a9fae7b5ab10f611859c7f08eb9441f382b9a4d4c6c7c052b WatchSource:0}: Error finding container d685dc43f8af1f5a9fae7b5ab10f611859c7f08eb9441f382b9a4d4c6c7c052b: Status 404 returned error can't find the container with id d685dc43f8af1f5a9fae7b5ab10f611859c7f08eb9441f382b9a4d4c6c7c052b
Jul 23 11:20:32.658654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.658557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd" event={"ID":"edcbe970-b649-4dd2-892f-92d8ff53556e","Type":"ContainerStarted","Data":"d685dc43f8af1f5a9fae7b5ab10f611859c7f08eb9441f382b9a4d4c6c7c052b"}
Jul 23 11:20:32.886933 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:32.886890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:34.669553 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:34.669521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd" event={"ID":"edcbe970-b649-4dd2-892f-92d8ff53556e","Type":"ContainerStarted","Data":"6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5"}
Jul 23 11:20:34.669905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:34.669650    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:34.688833 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:34.688787    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd" podStartSLOduration=1.522984858 podStartE2EDuration="3.688774051s" totalImagesPullingTime="2.165789193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:34.687059568 +0000 UTC m=+625.813922995" watchObservedRunningTime="2026-07-23 11:20:34.688774051 +0000 UTC m=+625.815637475"
Jul 23 11:20:37.095772 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.095735    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"]
Jul 23 11:20:37.099185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.099169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.102079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.102059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5mjcr\""
Jul 23 11:20:37.110399 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.110379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"]
Jul 23 11:20:37.206117 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.206082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8e1b39-fdcd-4285-883e-e601cd834153-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.206264 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.206130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lrx\" (UniqueName: \"kubernetes.io/projected/9f8e1b39-fdcd-4285-883e-e601cd834153-kube-api-access-k2lrx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.307317 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.307274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lrx\" (UniqueName: \"kubernetes.io/projected/9f8e1b39-fdcd-4285-883e-e601cd834153-kube-api-access-k2lrx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.307479 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.307379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8e1b39-fdcd-4285-883e-e601cd834153-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.307711 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.307694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8e1b39-fdcd-4285-883e-e601cd834153-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.325285 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.325258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lrx\" (UniqueName: \"kubernetes.io/projected/9f8e1b39-fdcd-4285-883e-e601cd834153-kube-api-access-k2lrx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.409476 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.409401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:37.526386 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.526350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:37.556236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.556216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"]
Jul 23 11:20:37.557685 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:37.557653    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8e1b39_fdcd_4285_883e_e601cd834153.slice/crio-1e7ad57158931b24587bafaa98d06cb3891069d917d811c68a82701fb7e5693b WatchSource:0}: Error finding container 1e7ad57158931b24587bafaa98d06cb3891069d917d811c68a82701fb7e5693b: Status 404 returned error can't find the container with id 1e7ad57158931b24587bafaa98d06cb3891069d917d811c68a82701fb7e5693b
Jul 23 11:20:37.684841 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:37.684764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g" event={"ID":"9f8e1b39-fdcd-4285-883e-e601cd834153","Type":"ContainerStarted","Data":"1e7ad57158931b24587bafaa98d06cb3891069d917d811c68a82701fb7e5693b"}
Jul 23 11:20:38.087150 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:38.087103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:38.428231 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:38.428135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:40.218757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.218723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:40.647089 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.647058    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"]
Jul 23 11:20:40.650898 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.650871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:40.654723 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.654685    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9zqwh\""
Jul 23 11:20:40.668389 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.668368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"]
Jul 23 11:20:40.738642 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.738587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp29l\" (UniqueName: \"kubernetes.io/projected/b1075b13-201a-4724-aeed-bd3d30cfe8db-kube-api-access-lp29l\") pod \"authorino-operator-75cc8d5cb7-jg6hb\" (UID: \"b1075b13-201a-4724-aeed-bd3d30cfe8db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:40.839792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.839760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp29l\" (UniqueName: \"kubernetes.io/projected/b1075b13-201a-4724-aeed-bd3d30cfe8db-kube-api-access-lp29l\") pod \"authorino-operator-75cc8d5cb7-jg6hb\" (UID: \"b1075b13-201a-4724-aeed-bd3d30cfe8db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:40.850136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.850113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp29l\" (UniqueName: \"kubernetes.io/projected/b1075b13-201a-4724-aeed-bd3d30cfe8db-kube-api-access-lp29l\") pod \"authorino-operator-75cc8d5cb7-jg6hb\" (UID: \"b1075b13-201a-4724-aeed-bd3d30cfe8db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:40.963744 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:40.963690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:41.111819 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:41.111790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"]
Jul 23 11:20:41.113639 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:41.113588    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1075b13_201a_4724_aeed_bd3d30cfe8db.slice/crio-96cc15d3f2d886976aa90c82743d5314333e80fef7156808250a806b02bf3b9c WatchSource:0}: Error finding container 96cc15d3f2d886976aa90c82743d5314333e80fef7156808250a806b02bf3b9c: Status 404 returned error can't find the container with id 96cc15d3f2d886976aa90c82743d5314333e80fef7156808250a806b02bf3b9c
Jul 23 11:20:41.706372 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:41.706339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb" event={"ID":"b1075b13-201a-4724-aeed-bd3d30cfe8db","Type":"ContainerStarted","Data":"96cc15d3f2d886976aa90c82743d5314333e80fef7156808250a806b02bf3b9c"}
Jul 23 11:20:41.882555 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:41.882495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:42.776295 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:42.776231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:42.878713 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:42.878679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:43.722389 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:43.722292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g" event={"ID":"9f8e1b39-fdcd-4285-883e-e601cd834153","Type":"ContainerStarted","Data":"95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3"}
Jul 23 11:20:43.722389 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:43.722385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:43.745731 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:43.745591    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g" podStartSLOduration=1.038632656 podStartE2EDuration="6.745570907s" totalImagesPullingTime="5.706938251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:43.744296373 +0000 UTC m=+634.871159798" watchObservedRunningTime="2026-07-23 11:20:43.745570907 +0000 UTC m=+634.872434334"
Jul 23 11:20:44.100504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.100427    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"]
Jul 23 11:20:44.107485 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.107460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:20:44.110420 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.110387    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ds8c2\""
Jul 23 11:20:44.110812 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.110797    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 11:20:44.117933 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.117908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"]
Jul 23 11:20:44.173730 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.173683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5q7n\" (UniqueName: \"kubernetes.io/projected/5d27c531-72a9-43da-a8c1-44ab27ef6e75-kube-api-access-k5q7n\") pod \"dns-operator-controller-manager-864dd78c4c-d8crn\" (UID: \"5d27c531-72a9-43da-a8c1-44ab27ef6e75\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:20:44.274422 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.274387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5q7n\" (UniqueName: \"kubernetes.io/projected/5d27c531-72a9-43da-a8c1-44ab27ef6e75-kube-api-access-k5q7n\") pod \"dns-operator-controller-manager-864dd78c4c-d8crn\" (UID: \"5d27c531-72a9-43da-a8c1-44ab27ef6e75\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:20:44.287808 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.287773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5q7n\" (UniqueName: \"kubernetes.io/projected/5d27c531-72a9-43da-a8c1-44ab27ef6e75-kube-api-access-k5q7n\") pod \"dns-operator-controller-manager-864dd78c4c-d8crn\" (UID: \"5d27c531-72a9-43da-a8c1-44ab27ef6e75\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:20:44.422305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.422213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:20:44.708297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:44.708215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:45.125560 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.125529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"]
Jul 23 11:20:45.128879 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:45.128852    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d27c531_72a9_43da_a8c1_44ab27ef6e75.slice/crio-6056863ca395f7b75441fb6821e0866eb6aac781f8416303c55a934e8e3b403a WatchSource:0}: Error finding container 6056863ca395f7b75441fb6821e0866eb6aac781f8416303c55a934e8e3b403a: Status 404 returned error can't find the container with id 6056863ca395f7b75441fb6821e0866eb6aac781f8416303c55a934e8e3b403a
Jul 23 11:20:45.676347 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.676312    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:45.690892 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.690848    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-88784b4b-xzdhd" podUID="35857bcb-b83e-4629-afcf-6fda7d2a2dcb" containerName="console" containerID="cri-o://634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341" gracePeriod=15
Jul 23 11:20:45.734696 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.734656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn" event={"ID":"5d27c531-72a9-43da-a8c1-44ab27ef6e75","Type":"ContainerStarted","Data":"6056863ca395f7b75441fb6821e0866eb6aac781f8416303c55a934e8e3b403a"}
Jul 23 11:20:45.736678 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.736645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb" event={"ID":"b1075b13-201a-4724-aeed-bd3d30cfe8db","Type":"ContainerStarted","Data":"ace83246a46a41b795706db8879a81a62eb4ffb45eae39f52acfa90db8235f55"}
Jul 23 11:20:45.736845 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.736797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:45.756207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:45.756158    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb" podStartSLOduration=1.8411832860000001 podStartE2EDuration="5.756140495s" totalImagesPullingTime="3.914957209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:45.754298454 +0000 UTC m=+636.881161894" watchObservedRunningTime="2026-07-23 11:20:45.756140495 +0000 UTC m=+636.883003919"
Jul 23 11:20:46.082128 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.082096    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:20:46.120847 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.120791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:46.191523 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-trusted-ca-bundle\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-serving-cert\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-oauth-config\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191684    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-service-ca\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-oauth-serving-cert\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktgz5\" (UniqueName: \"kubernetes.io/projected/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-kube-api-access-ktgz5\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192022 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.191804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-config\") pod \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\" (UID: \"35857bcb-b83e-4629-afcf-6fda7d2a2dcb\") "
Jul 23 11:20:46.192385 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.192259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:20:46.192385 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.192361    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-config" (OuterVolumeSpecName: "console-config") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:20:46.192485 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.192426    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-service-ca" (OuterVolumeSpecName: "service-ca") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:20:46.192485 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.192457    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:20:46.194722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.194672    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:20:46.195012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.194992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-kube-api-access-ktgz5" (OuterVolumeSpecName: "kube-api-access-ktgz5") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "kube-api-access-ktgz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:20:46.195105 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.194991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35857bcb-b83e-4629-afcf-6fda7d2a2dcb" (UID: "35857bcb-b83e-4629-afcf-6fda7d2a2dcb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:20:46.211838 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.211802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:46.293310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293273    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.293310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293304    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.293310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293316    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.293541 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293325    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktgz5\" (UniqueName: \"kubernetes.io/projected/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-kube-api-access-ktgz5\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.293541 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293334    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.293541 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293342    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-trusted-ca-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.293541 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.293351    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35857bcb-b83e-4629-afcf-6fda7d2a2dcb-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:20:46.554310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.554268    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"]
Jul 23 11:20:46.554691 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.554675    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35857bcb-b83e-4629-afcf-6fda7d2a2dcb" containerName="console"
Jul 23 11:20:46.554691 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.554690    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="35857bcb-b83e-4629-afcf-6fda7d2a2dcb" containerName="console"
Jul 23 11:20:46.554815 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.554772    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="35857bcb-b83e-4629-afcf-6fda7d2a2dcb" containerName="console"
Jul 23 11:20:46.558044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.558020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.560894 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.560868    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 11:20:46.561025 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.560930    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 11:20:46.561078 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.561009    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-srkvm\""
Jul 23 11:20:46.567383 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.567356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:46.568293 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.568265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"]
Jul 23 11:20:46.697151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.697113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7c73f01-af5d-42ce-ad03-a01da3a432f2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.697326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.697228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f7c73f01-af5d-42ce-ad03-a01da3a432f2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.697326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.697312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltmmj\" (UniqueName: \"kubernetes.io/projected/f7c73f01-af5d-42ce-ad03-a01da3a432f2-kube-api-access-ltmmj\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.744912 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.744587    2578 generic.go:356] "Generic (PLEG): container finished" podID="35857bcb-b83e-4629-afcf-6fda7d2a2dcb" containerID="634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341" exitCode=0
Jul 23 11:20:46.744912 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.744653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88784b4b-xzdhd" event={"ID":"35857bcb-b83e-4629-afcf-6fda7d2a2dcb","Type":"ContainerDied","Data":"634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341"}
Jul 23 11:20:46.744912 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.744725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88784b4b-xzdhd" event={"ID":"35857bcb-b83e-4629-afcf-6fda7d2a2dcb","Type":"ContainerDied","Data":"72619b73395de2d4ee884f0bb3a8cd994a4ea26a831e5dc214ca2cd1f011ac81"}
Jul 23 11:20:46.744912 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.744755    2578 scope.go:117] "RemoveContainer" containerID="634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341"
Jul 23 11:20:46.744912 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.744669    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88784b4b-xzdhd"
Jul 23 11:20:46.760422 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.760389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:46.770168 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.770133    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88784b4b-xzdhd"]
Jul 23 11:20:46.776786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.776762    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88784b4b-xzdhd"]
Jul 23 11:20:46.798361 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.798321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f7c73f01-af5d-42ce-ad03-a01da3a432f2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.798521 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.798417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltmmj\" (UniqueName: \"kubernetes.io/projected/f7c73f01-af5d-42ce-ad03-a01da3a432f2-kube-api-access-ltmmj\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.798521 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.798496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7c73f01-af5d-42ce-ad03-a01da3a432f2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.799195 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.799172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f7c73f01-af5d-42ce-ad03-a01da3a432f2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.801308 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.801279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7c73f01-af5d-42ce-ad03-a01da3a432f2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.811722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.811671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltmmj\" (UniqueName: \"kubernetes.io/projected/f7c73f01-af5d-42ce-ad03-a01da3a432f2-kube-api-access-ltmmj\") pod \"kuadrant-console-plugin-66b5774985-r2w4r\" (UID: \"f7c73f01-af5d-42ce-ad03-a01da3a432f2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:46.869784 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:46.869752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"
Jul 23 11:20:47.025358 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.025331    2578 scope.go:117] "RemoveContainer" containerID="634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341"
Jul 23 11:20:47.025740 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:47.025718    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341\": container with ID starting with 634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341 not found: ID does not exist" containerID="634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341"
Jul 23 11:20:47.025792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.025751    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341"} err="failed to get container status \"634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341\": rpc error: code = NotFound desc = could not find container \"634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341\": container with ID starting with 634a11f0befdd9b33aac6e45f130d47202c9824d45b43ad275c43bfb0a3eb341 not found: ID does not exist"
Jul 23 11:20:47.158379 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.158350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r"]
Jul 23 11:20:47.160072 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:20:47.160044    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7c73f01_af5d_42ce_ad03_a01da3a432f2.slice/crio-b66bd1930b4f68d318c8695604f75f9cbc929bc1633a08cdda6deab2b48cdce4 WatchSource:0}: Error finding container b66bd1930b4f68d318c8695604f75f9cbc929bc1633a08cdda6deab2b48cdce4: Status 404 returned error can't find the container with id b66bd1930b4f68d318c8695604f75f9cbc929bc1633a08cdda6deab2b48cdce4
Jul 23 11:20:47.323840 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.322013    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35857bcb-b83e-4629-afcf-6fda7d2a2dcb" path="/var/lib/kubelet/pods/35857bcb-b83e-4629-afcf-6fda7d2a2dcb/volumes"
Jul 23 11:20:47.751306 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.751206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r" event={"ID":"f7c73f01-af5d-42ce-ad03-a01da3a432f2","Type":"ContainerStarted","Data":"b66bd1930b4f68d318c8695604f75f9cbc929bc1633a08cdda6deab2b48cdce4"}
Jul 23 11:20:47.753105 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.753070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn" event={"ID":"5d27c531-72a9-43da-a8c1-44ab27ef6e75","Type":"ContainerStarted","Data":"2f66a43182efe89aab6dbfe42057d6d9b1dbd230c9f31ea262eee57e2166d2e7"}
Jul 23 11:20:47.753251 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.753145    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:20:47.771332 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:47.771287    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn" podStartSLOduration=1.824225898 podStartE2EDuration="3.771272714s" totalImagesPullingTime="1.947046816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:20:47.769690312 +0000 UTC m=+638.896553766" watchObservedRunningTime="2026-07-23 11:20:47.771272714 +0000 UTC m=+638.898136137"
Jul 23 11:20:49.484333 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:49.484279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:49.583593 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:49.583485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:54.730136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:54.730097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:56.379482 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.379399    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"]
Jul 23 11:20:56.379978 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.379630    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" containerName="manager" containerID="cri-o://95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3" gracePeriod=2
Jul 23 11:20:56.382149 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.382107    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:56.382509 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.382489    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"]
Jul 23 11:20:56.393621 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.392128    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"]
Jul 23 11:20:56.393621 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.392363    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" containerName="manager" containerID="cri-o://6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5" gracePeriod=2
Jul 23 11:20:56.395458 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.395326    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:56.408152 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.407682    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"edcbe970-b649-4dd2-892f-92d8ff53556e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-cffpd\": pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:56.411835 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.411806    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"]
Jul 23 11:20:56.414159 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.414135    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"]
Jul 23 11:20:56.414729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.414666    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" containerName="manager"
Jul 23 11:20:56.414729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.414731    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" containerName="manager"
Jul 23 11:20:56.414880 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.414846    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" containerName="manager"
Jul 23 11:20:56.414880 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.414859    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" containerName="manager"
Jul 23 11:20:56.415587 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.415038    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" containerName="manager"
Jul 23 11:20:56.415587 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.415054    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" containerName="manager"
Jul 23 11:20:56.420253 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.420232    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"]
Jul 23 11:20:56.420398 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.420380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.424110 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.424090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:20:56.431223 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.431193    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"]
Jul 23 11:20:56.444661 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.444635    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"]
Jul 23 11:20:56.452259 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.452220    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:56.454460 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.454425    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:56.456730 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.456674    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:56.459018 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.458992    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:56.493949 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.493916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m22pk\" (UniqueName: \"kubernetes.io/projected/38416bb4-505c-4518-8ae5-b14643b82ac2-kube-api-access-m22pk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-826cf\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.494111 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.493971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38416bb4-505c-4518-8ae5-b14643b82ac2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-826cf\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.594995 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.594958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m22pk\" (UniqueName: \"kubernetes.io/projected/38416bb4-505c-4518-8ae5-b14643b82ac2-kube-api-access-m22pk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-826cf\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.594995 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.595008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38416bb4-505c-4518-8ae5-b14643b82ac2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-826cf\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.595259 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.595041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g275r\" (UniqueName: \"kubernetes.io/projected/cc4e7879-1d5c-4c4a-afb1-66aade51c50d-kube-api-access-g275r\") pod \"limitador-operator-controller-manager-859d7b78bd-bkzfp\" (UID: \"cc4e7879-1d5c-4c4a-afb1-66aade51c50d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:20:56.595555 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.595525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38416bb4-505c-4518-8ae5-b14643b82ac2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-826cf\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.605035 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.605009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m22pk\" (UniqueName: \"kubernetes.io/projected/38416bb4-505c-4518-8ae5-b14643b82ac2-kube-api-access-m22pk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-826cf\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.696147 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.696048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g275r\" (UniqueName: \"kubernetes.io/projected/cc4e7879-1d5c-4c4a-afb1-66aade51c50d-kube-api-access-g275r\") pod \"limitador-operator-controller-manager-859d7b78bd-bkzfp\" (UID: \"cc4e7879-1d5c-4c4a-afb1-66aade51c50d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:20:56.708887 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.708856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g275r\" (UniqueName: \"kubernetes.io/projected/cc4e7879-1d5c-4c4a-afb1-66aade51c50d-kube-api-access-g275r\") pod \"limitador-operator-controller-manager-859d7b78bd-bkzfp\" (UID: \"cc4e7879-1d5c-4c4a-afb1-66aade51c50d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:20:56.747796 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.747766    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jg6hb"
Jul 23 11:20:56.750407 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.750376    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:20:56.773328 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:20:56.773293    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:20:56.802718 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.802673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:20:56.810334 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:56.810306    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:20:58.116124 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:58.116085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:58.216263 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:58.216225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:20:58.763413 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:20:58.763383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d8crn"
Jul 23 11:21:00.643647 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:00.643587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:00.750554 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:00.750512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:04.923318 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:04.923248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:05.038032 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:05.037979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:07.280123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:07.280082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:07.382225 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:07.382169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:08.651558 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.651004    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:08.653468 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.653429    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:08.660038 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.659972    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"]
Jul 23 11:21:08.661485 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:21:08.661459    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4e7879_1d5c_4c4a_afb1_66aade51c50d.slice/crio-b02592dff991f4c996e30a254b8bf318a039779e72574e788d65dcf34e72da76 WatchSource:0}: Error finding container b02592dff991f4c996e30a254b8bf318a039779e72574e788d65dcf34e72da76: Status 404 returned error can't find the container with id b02592dff991f4c996e30a254b8bf318a039779e72574e788d65dcf34e72da76
Jul 23 11:21:08.666084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.666063    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:21:08.668715 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.668675    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:08.671924 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.671889    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:21:08.695715 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.695688    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"]
Jul 23 11:21:08.697599 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:21:08.697574    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38416bb4_505c_4518_8ae5_b14643b82ac2.slice/crio-ad860db3fef07c6fb5f399b35f16f34cf2f207f4a9b93199f39e5c3411c09326 WatchSource:0}: Error finding container ad860db3fef07c6fb5f399b35f16f34cf2f207f4a9b93199f39e5c3411c09326: Status 404 returned error can't find the container with id ad860db3fef07c6fb5f399b35f16f34cf2f207f4a9b93199f39e5c3411c09326
Jul 23 11:21:08.713419 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.713400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2lrx\" (UniqueName: \"kubernetes.io/projected/9f8e1b39-fdcd-4285-883e-e601cd834153-kube-api-access-k2lrx\") pod \"9f8e1b39-fdcd-4285-883e-e601cd834153\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") "
Jul 23 11:21:08.713507 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.713448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddwxr\" (UniqueName: \"kubernetes.io/projected/edcbe970-b649-4dd2-892f-92d8ff53556e-kube-api-access-ddwxr\") pod \"edcbe970-b649-4dd2-892f-92d8ff53556e\" (UID: \"edcbe970-b649-4dd2-892f-92d8ff53556e\") "
Jul 23 11:21:08.713553 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.713523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8e1b39-fdcd-4285-883e-e601cd834153-extensions-socket-volume\") pod \"9f8e1b39-fdcd-4285-883e-e601cd834153\" (UID: \"9f8e1b39-fdcd-4285-883e-e601cd834153\") "
Jul 23 11:21:08.714120 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.714091    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8e1b39-fdcd-4285-883e-e601cd834153-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f8e1b39-fdcd-4285-883e-e601cd834153" (UID: "9f8e1b39-fdcd-4285-883e-e601cd834153"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:21:08.715702 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.715676    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edcbe970-b649-4dd2-892f-92d8ff53556e-kube-api-access-ddwxr" (OuterVolumeSpecName: "kube-api-access-ddwxr") pod "edcbe970-b649-4dd2-892f-92d8ff53556e" (UID: "edcbe970-b649-4dd2-892f-92d8ff53556e"). InnerVolumeSpecName "kube-api-access-ddwxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:21:08.715781 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.715708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8e1b39-fdcd-4285-883e-e601cd834153-kube-api-access-k2lrx" (OuterVolumeSpecName: "kube-api-access-k2lrx") pod "9f8e1b39-fdcd-4285-883e-e601cd834153" (UID: "9f8e1b39-fdcd-4285-883e-e601cd834153"). InnerVolumeSpecName "kube-api-access-k2lrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:21:08.814560 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.814533    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8e1b39-fdcd-4285-883e-e601cd834153-extensions-socket-volume\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:08.814560 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.814556    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2lrx\" (UniqueName: \"kubernetes.io/projected/9f8e1b39-fdcd-4285-883e-e601cd834153-kube-api-access-k2lrx\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:08.814560 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.814566    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddwxr\" (UniqueName: \"kubernetes.io/projected/edcbe970-b649-4dd2-892f-92d8ff53556e-kube-api-access-ddwxr\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:08.882911 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.882871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp" event={"ID":"cc4e7879-1d5c-4c4a-afb1-66aade51c50d","Type":"ContainerStarted","Data":"18a16496c1c3cb9cbd67da3e338aca871302cac7c4b116a63a0512c47b8ab7c2"}
Jul 23 11:21:08.883099 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.883040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:21:08.883099 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.883080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp" event={"ID":"cc4e7879-1d5c-4c4a-afb1-66aade51c50d","Type":"ContainerStarted","Data":"b02592dff991f4c996e30a254b8bf318a039779e72574e788d65dcf34e72da76"}
Jul 23 11:21:08.884274 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.884250    2578 generic.go:356] "Generic (PLEG): container finished" podID="edcbe970-b649-4dd2-892f-92d8ff53556e" containerID="6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5" exitCode=0
Jul 23 11:21:08.884390 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.884286    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:08.884390 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.884325    2578 scope.go:117] "RemoveContainer" containerID="6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5"
Jul 23 11:21:08.885783 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.885749    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:08.886224 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.886201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf" event={"ID":"38416bb4-505c-4518-8ae5-b14643b82ac2","Type":"ContainerStarted","Data":"3f344952c131196390025f9c3f20df02064b45e4f886bfe55fce37eb10bb93e9"}
Jul 23 11:21:08.886310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.886246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf" event={"ID":"38416bb4-505c-4518-8ae5-b14643b82ac2","Type":"ContainerStarted","Data":"ad860db3fef07c6fb5f399b35f16f34cf2f207f4a9b93199f39e5c3411c09326"}
Jul 23 11:21:08.886365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.886307    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:21:08.887653 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.887634    2578 generic.go:356] "Generic (PLEG): container finished" podID="9f8e1b39-fdcd-4285-883e-e601cd834153" containerID="95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3" exitCode=0
Jul 23 11:21:08.887751 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.887677    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:21:08.888388 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.888361    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:21:08.889300 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.889281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r" event={"ID":"f7c73f01-af5d-42ce-ad03-a01da3a432f2","Type":"ContainerStarted","Data":"02458885e863f05ec4fefa210f28ca2fc14000e4ccc4cca46b214f6e1f4c4266"}
Jul 23 11:21:08.894075 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.894054    2578 scope.go:117] "RemoveContainer" containerID="6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5"
Jul 23 11:21:08.894315 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.894295    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5\": container with ID starting with 6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5 not found: ID does not exist" containerID="6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5"
Jul 23 11:21:08.894365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.894324    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5"} err="failed to get container status \"6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5\": rpc error: code = NotFound desc = could not find container \"6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5\": container with ID starting with 6c02c83ce0f05972db64ba3f9e811ea791ac143516ef9b6648039c753dc78ce5 not found: ID does not exist"
Jul 23 11:21:08.894365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.894342    2578 scope.go:117] "RemoveContainer" containerID="95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3"
Jul 23 11:21:08.902054 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.902039    2578 scope.go:117] "RemoveContainer" containerID="95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3"
Jul 23 11:21:08.902302 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.902284    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3\": container with ID starting with 95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3 not found: ID does not exist" containerID="95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3"
Jul 23 11:21:08.902349 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.902308    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3"} err="failed to get container status \"95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3\": rpc error: code = NotFound desc = could not find container \"95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3\": container with ID starting with 95c205ce78ddcac28ada3bb121390a1017fca9b9486e46a31a974e6cb82eb9f3 not found: ID does not exist"
Jul 23 11:21:08.907023 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.906981    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp" podStartSLOduration=12.906969285 podStartE2EDuration="12.906969285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:08.906322099 +0000 UTC m=+660.033185546" watchObservedRunningTime="2026-07-23 11:21:08.906969285 +0000 UTC m=+660.033832709"
Jul 23 11:21:08.908762 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.908740    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:08.910935 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:08.910911    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:21:08.927888 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.927848    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r2w4r" podStartSLOduration=1.5055028369999999 podStartE2EDuration="22.927834818s" totalImagesPullingTime="21.422331981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:08.927198994 +0000 UTC m=+660.054062418" watchObservedRunningTime="2026-07-23 11:21:08.927834818 +0000 UTC m=+660.054698240"
Jul 23 11:21:08.955011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:08.954963    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf" podStartSLOduration=12.954945567 podStartE2EDuration="12.954945567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:08.954118536 +0000 UTC m=+660.080981959" watchObservedRunningTime="2026-07-23 11:21:08.954945567 +0000 UTC m=+660.081808993"
Jul 23 11:21:09.316257 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:09.316226    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cffpd\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cffpd"
Jul 23 11:21:09.318259 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:09.318230    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" path="/var/lib/kubelet/pods/9f8e1b39-fdcd-4285-883e-e601cd834153/volumes"
Jul 23 11:21:09.318386 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:09.318253    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q676g\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="9f8e1b39-fdcd-4285-883e-e601cd834153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q676g"
Jul 23 11:21:09.318703 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:09.318684    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edcbe970-b649-4dd2-892f-92d8ff53556e" path="/var/lib/kubelet/pods/edcbe970-b649-4dd2-892f-92d8ff53556e/volumes"
Jul 23 11:21:15.265622 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:15.265580    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"]
Jul 23 11:21:15.266056 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:15.265808    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf" podUID="38416bb4-505c-4518-8ae5-b14643b82ac2" containerName="manager" containerID="cri-o://3f344952c131196390025f9c3f20df02064b45e4f886bfe55fce37eb10bb93e9" gracePeriod=10
Jul 23 11:21:15.267559 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:15.267531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:21:15.925083 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:15.925056    2578 generic.go:356] "Generic (PLEG): container finished" podID="38416bb4-505c-4518-8ae5-b14643b82ac2" containerID="3f344952c131196390025f9c3f20df02064b45e4f886bfe55fce37eb10bb93e9" exitCode=0
Jul 23 11:21:15.925231 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:15.925141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf" event={"ID":"38416bb4-505c-4518-8ae5-b14643b82ac2","Type":"ContainerDied","Data":"3f344952c131196390025f9c3f20df02064b45e4f886bfe55fce37eb10bb93e9"}
Jul 23 11:21:16.064506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.064479    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:21:16.125113 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.125073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:16.175440 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.175367    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m22pk\" (UniqueName: \"kubernetes.io/projected/38416bb4-505c-4518-8ae5-b14643b82ac2-kube-api-access-m22pk\") pod \"38416bb4-505c-4518-8ae5-b14643b82ac2\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") "
Jul 23 11:21:16.175620 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.175459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38416bb4-505c-4518-8ae5-b14643b82ac2-extensions-socket-volume\") pod \"38416bb4-505c-4518-8ae5-b14643b82ac2\" (UID: \"38416bb4-505c-4518-8ae5-b14643b82ac2\") "
Jul 23 11:21:16.175723 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.175701    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38416bb4-505c-4518-8ae5-b14643b82ac2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "38416bb4-505c-4518-8ae5-b14643b82ac2" (UID: "38416bb4-505c-4518-8ae5-b14643b82ac2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:21:16.175852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.175835    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38416bb4-505c-4518-8ae5-b14643b82ac2-extensions-socket-volume\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:16.177405 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.177383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38416bb4-505c-4518-8ae5-b14643b82ac2-kube-api-access-m22pk" (OuterVolumeSpecName: "kube-api-access-m22pk") pod "38416bb4-505c-4518-8ae5-b14643b82ac2" (UID: "38416bb4-505c-4518-8ae5-b14643b82ac2"). InnerVolumeSpecName "kube-api-access-m22pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:21:16.225400 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.225369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:16.276682 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.276657    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m22pk\" (UniqueName: \"kubernetes.io/projected/38416bb4-505c-4518-8ae5-b14643b82ac2-kube-api-access-m22pk\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:16.931211 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.931181    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"
Jul 23 11:21:16.931211 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.931199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf" event={"ID":"38416bb4-505c-4518-8ae5-b14643b82ac2","Type":"ContainerDied","Data":"ad860db3fef07c6fb5f399b35f16f34cf2f207f4a9b93199f39e5c3411c09326"}
Jul 23 11:21:16.931510 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.931256    2578 scope.go:117] "RemoveContainer" containerID="3f344952c131196390025f9c3f20df02064b45e4f886bfe55fce37eb10bb93e9"
Jul 23 11:21:16.962236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.962209    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"]
Jul 23 11:21:16.965639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:16.965593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-826cf"]
Jul 23 11:21:17.318017 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:17.317989    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38416bb4-505c-4518-8ae5-b14643b82ac2" path="/var/lib/kubelet/pods/38416bb4-505c-4518-8ae5-b14643b82ac2/volumes"
Jul 23 11:21:17.864315 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:17.864274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:17.963768 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:17.963737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:19.689838 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:19.689799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:19.895774 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:19.895733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:19.897074 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:19.897050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzfp"
Jul 23 11:21:25.263871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:25.263833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:25.363383 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:25.363353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:26.567020 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:26.566985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:26.666143 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:26.666107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:27.988311 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:27.988273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:29.676845 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:29.676813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:29.777106 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:29.777068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:31.538345 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.538309    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"]
Jul 23 11:21:31.538817 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.538802    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38416bb4-505c-4518-8ae5-b14643b82ac2" containerName="manager"
Jul 23 11:21:31.538867 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.538819    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="38416bb4-505c-4518-8ae5-b14643b82ac2" containerName="manager"
Jul 23 11:21:31.538905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.538883    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="38416bb4-505c-4518-8ae5-b14643b82ac2" containerName="manager"
Jul 23 11:21:31.540748 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.540729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.543589 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.543569    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 11:21:31.543718 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.543591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nb4r2\""
Jul 23 11:21:31.553688 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.553660    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"]
Jul 23 11:21:31.600789 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.600922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlxnk\" (UniqueName: \"kubernetes.io/projected/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-kube-api-access-zlxnk\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.600922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.600922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.601026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.601026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.601026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.601026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.600984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.601157 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.601029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702184 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlxnk\" (UniqueName: \"kubernetes.io/projected/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-kube-api-access-zlxnk\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702752 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702752 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702752 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702909 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.702909 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.702800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.703117 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.703096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.704567 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.704545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.704769 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.704749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.727257 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.727234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.727713 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.727694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlxnk\" (UniqueName: \"kubernetes.io/projected/5fdaa0c4-6022-495d-b08f-4c5c6e509ebd-kube-api-access-zlxnk\") pod \"maas-default-gateway-openshift-default-56654dcf7-wxwvf\" (UID: \"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.850917 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.850862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:31.932149 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.932097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:31.983767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.983741    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"]
Jul 23 11:21:31.985238 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:21:31.985211    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdaa0c4_6022_495d_b08f_4c5c6e509ebd.slice/crio-637703a5bf744d7e76a19429693825e068b8cac5d4ec7ee26e51318f8bb5d0ed WatchSource:0}: Error finding container 637703a5bf744d7e76a19429693825e068b8cac5d4ec7ee26e51318f8bb5d0ed: Status 404 returned error can't find the container with id 637703a5bf744d7e76a19429693825e068b8cac5d4ec7ee26e51318f8bb5d0ed
Jul 23 11:21:31.989437 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:31.989406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:32.003272 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:32.003247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" event={"ID":"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd","Type":"ContainerStarted","Data":"637703a5bf744d7e76a19429693825e068b8cac5d4ec7ee26e51318f8bb5d0ed"}
Jul 23 11:21:35.958685 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:35.958653    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:21:35.958979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:35.958722    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:21:35.958979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:35.958750    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:21:36.025344 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:36.025318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" event={"ID":"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd","Type":"ContainerStarted","Data":"108a9d472b3da486777d383412c482a8123d4ddc1ca3497bd5d6a4399487c4d6"}
Jul 23 11:21:37.056414 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:37.056365    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" podStartSLOduration=2.085088881 podStartE2EDuration="6.056347484s" totalImagesPullingTime="3.971258603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:37.054566875 +0000 UTC m=+688.181430299" watchObservedRunningTime="2026-07-23 11:21:37.056347484 +0000 UTC m=+688.183210907"
Jul 23 11:21:37.851432 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:37.851397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:37.855789 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:37.855764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:38.036125 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.036101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:38.037074 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.037048    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:21:38.044652 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.044629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:38.066576 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.066552    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:38.070350 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.070332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.073087 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.073061    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 11:21:38.083555 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.083528    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:38.154056 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.153945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:38.154220 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.154096    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:38.162007 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.161982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnwx2\" (UniqueName: \"kubernetes.io/projected/83b584d2-5aaa-4906-a721-f12c1d8ecff7-kube-api-access-bnwx2\") pod \"limitador-limitador-64c94fd64f-dm564\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.162151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.162131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83b584d2-5aaa-4906-a721-f12c1d8ecff7-config-file\") pod \"limitador-limitador-64c94fd64f-dm564\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.253999 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.253969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:38.262958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.262929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnwx2\" (UniqueName: \"kubernetes.io/projected/83b584d2-5aaa-4906-a721-f12c1d8ecff7-kube-api-access-bnwx2\") pod \"limitador-limitador-64c94fd64f-dm564\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.263085 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.262999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83b584d2-5aaa-4906-a721-f12c1d8ecff7-config-file\") pod \"limitador-limitador-64c94fd64f-dm564\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.263595 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.263574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83b584d2-5aaa-4906-a721-f12c1d8ecff7-config-file\") pod \"limitador-limitador-64c94fd64f-dm564\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.275012 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.274989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnwx2\" (UniqueName: \"kubernetes.io/projected/83b584d2-5aaa-4906-a721-f12c1d8ecff7-kube-api-access-bnwx2\") pod \"limitador-limitador-64c94fd64f-dm564\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.391717 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.391693    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:38.524673 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.524647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:38.526700 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:21:38.526667    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b584d2_5aaa_4906_a721_f12c1d8ecff7.slice/crio-5454c307dcfe449ed9dd5af61eba3068febb721f42e776e428233f7ab3591318 WatchSource:0}: Error finding container 5454c307dcfe449ed9dd5af61eba3068febb721f42e776e428233f7ab3591318: Status 404 returned error can't find the container with id 5454c307dcfe449ed9dd5af61eba3068febb721f42e776e428233f7ab3591318
Jul 23 11:21:38.889875 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.889845    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qs4fx"]
Jul 23 11:21:38.917400 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.917357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:38.924895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.924872    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qs4fx"]
Jul 23 11:21:38.925031 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.924970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:38.927472 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:38.927453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f7cpt\""
Jul 23 11:21:39.020455 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.020423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:39.042377 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.042347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564" event={"ID":"83b584d2-5aaa-4906-a721-f12c1d8ecff7","Type":"ContainerStarted","Data":"5454c307dcfe449ed9dd5af61eba3068febb721f42e776e428233f7ab3591318"}
Jul 23 11:21:39.069737 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.069708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxhr8\" (UniqueName: \"kubernetes.io/projected/3bd49e95-26e0-498b-87c4-3c060e426dd2-kube-api-access-lxhr8\") pod \"authorino-58cd955675-qs4fx\" (UID: \"3bd49e95-26e0-498b-87c4-3c060e426dd2\") " pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:39.170418 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.170354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxhr8\" (UniqueName: \"kubernetes.io/projected/3bd49e95-26e0-498b-87c4-3c060e426dd2-kube-api-access-lxhr8\") pod \"authorino-58cd955675-qs4fx\" (UID: \"3bd49e95-26e0-498b-87c4-3c060e426dd2\") " pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:39.180350 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.180312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxhr8\" (UniqueName: \"kubernetes.io/projected/3bd49e95-26e0-498b-87c4-3c060e426dd2-kube-api-access-lxhr8\") pod \"authorino-58cd955675-qs4fx\" (UID: \"3bd49e95-26e0-498b-87c4-3c060e426dd2\") " pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:39.234509 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.234339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:39.409130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:39.409102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qs4fx"]
Jul 23 11:21:39.423321 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:21:39.412728    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bd49e95_26e0_498b_87c4_3c060e426dd2.slice/crio-b89e152f0f481dde91fc6ef2c1cd3fa074030b65a933422fc6be20cffb573dcf WatchSource:0}: Error finding container b89e152f0f481dde91fc6ef2c1cd3fa074030b65a933422fc6be20cffb573dcf: Status 404 returned error can't find the container with id b89e152f0f481dde91fc6ef2c1cd3fa074030b65a933422fc6be20cffb573dcf
Jul 23 11:21:40.049832 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:40.049797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qs4fx" event={"ID":"3bd49e95-26e0-498b-87c4-3c060e426dd2","Type":"ContainerStarted","Data":"b89e152f0f481dde91fc6ef2c1cd3fa074030b65a933422fc6be20cffb573dcf"}
Jul 23 11:21:40.265453 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:40.265409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:40.333278 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:40.333153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:40.656989 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:40.656904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:40.742879 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:40.742849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:42.065852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.065810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564" event={"ID":"83b584d2-5aaa-4906-a721-f12c1d8ecff7","Type":"ContainerStarted","Data":"d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907"}
Jul 23 11:21:42.066347 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.065887    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:42.087796 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.087719    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564" podStartSLOduration=1.11947304 podStartE2EDuration="4.087697642s" totalImagesPullingTime="2.968224602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:42.085302605 +0000 UTC m=+693.212166058" watchObservedRunningTime="2026-07-23 11:21:42.087697642 +0000 UTC m=+693.214561069"
Jul 23 11:21:42.454891 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.454813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:42.519308 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.519272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:42.682475 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.682423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:42.782814 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:42.782780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:43.463423 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:43.463389    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qs4fx"]
Jul 23 11:21:44.077719 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.077682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qs4fx" event={"ID":"3bd49e95-26e0-498b-87c4-3c060e426dd2","Type":"ContainerStarted","Data":"e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855"}
Jul 23 11:21:44.077719 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.077704    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qs4fx" podUID="3bd49e95-26e0-498b-87c4-3c060e426dd2" containerName="authorino" containerID="cri-o://e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855" gracePeriod=30
Jul 23 11:21:44.093635 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.093573    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qs4fx" podStartSLOduration=1.88794826 podStartE2EDuration="6.093557384s" totalImagesPullingTime="4.205609124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:21:44.09237939 +0000 UTC m=+695.219242815" watchObservedRunningTime="2026-07-23 11:21:44.093557384 +0000 UTC m=+695.220420807"
Jul 23 11:21:44.330843 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.330794    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:44.420851 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.420828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxhr8\" (UniqueName: \"kubernetes.io/projected/3bd49e95-26e0-498b-87c4-3c060e426dd2-kube-api-access-lxhr8\") pod \"3bd49e95-26e0-498b-87c4-3c060e426dd2\" (UID: \"3bd49e95-26e0-498b-87c4-3c060e426dd2\") "
Jul 23 11:21:44.422783 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.422763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd49e95-26e0-498b-87c4-3c060e426dd2-kube-api-access-lxhr8" (OuterVolumeSpecName: "kube-api-access-lxhr8") pod "3bd49e95-26e0-498b-87c4-3c060e426dd2" (UID: "3bd49e95-26e0-498b-87c4-3c060e426dd2"). InnerVolumeSpecName "kube-api-access-lxhr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:21:44.521920 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:44.521898    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxhr8\" (UniqueName: \"kubernetes.io/projected/3bd49e95-26e0-498b-87c4-3c060e426dd2-kube-api-access-lxhr8\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:45.084076 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.084012    2578 generic.go:356] "Generic (PLEG): container finished" podID="3bd49e95-26e0-498b-87c4-3c060e426dd2" containerID="e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855" exitCode=0
Jul 23 11:21:45.084076 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.084062    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qs4fx"
Jul 23 11:21:45.084304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.084090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qs4fx" event={"ID":"3bd49e95-26e0-498b-87c4-3c060e426dd2","Type":"ContainerDied","Data":"e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855"}
Jul 23 11:21:45.084304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.084127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qs4fx" event={"ID":"3bd49e95-26e0-498b-87c4-3c060e426dd2","Type":"ContainerDied","Data":"b89e152f0f481dde91fc6ef2c1cd3fa074030b65a933422fc6be20cffb573dcf"}
Jul 23 11:21:45.084304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.084147    2578 scope.go:117] "RemoveContainer" containerID="e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855"
Jul 23 11:21:45.094026 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.094007    2578 scope.go:117] "RemoveContainer" containerID="e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855"
Jul 23 11:21:45.094301 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:45.094276    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855\": container with ID starting with e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855 not found: ID does not exist" containerID="e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855"
Jul 23 11:21:45.094416 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.094307    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855"} err="failed to get container status \"e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855\": rpc error: code = NotFound desc = could not find container \"e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855\": container with ID starting with e3f95cf8ddc71c5431d536154efd057b0b18f8055d1ac2ec23ca28f4fad36855 not found: ID does not exist"
Jul 23 11:21:45.106972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.106950    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qs4fx"]
Jul 23 11:21:45.111102 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.111081    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qs4fx"]
Jul 23 11:21:45.317790 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:45.317762    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bd49e95-26e0-498b-87c4-3c060e426dd2" path="/var/lib/kubelet/pods/3bd49e95-26e0-498b-87c4-3c060e426dd2/volumes"
Jul 23 11:21:53.072126 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.072093    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:53.226123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.226083    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:53.226356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.226335    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564" podUID="83b584d2-5aaa-4906-a721-f12c1d8ecff7" containerName="limitador" containerID="cri-o://d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907" gracePeriod=30
Jul 23 11:21:53.776863 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.776841    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:53.897639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.897562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83b584d2-5aaa-4906-a721-f12c1d8ecff7-config-file\") pod \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") "
Jul 23 11:21:53.897762 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.897644    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnwx2\" (UniqueName: \"kubernetes.io/projected/83b584d2-5aaa-4906-a721-f12c1d8ecff7-kube-api-access-bnwx2\") pod \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\" (UID: \"83b584d2-5aaa-4906-a721-f12c1d8ecff7\") "
Jul 23 11:21:53.897895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.897876    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b584d2-5aaa-4906-a721-f12c1d8ecff7-config-file" (OuterVolumeSpecName: "config-file") pod "83b584d2-5aaa-4906-a721-f12c1d8ecff7" (UID: "83b584d2-5aaa-4906-a721-f12c1d8ecff7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:21:53.899620 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.899588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b584d2-5aaa-4906-a721-f12c1d8ecff7-kube-api-access-bnwx2" (OuterVolumeSpecName: "kube-api-access-bnwx2") pod "83b584d2-5aaa-4906-a721-f12c1d8ecff7" (UID: "83b584d2-5aaa-4906-a721-f12c1d8ecff7"). InnerVolumeSpecName "kube-api-access-bnwx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:21:53.998655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.998634    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83b584d2-5aaa-4906-a721-f12c1d8ecff7-config-file\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:53.998655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:53.998654    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnwx2\" (UniqueName: \"kubernetes.io/projected/83b584d2-5aaa-4906-a721-f12c1d8ecff7-kube-api-access-bnwx2\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:21:54.133457 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.133431    2578 generic.go:356] "Generic (PLEG): container finished" podID="83b584d2-5aaa-4906-a721-f12c1d8ecff7" containerID="d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907" exitCode=0
Jul 23 11:21:54.133831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.133474    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564"
Jul 23 11:21:54.133831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.133508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564" event={"ID":"83b584d2-5aaa-4906-a721-f12c1d8ecff7","Type":"ContainerDied","Data":"d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907"}
Jul 23 11:21:54.133831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.133548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dm564" event={"ID":"83b584d2-5aaa-4906-a721-f12c1d8ecff7","Type":"ContainerDied","Data":"5454c307dcfe449ed9dd5af61eba3068febb721f42e776e428233f7ab3591318"}
Jul 23 11:21:54.133831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.133569    2578 scope.go:117] "RemoveContainer" containerID="d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907"
Jul 23 11:21:54.141957 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.141942    2578 scope.go:117] "RemoveContainer" containerID="d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907"
Jul 23 11:21:54.142198 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:21:54.142179    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907\": container with ID starting with d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907 not found: ID does not exist" containerID="d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907"
Jul 23 11:21:54.142254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.142205    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907"} err="failed to get container status \"d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907\": rpc error: code = NotFound desc = could not find container \"d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907\": container with ID starting with d7e76f8b537e8f5c457403f47922f845a9a202cab023aa1d2df865d8960e7907 not found: ID does not exist"
Jul 23 11:21:54.156434 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.156386    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:54.159774 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:54.159754    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dm564"]
Jul 23 11:21:55.318197 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:55.318165    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b584d2-5aaa-4906-a721-f12c1d8ecff7" path="/var/lib/kubelet/pods/83b584d2-5aaa-4906-a721-f12c1d8ecff7/volumes"
Jul 23 11:21:59.237660 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.237621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:59.335203 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.335167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:59.693246 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.693202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:21:59.746982 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.746953    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"]
Jul 23 11:21:59.747327 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.747315    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b584d2-5aaa-4906-a721-f12c1d8ecff7" containerName="limitador"
Jul 23 11:21:59.747365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.747328    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b584d2-5aaa-4906-a721-f12c1d8ecff7" containerName="limitador"
Jul 23 11:21:59.747365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.747338    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd49e95-26e0-498b-87c4-3c060e426dd2" containerName="authorino"
Jul 23 11:21:59.747365 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.747344    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd49e95-26e0-498b-87c4-3c060e426dd2" containerName="authorino"
Jul 23 11:21:59.747474 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.747398    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bd49e95-26e0-498b-87c4-3c060e426dd2" containerName="authorino"
Jul 23 11:21:59.747474 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.747405    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b584d2-5aaa-4906-a721-f12c1d8ecff7" containerName="limitador"
Jul 23 11:21:59.751595 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.751577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:21:59.764479 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.764459    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 11:21:59.764744 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.764724    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rvvvg\""
Jul 23 11:21:59.764825 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.764809    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 11:21:59.766118 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.766103    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 11:21:59.778986 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.778965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"]
Jul 23 11:21:59.843250 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.843218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16b38334-4f2d-4522-81cf-5b9049ad49b0-data\") pod \"postgres-69fb4594cf-7hn7c\" (UID: \"16b38334-4f2d-4522-81cf-5b9049ad49b0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:21:59.843345 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.843280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt74s\" (UniqueName: \"kubernetes.io/projected/16b38334-4f2d-4522-81cf-5b9049ad49b0-kube-api-access-qt74s\") pod \"postgres-69fb4594cf-7hn7c\" (UID: \"16b38334-4f2d-4522-81cf-5b9049ad49b0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:21:59.944137 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.944069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt74s\" (UniqueName: \"kubernetes.io/projected/16b38334-4f2d-4522-81cf-5b9049ad49b0-kube-api-access-qt74s\") pod \"postgres-69fb4594cf-7hn7c\" (UID: \"16b38334-4f2d-4522-81cf-5b9049ad49b0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:21:59.944137 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.944118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16b38334-4f2d-4522-81cf-5b9049ad49b0-data\") pod \"postgres-69fb4594cf-7hn7c\" (UID: \"16b38334-4f2d-4522-81cf-5b9049ad49b0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:21:59.944437 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.944416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16b38334-4f2d-4522-81cf-5b9049ad49b0-data\") pod \"postgres-69fb4594cf-7hn7c\" (UID: \"16b38334-4f2d-4522-81cf-5b9049ad49b0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:21:59.953501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:21:59.953477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt74s\" (UniqueName: \"kubernetes.io/projected/16b38334-4f2d-4522-81cf-5b9049ad49b0-kube-api-access-qt74s\") pod \"postgres-69fb4594cf-7hn7c\" (UID: \"16b38334-4f2d-4522-81cf-5b9049ad49b0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:22:00.061447 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:00.061407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:22:00.194776 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:00.194716    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"]
Jul 23 11:22:00.196291 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:22:00.196251    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b38334_4f2d_4522_81cf_5b9049ad49b0.slice/crio-eefd9b2bd0d51d0689b07407b23dd2623468166e6cef70d57853a8f12a243b11 WatchSource:0}: Error finding container eefd9b2bd0d51d0689b07407b23dd2623468166e6cef70d57853a8f12a243b11: Status 404 returned error can't find the container with id eefd9b2bd0d51d0689b07407b23dd2623468166e6cef70d57853a8f12a243b11
Jul 23 11:22:01.169663 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:01.169631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c" event={"ID":"16b38334-4f2d-4522-81cf-5b9049ad49b0","Type":"ContainerStarted","Data":"eefd9b2bd0d51d0689b07407b23dd2623468166e6cef70d57853a8f12a243b11"}
Jul 23 11:22:07.212403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:07.212366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c" event={"ID":"16b38334-4f2d-4522-81cf-5b9049ad49b0","Type":"ContainerStarted","Data":"d66d8a76e65429d79ec9fa45e309b2abe3778b209aeeb299d94bb351a88eff16"}
Jul 23 11:22:07.212878 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:07.212431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:22:07.233512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:07.233464    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c" podStartSLOduration=1.8388375689999998 podStartE2EDuration="8.233449176s" totalImagesPullingTime="6.394611607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:22:07.232252374 +0000 UTC m=+718.359115799" watchObservedRunningTime="2026-07-23 11:22:07.233449176 +0000 UTC m=+718.360312599"
Jul 23 11:22:13.245940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:13.245910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7hn7c"
Jul 23 11:22:13.555377 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:13.555345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:13.889567 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:13.889489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:20.081321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.081287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:20.090281 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.090252    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c46c6f85-2t7rv"]
Jul 23 11:22:20.098096 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.098076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.109666 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.109644    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 11:22:20.109793 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.109671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s4s79\""
Jul 23 11:22:20.109793 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.109714    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 11:22:20.110693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.110673    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c46c6f85-2t7rv"]
Jul 23 11:22:20.177771 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.177743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:20.239362 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.239334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb71461-fe4a-4b1e-800f-b0a057c97f37-webhook-cert\") pod \"maas-controller-5c46c6f85-2t7rv\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") " pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.239477 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.239377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qjr\" (UniqueName: \"kubernetes.io/projected/dfb71461-fe4a-4b1e-800f-b0a057c97f37-kube-api-access-99qjr\") pod \"maas-controller-5c46c6f85-2t7rv\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") " pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.273082 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.273053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:20.277253 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.277235    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7646859554-chpkl"]
Jul 23 11:22:20.280643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.280627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.290110 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.290087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646859554-chpkl"]
Jul 23 11:22:20.339156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.339096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:20.340146 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.340127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8ds\" (UniqueName: \"kubernetes.io/projected/21c24bd4-1090-4741-969c-277d4cf273db-kube-api-access-2k8ds\") pod \"maas-controller-7646859554-chpkl\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") " pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.340217 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.340159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb71461-fe4a-4b1e-800f-b0a057c97f37-webhook-cert\") pod \"maas-controller-5c46c6f85-2t7rv\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") " pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.340217 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.340187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qjr\" (UniqueName: \"kubernetes.io/projected/dfb71461-fe4a-4b1e-800f-b0a057c97f37-kube-api-access-99qjr\") pod \"maas-controller-5c46c6f85-2t7rv\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") " pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.340305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.340232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c24bd4-1090-4741-969c-277d4cf273db-webhook-cert\") pod \"maas-controller-7646859554-chpkl\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") " pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.342497 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.342477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb71461-fe4a-4b1e-800f-b0a057c97f37-webhook-cert\") pod \"maas-controller-5c46c6f85-2t7rv\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") " pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.349047 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.349021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qjr\" (UniqueName: \"kubernetes.io/projected/dfb71461-fe4a-4b1e-800f-b0a057c97f37-kube-api-access-99qjr\") pod \"maas-controller-5c46c6f85-2t7rv\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") " pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.408767 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.408746    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:20.440805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.440782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c24bd4-1090-4741-969c-277d4cf273db-webhook-cert\") pod \"maas-controller-7646859554-chpkl\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") " pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.440901 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.440878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8ds\" (UniqueName: \"kubernetes.io/projected/21c24bd4-1090-4741-969c-277d4cf273db-kube-api-access-2k8ds\") pod \"maas-controller-7646859554-chpkl\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") " pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.443129 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.443098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c24bd4-1090-4741-969c-277d4cf273db-webhook-cert\") pod \"maas-controller-7646859554-chpkl\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") " pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.450512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.450491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8ds\" (UniqueName: \"kubernetes.io/projected/21c24bd4-1090-4741-969c-277d4cf273db-kube-api-access-2k8ds\") pod \"maas-controller-7646859554-chpkl\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") " pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.577418 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.577392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c46c6f85-2t7rv"]
Jul 23 11:22:20.578879 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:22:20.578846    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb71461_fe4a_4b1e_800f_b0a057c97f37.slice/crio-d68c446afcc938b3333ee3f1f98dee672dd653bf05c044e8fba15dc413068b68 WatchSource:0}: Error finding container d68c446afcc938b3333ee3f1f98dee672dd653bf05c044e8fba15dc413068b68: Status 404 returned error can't find the container with id d68c446afcc938b3333ee3f1f98dee672dd653bf05c044e8fba15dc413068b68
Jul 23 11:22:20.590818 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.590769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:20.736807 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:20.736785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646859554-chpkl"]
Jul 23 11:22:20.737937 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:22:20.737906    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c24bd4_1090_4741_969c_277d4cf273db.slice/crio-cb858630a9110107badec32ac5a6aabb2b5fbb7aefbd86410453eef98f60032b WatchSource:0}: Error finding container cb858630a9110107badec32ac5a6aabb2b5fbb7aefbd86410453eef98f60032b: Status 404 returned error can't find the container with id cb858630a9110107badec32ac5a6aabb2b5fbb7aefbd86410453eef98f60032b
Jul 23 11:22:21.280821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:21.280711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c46c6f85-2t7rv" event={"ID":"dfb71461-fe4a-4b1e-800f-b0a057c97f37","Type":"ContainerStarted","Data":"d68c446afcc938b3333ee3f1f98dee672dd653bf05c044e8fba15dc413068b68"}
Jul 23 11:22:21.282659 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:21.282632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-chpkl" event={"ID":"21c24bd4-1090-4741-969c-277d4cf273db","Type":"ContainerStarted","Data":"cb858630a9110107badec32ac5a6aabb2b5fbb7aefbd86410453eef98f60032b"}
Jul 23 11:22:23.293825 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.293790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:23.294884 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.294852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c46c6f85-2t7rv" event={"ID":"dfb71461-fe4a-4b1e-800f-b0a057c97f37","Type":"ContainerStarted","Data":"d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6"}
Jul 23 11:22:23.295059 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.294959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:23.296656 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.296633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-chpkl" event={"ID":"21c24bd4-1090-4741-969c-277d4cf273db","Type":"ContainerStarted","Data":"8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4"}
Jul 23 11:22:23.296757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.296689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:23.360540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.360446    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c46c6f85-2t7rv" podStartSLOduration=0.818301632 podStartE2EDuration="3.360431373s" totalImagesPullingTime="2.542129741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:22:23.357373509 +0000 UTC m=+734.484236932" watchObservedRunningTime="2026-07-23 11:22:23.360431373 +0000 UTC m=+734.487294838"
Jul 23 11:22:23.394558 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:23.394527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:34.304419 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.304389    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:22:34.304895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.304863    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:34.327209 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.327161    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7646859554-chpkl" podStartSLOduration=11.937175539 podStartE2EDuration="14.327147434s" totalImagesPullingTime="2.389971895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:22:23.406129804 +0000 UTC m=+734.532993227" watchObservedRunningTime="2026-07-23 11:22:34.327147434 +0000 UTC m=+745.454010856"
Jul 23 11:22:34.360256 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.360232    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c46c6f85-2t7rv"]
Jul 23 11:22:34.360440 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.360420    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c46c6f85-2t7rv" podUID="dfb71461-fe4a-4b1e-800f-b0a057c97f37" containerName="manager" containerID="cri-o://d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6" gracePeriod=30
Jul 23 11:22:34.608407 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.608385    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:34.763495 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.763465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99qjr\" (UniqueName: \"kubernetes.io/projected/dfb71461-fe4a-4b1e-800f-b0a057c97f37-kube-api-access-99qjr\") pod \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") "
Jul 23 11:22:34.763694 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.763510    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb71461-fe4a-4b1e-800f-b0a057c97f37-webhook-cert\") pod \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\" (UID: \"dfb71461-fe4a-4b1e-800f-b0a057c97f37\") "
Jul 23 11:22:34.765674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.765641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb71461-fe4a-4b1e-800f-b0a057c97f37-kube-api-access-99qjr" (OuterVolumeSpecName: "kube-api-access-99qjr") pod "dfb71461-fe4a-4b1e-800f-b0a057c97f37" (UID: "dfb71461-fe4a-4b1e-800f-b0a057c97f37"). InnerVolumeSpecName "kube-api-access-99qjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:22:34.765788 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.765726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb71461-fe4a-4b1e-800f-b0a057c97f37-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dfb71461-fe4a-4b1e-800f-b0a057c97f37" (UID: "dfb71461-fe4a-4b1e-800f-b0a057c97f37"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:22:34.864294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.864241    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99qjr\" (UniqueName: \"kubernetes.io/projected/dfb71461-fe4a-4b1e-800f-b0a057c97f37-kube-api-access-99qjr\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:22:34.864294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:34.864263    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb71461-fe4a-4b1e-800f-b0a057c97f37-webhook-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:22:35.358046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.358018    2578 generic.go:356] "Generic (PLEG): container finished" podID="dfb71461-fe4a-4b1e-800f-b0a057c97f37" containerID="d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6" exitCode=0
Jul 23 11:22:35.358387 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.358054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c46c6f85-2t7rv"
Jul 23 11:22:35.358387 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.358056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c46c6f85-2t7rv" event={"ID":"dfb71461-fe4a-4b1e-800f-b0a057c97f37","Type":"ContainerDied","Data":"d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6"}
Jul 23 11:22:35.358387 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.358098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c46c6f85-2t7rv" event={"ID":"dfb71461-fe4a-4b1e-800f-b0a057c97f37","Type":"ContainerDied","Data":"d68c446afcc938b3333ee3f1f98dee672dd653bf05c044e8fba15dc413068b68"}
Jul 23 11:22:35.358387 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.358127    2578 scope.go:117] "RemoveContainer" containerID="d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6"
Jul 23 11:22:35.366323 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.366119    2578 scope.go:117] "RemoveContainer" containerID="d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6"
Jul 23 11:22:35.366419 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:22:35.366396    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6\": container with ID starting with d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6 not found: ID does not exist" containerID="d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6"
Jul 23 11:22:35.366461 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.366428    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6"} err="failed to get container status \"d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6\": rpc error: code = NotFound desc = could not find container \"d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6\": container with ID starting with d10d1f1e004ac35eafe0c3128933f821d54dbd07a9e3e9239ba1f06f46c5afd6 not found: ID does not exist"
Jul 23 11:22:35.376214 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.376186    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c46c6f85-2t7rv"]
Jul 23 11:22:35.379853 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:35.379835    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c46c6f85-2t7rv"]
Jul 23 11:22:37.317540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:37.317512    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb71461-fe4a-4b1e-800f-b0a057c97f37" path="/var/lib/kubelet/pods/dfb71461-fe4a-4b1e-800f-b0a057c97f37/volumes"
Jul 23 11:22:56.048974 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.048922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:56.146745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.146706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:56.779914 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.779869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:56.781446 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.781422    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"]
Jul 23 11:22:56.781862 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.781847    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb71461-fe4a-4b1e-800f-b0a057c97f37" containerName="manager"
Jul 23 11:22:56.781937 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.781864    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb71461-fe4a-4b1e-800f-b0a057c97f37" containerName="manager"
Jul 23 11:22:56.781975 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.781960    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb71461-fe4a-4b1e-800f-b0a057c97f37" containerName="manager"
Jul 23 11:22:56.809927 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.809900    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"]
Jul 23 11:22:56.810024 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.809988    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.812727 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.812698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 11:22:56.812850 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.812730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7gxng\""
Jul 23 11:22:56.835092 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.835071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/631df4bd-e09c-4026-aae8-1759c00dc754-maas-api-tls\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.835195 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.835104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/631df4bd-e09c-4026-aae8-1759c00dc754-openshift-service-ca\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.835195 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.835132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wch\" (UniqueName: \"kubernetes.io/projected/631df4bd-e09c-4026-aae8-1759c00dc754-kube-api-access-v5wch\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.935768 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.935746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wch\" (UniqueName: \"kubernetes.io/projected/631df4bd-e09c-4026-aae8-1759c00dc754-kube-api-access-v5wch\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.935885 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.935834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/631df4bd-e09c-4026-aae8-1759c00dc754-maas-api-tls\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.935885 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.935858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/631df4bd-e09c-4026-aae8-1759c00dc754-openshift-service-ca\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.935991 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:22:56.935972    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 23 11:22:56.936046 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:22:56.936035    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631df4bd-e09c-4026-aae8-1759c00dc754-maas-api-tls podName:631df4bd-e09c-4026-aae8-1759c00dc754 nodeName:}" failed. No retries permitted until 2026-07-23 11:22:57.436018294 +0000 UTC m=+768.562881702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/631df4bd-e09c-4026-aae8-1759c00dc754-maas-api-tls") pod "maas-api-757c9f4cdb-4dzrc" (UID: "631df4bd-e09c-4026-aae8-1759c00dc754") : secret "maas-api-serving-cert" not found
Jul 23 11:22:56.936400 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.936383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/631df4bd-e09c-4026-aae8-1759c00dc754-openshift-service-ca\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:56.947214 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:56.947194    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wch\" (UniqueName: \"kubernetes.io/projected/631df4bd-e09c-4026-aae8-1759c00dc754-kube-api-access-v5wch\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:57.029368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.029339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:57.336805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.336772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:57.440310 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.440274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:22:57.440502 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.440454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/631df4bd-e09c-4026-aae8-1759c00dc754-maas-api-tls\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:57.442877 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.442855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/631df4bd-e09c-4026-aae8-1759c00dc754-maas-api-tls\") pod \"maas-api-757c9f4cdb-4dzrc\" (UID: \"631df4bd-e09c-4026-aae8-1759c00dc754\") " pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:57.462151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.462121    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-vlmnk"]
Jul 23 11:22:57.466230 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.466206    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.467982 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.467960    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"]
Jul 23 11:22:57.468928 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.468907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-f9mzn\""
Jul 23 11:22:57.469098 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.468916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 11:22:57.471701 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.471686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.479166 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.479146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-vlmnk"]
Jul 23 11:22:57.487296 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.487275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"]
Jul 23 11:22:57.541444 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.541418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn9l8\" (UniqueName: \"kubernetes.io/projected/384a55a8-71bb-45ea-8cdb-2bf411630c54-kube-api-access-mn9l8\") pod \"payload-processing-5bf47cd988-vlmnk\" (UID: \"384a55a8-71bb-45ea-8cdb-2bf411630c54\") " pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.541544 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.541467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/384a55a8-71bb-45ea-8cdb-2bf411630c54-plugins-config-volume\") pod \"payload-processing-5bf47cd988-vlmnk\" (UID: \"384a55a8-71bb-45ea-8cdb-2bf411630c54\") " pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.541590 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.541558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zpvv\" (UniqueName: \"kubernetes.io/projected/12ddfbaa-a3fa-4e64-98f7-3c03350b4465-kube-api-access-7zpvv\") pod \"payload-pre-processing-7677b774bb-ktq2x\" (UID: \"12ddfbaa-a3fa-4e64-98f7-3c03350b4465\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.541655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.541592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ddfbaa-a3fa-4e64-98f7-3c03350b4465-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-ktq2x\" (UID: \"12ddfbaa-a3fa-4e64-98f7-3c03350b4465\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.643069 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.642993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/384a55a8-71bb-45ea-8cdb-2bf411630c54-plugins-config-volume\") pod \"payload-processing-5bf47cd988-vlmnk\" (UID: \"384a55a8-71bb-45ea-8cdb-2bf411630c54\") " pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.643190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.643093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zpvv\" (UniqueName: \"kubernetes.io/projected/12ddfbaa-a3fa-4e64-98f7-3c03350b4465-kube-api-access-7zpvv\") pod \"payload-pre-processing-7677b774bb-ktq2x\" (UID: \"12ddfbaa-a3fa-4e64-98f7-3c03350b4465\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.643190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.643126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ddfbaa-a3fa-4e64-98f7-3c03350b4465-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-ktq2x\" (UID: \"12ddfbaa-a3fa-4e64-98f7-3c03350b4465\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.643262 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.643193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9l8\" (UniqueName: \"kubernetes.io/projected/384a55a8-71bb-45ea-8cdb-2bf411630c54-kube-api-access-mn9l8\") pod \"payload-processing-5bf47cd988-vlmnk\" (UID: \"384a55a8-71bb-45ea-8cdb-2bf411630c54\") " pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.643745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.643727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/384a55a8-71bb-45ea-8cdb-2bf411630c54-plugins-config-volume\") pod \"payload-processing-5bf47cd988-vlmnk\" (UID: \"384a55a8-71bb-45ea-8cdb-2bf411630c54\") " pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.644193 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.644175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ddfbaa-a3fa-4e64-98f7-3c03350b4465-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-ktq2x\" (UID: \"12ddfbaa-a3fa-4e64-98f7-3c03350b4465\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.654385 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.654363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn9l8\" (UniqueName: \"kubernetes.io/projected/384a55a8-71bb-45ea-8cdb-2bf411630c54-kube-api-access-mn9l8\") pod \"payload-processing-5bf47cd988-vlmnk\" (UID: \"384a55a8-71bb-45ea-8cdb-2bf411630c54\") " pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.657919 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.657896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zpvv\" (UniqueName: \"kubernetes.io/projected/12ddfbaa-a3fa-4e64-98f7-3c03350b4465-kube-api-access-7zpvv\") pod \"payload-pre-processing-7677b774bb-ktq2x\" (UID: \"12ddfbaa-a3fa-4e64-98f7-3c03350b4465\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.720500 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.720475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:22:57.779648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.779597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:22:57.787001 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.786829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:22:57.878805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.878778    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"]
Jul 23 11:22:57.879339 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:22:57.879316    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631df4bd_e09c_4026_aae8_1759c00dc754.slice/crio-7117e69665666fb728c9799b829637ac11cff0100c80a3dcae325010b1023a91 WatchSource:0}: Error finding container 7117e69665666fb728c9799b829637ac11cff0100c80a3dcae325010b1023a91: Status 404 returned error can't find the container with id 7117e69665666fb728c9799b829637ac11cff0100c80a3dcae325010b1023a91
Jul 23 11:22:57.939107 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.939078    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"]
Jul 23 11:22:57.939370 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:22:57.939342    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ddfbaa_a3fa_4e64_98f7_3c03350b4465.slice/crio-678d9c3ec97d2bb881aaec4e9cbbe4944c82c77ba3753d97f85fe5fead396034 WatchSource:0}: Error finding container 678d9c3ec97d2bb881aaec4e9cbbe4944c82c77ba3753d97f85fe5fead396034: Status 404 returned error can't find the container with id 678d9c3ec97d2bb881aaec4e9cbbe4944c82c77ba3753d97f85fe5fead396034
Jul 23 11:22:57.968041 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:57.968012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-vlmnk"]
Jul 23 11:22:57.969921 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:22:57.969896    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384a55a8_71bb_45ea_8cdb_2bf411630c54.slice/crio-733a6dafec5a8a06b326c84e5bed053be75930f73f06f92361cd989137be776a WatchSource:0}: Error finding container 733a6dafec5a8a06b326c84e5bed053be75930f73f06f92361cd989137be776a: Status 404 returned error can't find the container with id 733a6dafec5a8a06b326c84e5bed053be75930f73f06f92361cd989137be776a
Jul 23 11:22:58.476488 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:58.475861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x" event={"ID":"12ddfbaa-a3fa-4e64-98f7-3c03350b4465","Type":"ContainerStarted","Data":"678d9c3ec97d2bb881aaec4e9cbbe4944c82c77ba3753d97f85fe5fead396034"}
Jul 23 11:22:58.477476 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:58.477449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk" event={"ID":"384a55a8-71bb-45ea-8cdb-2bf411630c54","Type":"ContainerStarted","Data":"733a6dafec5a8a06b326c84e5bed053be75930f73f06f92361cd989137be776a"}
Jul 23 11:22:58.478758 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:22:58.478735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc" event={"ID":"631df4bd-e09c-4026-aae8-1759c00dc754","Type":"ContainerStarted","Data":"7117e69665666fb728c9799b829637ac11cff0100c80a3dcae325010b1023a91"}
Jul 23 11:23:01.499337 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:01.499308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc" event={"ID":"631df4bd-e09c-4026-aae8-1759c00dc754","Type":"ContainerStarted","Data":"08c3d289c5a8854744ac2ee59d44350ff72d1fa2ad0d5608112a035a117bd737"}
Jul 23 11:23:01.499763 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:01.499412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:23:01.520079 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:01.520039    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc" podStartSLOduration=2.06830946 podStartE2EDuration="5.520024932s" totalImagesPullingTime="3.451715472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:01.518897648 +0000 UTC m=+772.645761072" watchObservedRunningTime="2026-07-23 11:23:01.520024932 +0000 UTC m=+772.646888411"
Jul 23 11:23:02.506100 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:02.506068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x" event={"ID":"12ddfbaa-a3fa-4e64-98f7-3c03350b4465","Type":"ContainerStarted","Data":"c9a1f3e32384f3abbdcedce34af86c66813feeddb741280f3cae5f1512f2f021"}
Jul 23 11:23:02.506556 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:02.506246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:23:02.507838 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:02.507811    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk" event={"ID":"384a55a8-71bb-45ea-8cdb-2bf411630c54","Type":"ContainerStarted","Data":"ce3d4b9122fee5bfb799388be565bdb24be7fbc643d4213076bd23c0483cfe07"}
Jul 23 11:23:02.507974 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:02.507861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:23:02.531111 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:02.531061    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x" podStartSLOduration=2.045955719 podStartE2EDuration="5.531047257s" totalImagesPullingTime="3.485091538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:02.53084387 +0000 UTC m=+773.657707294" watchObservedRunningTime="2026-07-23 11:23:02.531047257 +0000 UTC m=+773.657910680"
Jul 23 11:23:02.560037 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:02.559987    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk" podStartSLOduration=2.115971257 podStartE2EDuration="5.559968467s" totalImagesPullingTime="3.44399721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:02.559332261 +0000 UTC m=+773.686195685" watchObservedRunningTime="2026-07-23 11:23:02.559968467 +0000 UTC m=+773.686831893"
Jul 23 11:23:05.524852 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:05.524824    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fdaa0c4-6022-495d-b08f-4c5c6e509ebd" containerID="108a9d472b3da486777d383412c482a8123d4ddc1ca3497bd5d6a4399487c4d6" exitCode=0
Jul 23 11:23:05.525255 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:05.524891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" event={"ID":"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd","Type":"ContainerDied","Data":"108a9d472b3da486777d383412c482a8123d4ddc1ca3497bd5d6a4399487c4d6"}
Jul 23 11:23:05.525255 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:05.525245    2578 scope.go:117] "RemoveContainer" containerID="108a9d472b3da486777d383412c482a8123d4ddc1ca3497bd5d6a4399487c4d6"
Jul 23 11:23:05.526223 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:05.526197    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:23:05.526288 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:05.526270    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:23:05.526340 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:05.526330    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:23:06.531961 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:06.531934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" event={"ID":"5fdaa0c4-6022-495d-b08f-4c5c6e509ebd","Type":"ContainerStarted","Data":"56cf8b6e8bc3443fcaab9c56658fa47e0eb832257e509249f5f27af8ffed6e44"}
Jul 23 11:23:06.851249 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:06.851094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:23:06.853383 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:06.853352    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wxwvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 11:23:06.853545 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:06.853420    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" podUID="5fdaa0c4-6022-495d-b08f-4c5c6e509ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 11:23:07.513501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:07.513474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-757c9f4cdb-4dzrc"
Jul 23 11:23:07.851995 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:07.851494    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wxwvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 11:23:07.851995 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:07.851554    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" podUID="5fdaa0c4-6022-495d-b08f-4c5c6e509ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 11:23:08.036729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:08.036698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:23:08.489725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:08.489688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:08.590014 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:08.589979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:08.852561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:08.852118    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wxwvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 11:23:08.852561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:08.852185    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" podUID="5fdaa0c4-6022-495d-b08f-4c5c6e509ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 11:23:09.851840 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:09.851794    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wxwvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 11:23:09.852015 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:09.851868    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf" podUID="5fdaa0c4-6022-495d-b08f-4c5c6e509ebd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 11:23:10.856813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:10.856784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:23:10.858647 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:10.858595    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wxwvf"
Jul 23 11:23:13.515245 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.515220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-ktq2x"
Jul 23 11:23:13.515632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.515275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-vlmnk"
Jul 23 11:23:13.708123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.708097    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"]
Jul 23 11:23:13.712866 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.712850    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.715793 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.715763    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 11:23:13.715913 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.715854    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9687v\""
Jul 23 11:23:13.715969 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.715910    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 11:23:13.716008 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.715987    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 11:23:13.720496 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.720478    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"]
Jul 23 11:23:13.727599 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.727573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:13.816151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.816078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.816151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.816119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.816326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.816163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.816326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.816200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.816326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.816234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59d0fff7-646b-4e00-9789-f678e35d77f6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.816326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.816299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6g7g\" (UniqueName: \"kubernetes.io/projected/59d0fff7-646b-4e00-9789-f678e35d77f6-kube-api-access-s6g7g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917514 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59d0fff7-646b-4e00-9789-f678e35d77f6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6g7g\" (UniqueName: \"kubernetes.io/projected/59d0fff7-646b-4e00-9789-f678e35d77f6-kube-api-access-s6g7g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917939 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.917939 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.918040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.917947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.918040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.918002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.919832 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.919811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59d0fff7-646b-4e00-9789-f678e35d77f6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.919995 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.919980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59d0fff7-646b-4e00-9789-f678e35d77f6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:13.927082 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:13.927060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6g7g\" (UniqueName: \"kubernetes.io/projected/59d0fff7-646b-4e00-9789-f678e35d77f6-kube-api-access-s6g7g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5\" (UID: \"59d0fff7-646b-4e00-9789-f678e35d77f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:14.024193 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:14.024167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:14.155205 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:14.155182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"]
Jul 23 11:23:14.157923 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:23:14.157872    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d0fff7_646b_4e00_9789_f678e35d77f6.slice/crio-7e53ec4e0fd8116ddadce3037cd52731fcfb7e4c94ab48eefac26ee3b5fbc8d2 WatchSource:0}: Error finding container 7e53ec4e0fd8116ddadce3037cd52731fcfb7e4c94ab48eefac26ee3b5fbc8d2: Status 404 returned error can't find the container with id 7e53ec4e0fd8116ddadce3037cd52731fcfb7e4c94ab48eefac26ee3b5fbc8d2
Jul 23 11:23:14.579950 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:14.579908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5" event={"ID":"59d0fff7-646b-4e00-9789-f678e35d77f6","Type":"ContainerStarted","Data":"7e53ec4e0fd8116ddadce3037cd52731fcfb7e4c94ab48eefac26ee3b5fbc8d2"}
Jul 23 11:23:15.586931 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:15.586902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5" event={"ID":"59d0fff7-646b-4e00-9789-f678e35d77f6","Type":"ContainerStarted","Data":"3c9d2266f7a87979a2f525ea8b05cf8b9c5a9efea33259b9525156e68622decb"}
Jul 23 11:23:15.606889 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:15.606835    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5" podStartSLOduration=1.3629062140000001 podStartE2EDuration="2.60681628s" totalImagesPullingTime="1.243910066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:15.606730271 +0000 UTC m=+786.733593716" watchObservedRunningTime="2026-07-23 11:23:15.60681628 +0000 UTC m=+786.733679705"
Jul 23 11:23:24.024585 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:24.024552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:24.024972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:24.024621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:24.036907 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:24.036888    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:24.640586 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:24.640558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5"
Jul 23 11:23:26.296273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:26.296227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:39.514924 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:39.514838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:41.719231 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:41.719186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:52.313368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.313336    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"]
Jul 23 11:23:52.321376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.321356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.325639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.325582    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 11:23:52.328973 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.328949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"]
Jul 23 11:23:52.394493 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.394448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:52.433148 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.433096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.433298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.433153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/619dc8db-7c02-4339-9856-61670ccf3936-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.433298 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.433236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xssbs\" (UniqueName: \"kubernetes.io/projected/619dc8db-7c02-4339-9856-61670ccf3936-kube-api-access-xssbs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.433386 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.433296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.433386 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.433365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.433492 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.433430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.534933 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.534902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.534954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.534975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/619dc8db-7c02-4339-9856-61670ccf3936-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.534996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xssbs\" (UniqueName: \"kubernetes.io/projected/619dc8db-7c02-4339-9856-61670ccf3936-kube-api-access-xssbs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.535023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535123 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.535083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.535312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535447 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.535419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.535484 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.535452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.537300 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.537271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/619dc8db-7c02-4339-9856-61670ccf3936-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.537424 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.537409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/619dc8db-7c02-4339-9856-61670ccf3936-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.544154 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.544133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xssbs\" (UniqueName: \"kubernetes.io/projected/619dc8db-7c02-4339-9856-61670ccf3936-kube-api-access-xssbs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h\" (UID: \"619dc8db-7c02-4339-9856-61670ccf3936\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.634527 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.634441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:23:52.775991 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.775960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"]
Jul 23 11:23:52.777517 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:23:52.777494    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619dc8db_7c02_4339_9856_61670ccf3936.slice/crio-8baac282eb43c9d360c6f4b173d9aba6982d6f048ad01c24bb386a2560dc0692 WatchSource:0}: Error finding container 8baac282eb43c9d360c6f4b173d9aba6982d6f048ad01c24bb386a2560dc0692: Status 404 returned error can't find the container with id 8baac282eb43c9d360c6f4b173d9aba6982d6f048ad01c24bb386a2560dc0692
Jul 23 11:23:52.779169 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:52.779153    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:23:53.775007 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:53.774976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h" event={"ID":"619dc8db-7c02-4339-9856-61670ccf3936","Type":"ContainerStarted","Data":"28b2547697afada91ed9917ff5e9375db75ced55a8ac5d5df40b5daf9a766531"}
Jul 23 11:23:53.775358 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:53.775029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h" event={"ID":"619dc8db-7c02-4339-9856-61670ccf3936","Type":"ContainerStarted","Data":"8baac282eb43c9d360c6f4b173d9aba6982d6f048ad01c24bb386a2560dc0692"}
Jul 23 11:23:53.795502 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:53.795456    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h" podStartSLOduration=1.612494214 podStartE2EDuration="1.795441601s" totalImagesPullingTime="182.947387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:53.793856147 +0000 UTC m=+824.920719619" watchObservedRunningTime="2026-07-23 11:23:53.795441601 +0000 UTC m=+824.922305045"
Jul 23 11:23:57.820389 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.820338    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"]
Jul 23 11:23:57.831457 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.831423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"]
Jul 23 11:23:57.831632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.831551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.834501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.834479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 11:23:57.839455 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.839427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:23:57.876476 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.876451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.876575 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.876481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.876575 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.876540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2glm7\" (UniqueName: \"kubernetes.io/projected/89760988-fb0e-4312-8f16-fe62fdd95ded-kube-api-access-2glm7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.876696 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.876587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.876696 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.876624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89760988-fb0e-4312-8f16-fe62fdd95ded-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.876696 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.876641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.977643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.977585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.977770 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.977736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2glm7\" (UniqueName: \"kubernetes.io/projected/89760988-fb0e-4312-8f16-fe62fdd95ded-kube-api-access-2glm7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.977848 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.977830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.977903 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.977880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89760988-fb0e-4312-8f16-fe62fdd95ded-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.977963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.977906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.977963 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.977937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.978038 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.978003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.978322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.978292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.978536 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.978501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.980377 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.980350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89760988-fb0e-4312-8f16-fe62fdd95ded-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.980484 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.980453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89760988-fb0e-4312-8f16-fe62fdd95ded-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:57.992466 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:57.992443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2glm7\" (UniqueName: \"kubernetes.io/projected/89760988-fb0e-4312-8f16-fe62fdd95ded-kube-api-access-2glm7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvvpm\" (UID: \"89760988-fb0e-4312-8f16-fe62fdd95ded\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:58.144664 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:58.144588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:23:58.283126 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:58.283100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"]
Jul 23 11:23:58.284201 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:23:58.284176    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89760988_fb0e_4312_8f16_fe62fdd95ded.slice/crio-73b6117abd2be001c394dcace7f4a6a9bf513d4e6fabfcbe29da14e32bed5a2c WatchSource:0}: Error finding container 73b6117abd2be001c394dcace7f4a6a9bf513d4e6fabfcbe29da14e32bed5a2c: Status 404 returned error can't find the container with id 73b6117abd2be001c394dcace7f4a6a9bf513d4e6fabfcbe29da14e32bed5a2c
Jul 23 11:23:58.825371 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:58.825341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm" event={"ID":"89760988-fb0e-4312-8f16-fe62fdd95ded","Type":"ContainerStarted","Data":"aa963375d6f4e6df8f517de45cbd10e4695eeb8ddb8aa367965b152a92a29556"}
Jul 23 11:23:58.825730 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:58.825391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm" event={"ID":"89760988-fb0e-4312-8f16-fe62fdd95ded","Type":"ContainerStarted","Data":"73b6117abd2be001c394dcace7f4a6a9bf513d4e6fabfcbe29da14e32bed5a2c"}
Jul 23 11:23:58.846676 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:23:58.846630    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm" podStartSLOduration=1.637869792 podStartE2EDuration="1.846595932s" totalImagesPullingTime="208.72614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:23:58.843813266 +0000 UTC m=+829.970676724" watchObservedRunningTime="2026-07-23 11:23:58.846595932 +0000 UTC m=+829.973459354"
Jul 23 11:24:01.725157 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:01.725104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:24:02.634689 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:02.634661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:24:02.634870 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:02.634718    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:24:02.647242 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:02.647216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:24:02.856190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:02.856160    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h"
Jul 23 11:24:08.145384 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:08.145344    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:24:08.145867 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:08.145403    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:24:08.157793 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:08.157769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:24:08.885918 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:08.885886    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvvpm"
Jul 23 11:24:55.770283 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:24:55.770243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:09.273347 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:09.273314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:25:09.274258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:09.274237    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:25:11.797132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:11.797089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:18.128881 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:18.128847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:18.217244 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:18.217195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:19.239034 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:19.238987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:19.337345 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:19.337314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:24.644339 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:24.644313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:25:42.758364 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:25:42.758334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:26:04.383805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.383769    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646859554-chpkl"]
Jul 23 11:26:04.384368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.384013    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7646859554-chpkl" podUID="21c24bd4-1090-4741-969c-277d4cf273db" containerName="manager" containerID="cri-o://8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4" gracePeriod=30
Jul 23 11:26:04.631745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.631720    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:26:04.724151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.724064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c24bd4-1090-4741-969c-277d4cf273db-webhook-cert\") pod \"21c24bd4-1090-4741-969c-277d4cf273db\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") "
Jul 23 11:26:04.724300 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.724174    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k8ds\" (UniqueName: \"kubernetes.io/projected/21c24bd4-1090-4741-969c-277d4cf273db-kube-api-access-2k8ds\") pod \"21c24bd4-1090-4741-969c-277d4cf273db\" (UID: \"21c24bd4-1090-4741-969c-277d4cf273db\") "
Jul 23 11:26:04.726086 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.726059    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c24bd4-1090-4741-969c-277d4cf273db-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "21c24bd4-1090-4741-969c-277d4cf273db" (UID: "21c24bd4-1090-4741-969c-277d4cf273db"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:26:04.726193 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.726102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c24bd4-1090-4741-969c-277d4cf273db-kube-api-access-2k8ds" (OuterVolumeSpecName: "kube-api-access-2k8ds") pod "21c24bd4-1090-4741-969c-277d4cf273db" (UID: "21c24bd4-1090-4741-969c-277d4cf273db"). InnerVolumeSpecName "kube-api-access-2k8ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:26:04.825409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.825355    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c24bd4-1090-4741-969c-277d4cf273db-webhook-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:26:04.825409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:04.825401    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k8ds\" (UniqueName: \"kubernetes.io/projected/21c24bd4-1090-4741-969c-277d4cf273db-kube-api-access-2k8ds\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:26:05.470121 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.470080    2578 generic.go:356] "Generic (PLEG): container finished" podID="21c24bd4-1090-4741-969c-277d4cf273db" containerID="8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4" exitCode=0
Jul 23 11:26:05.470534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.470130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-chpkl" event={"ID":"21c24bd4-1090-4741-969c-277d4cf273db","Type":"ContainerDied","Data":"8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4"}
Jul 23 11:26:05.470534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.470138    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-chpkl"
Jul 23 11:26:05.470534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.470206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-chpkl" event={"ID":"21c24bd4-1090-4741-969c-277d4cf273db","Type":"ContainerDied","Data":"cb858630a9110107badec32ac5a6aabb2b5fbb7aefbd86410453eef98f60032b"}
Jul 23 11:26:05.470534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.470230    2578 scope.go:117] "RemoveContainer" containerID="8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4"
Jul 23 11:26:05.479071 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.479052    2578 scope.go:117] "RemoveContainer" containerID="8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4"
Jul 23 11:26:05.479346 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:26:05.479327    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4\": container with ID starting with 8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4 not found: ID does not exist" containerID="8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4"
Jul 23 11:26:05.479410 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.479358    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4"} err="failed to get container status \"8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4\": rpc error: code = NotFound desc = could not find container \"8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4\": container with ID starting with 8c7ba0caf1d1d73b2e382362b1a0b4984f985b23776b12e9e96fcff6fb7c65b4 not found: ID does not exist"
Jul 23 11:26:05.489111 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.489077    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646859554-chpkl"]
Jul 23 11:26:05.492641 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:05.492620    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7646859554-chpkl"]
Jul 23 11:26:07.318876 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:26:07.318837    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c24bd4-1090-4741-969c-277d4cf273db" path="/var/lib/kubelet/pods/21c24bd4-1090-4741-969c-277d4cf273db/volumes"
Jul 23 11:27:06.263934 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.263890    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7646859554-8pfkd"]
Jul 23 11:27:06.264450 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.264346    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c24bd4-1090-4741-969c-277d4cf273db" containerName="manager"
Jul 23 11:27:06.264450 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.264358    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c24bd4-1090-4741-969c-277d4cf273db" containerName="manager"
Jul 23 11:27:06.264450 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.264436    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c24bd4-1090-4741-969c-277d4cf273db" containerName="manager"
Jul 23 11:27:06.267670 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.267646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.271690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.271660    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 11:27:06.271690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.271681    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 11:27:06.271931 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.271660    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s4s79\""
Jul 23 11:27:06.287598 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.287554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646859554-8pfkd"]
Jul 23 11:27:06.369984 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.369937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-webhook-cert\") pod \"maas-controller-7646859554-8pfkd\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") " pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.370183 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.370017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4x6n\" (UniqueName: \"kubernetes.io/projected/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-kube-api-access-s4x6n\") pod \"maas-controller-7646859554-8pfkd\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") " pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.471008 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.470972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4x6n\" (UniqueName: \"kubernetes.io/projected/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-kube-api-access-s4x6n\") pod \"maas-controller-7646859554-8pfkd\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") " pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.471175 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.471127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-webhook-cert\") pod \"maas-controller-7646859554-8pfkd\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") " pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.473527 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.473502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-webhook-cert\") pod \"maas-controller-7646859554-8pfkd\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") " pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.480084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.480051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4x6n\" (UniqueName: \"kubernetes.io/projected/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-kube-api-access-s4x6n\") pod \"maas-controller-7646859554-8pfkd\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") " pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.583160 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.583048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:06.732084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.732054    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646859554-8pfkd"]
Jul 23 11:27:06.734422 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:27:06.734387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b482e6_9fe8_4cdc_9f2f_3d9262ba43f4.slice/crio-6e8ed859bcbeeae4dbc476cbccc3241d61d56f5591cc02c98a5dce2b566c18c8 WatchSource:0}: Error finding container 6e8ed859bcbeeae4dbc476cbccc3241d61d56f5591cc02c98a5dce2b566c18c8: Status 404 returned error can't find the container with id 6e8ed859bcbeeae4dbc476cbccc3241d61d56f5591cc02c98a5dce2b566c18c8
Jul 23 11:27:06.800913 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:06.800873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-8pfkd" event={"ID":"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4","Type":"ContainerStarted","Data":"6e8ed859bcbeeae4dbc476cbccc3241d61d56f5591cc02c98a5dce2b566c18c8"}
Jul 23 11:27:07.807802 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:07.807763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-8pfkd" event={"ID":"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4","Type":"ContainerStarted","Data":"9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab"}
Jul 23 11:27:07.808188 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:07.807833    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:07.828721 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:07.828669    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7646859554-8pfkd" podStartSLOduration=1.453991115 podStartE2EDuration="1.828651383s" totalImagesPullingTime="374.660268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:27:07.827101008 +0000 UTC m=+1018.953964464" watchObservedRunningTime="2026-07-23 11:27:07.828651383 +0000 UTC m=+1018.955514807"
Jul 23 11:27:18.816465 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:18.816431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:23.764473 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:23.764441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:27:24.042194 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.042112    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646859554-8pfkd"]
Jul 23 11:27:24.042353 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.042325    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7646859554-8pfkd" podUID="c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" containerName="manager" containerID="cri-o://9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab" gracePeriod=30
Jul 23 11:27:24.289539 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.289513    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:24.441031 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.440894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4x6n\" (UniqueName: \"kubernetes.io/projected/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-kube-api-access-s4x6n\") pod \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") "
Jul 23 11:27:24.441178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.441077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-webhook-cert\") pod \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\" (UID: \"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4\") "
Jul 23 11:27:24.442932 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.442905    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-kube-api-access-s4x6n" (OuterVolumeSpecName: "kube-api-access-s4x6n") pod "c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" (UID: "c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4"). InnerVolumeSpecName "kube-api-access-s4x6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:27:24.443043 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.442991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" (UID: "c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:27:24.542801 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.542776    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-webhook-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:27:24.542801 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.542800    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4x6n\" (UniqueName: \"kubernetes.io/projected/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4-kube-api-access-s4x6n\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:27:24.903836 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.903803    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" containerID="9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab" exitCode=0
Jul 23 11:27:24.904258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.903847    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-8pfkd"
Jul 23 11:27:24.904258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.903882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-8pfkd" event={"ID":"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4","Type":"ContainerDied","Data":"9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab"}
Jul 23 11:27:24.904258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.903926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-8pfkd" event={"ID":"c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4","Type":"ContainerDied","Data":"6e8ed859bcbeeae4dbc476cbccc3241d61d56f5591cc02c98a5dce2b566c18c8"}
Jul 23 11:27:24.904258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.903946    2578 scope.go:117] "RemoveContainer" containerID="9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab"
Jul 23 11:27:24.913466 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.913447    2578 scope.go:117] "RemoveContainer" containerID="9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab"
Jul 23 11:27:24.913793 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:27:24.913773    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab\": container with ID starting with 9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab not found: ID does not exist" containerID="9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab"
Jul 23 11:27:24.913865 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.913806    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab"} err="failed to get container status \"9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab\": rpc error: code = NotFound desc = could not find container \"9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab\": container with ID starting with 9903b999ad6044a835107670cd63dbca0934d721762c4c77aec64fd2d5f898ab not found: ID does not exist"
Jul 23 11:27:24.927250 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.927221    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646859554-8pfkd"]
Jul 23 11:27:24.932790 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:24.932759    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7646859554-8pfkd"]
Jul 23 11:27:25.318545 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.318514    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" path="/var/lib/kubelet/pods/c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4/volumes"
Jul 23 11:27:25.674302 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.674213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:27:25.789176 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.789140    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7646859554-krtn2"]
Jul 23 11:27:25.789598 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.789586    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" containerName="manager"
Jul 23 11:27:25.789679 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.789599    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" containerName="manager"
Jul 23 11:27:25.789723 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.789687    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b482e6-9fe8-4cdc-9f2f-3d9262ba43f4" containerName="manager"
Jul 23 11:27:25.794284 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.794261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:25.798741 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.798701    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 11:27:25.798741 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.798739    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s4s79\""
Jul 23 11:27:25.798978 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.798748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 11:27:25.802574 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.802306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646859554-krtn2"]
Jul 23 11:27:25.957149 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.957053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw52t\" (UniqueName: \"kubernetes.io/projected/671dcff5-909c-456d-a073-472c150e9525-kube-api-access-sw52t\") pod \"maas-controller-7646859554-krtn2\" (UID: \"671dcff5-909c-456d-a073-472c150e9525\") " pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:25.957522 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:25.957180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671dcff5-909c-456d-a073-472c150e9525-webhook-cert\") pod \"maas-controller-7646859554-krtn2\" (UID: \"671dcff5-909c-456d-a073-472c150e9525\") " pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.057921 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.057879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw52t\" (UniqueName: \"kubernetes.io/projected/671dcff5-909c-456d-a073-472c150e9525-kube-api-access-sw52t\") pod \"maas-controller-7646859554-krtn2\" (UID: \"671dcff5-909c-456d-a073-472c150e9525\") " pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.058113 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.057964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671dcff5-909c-456d-a073-472c150e9525-webhook-cert\") pod \"maas-controller-7646859554-krtn2\" (UID: \"671dcff5-909c-456d-a073-472c150e9525\") " pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.060366 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.060338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671dcff5-909c-456d-a073-472c150e9525-webhook-cert\") pod \"maas-controller-7646859554-krtn2\" (UID: \"671dcff5-909c-456d-a073-472c150e9525\") " pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.068168 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.068147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw52t\" (UniqueName: \"kubernetes.io/projected/671dcff5-909c-456d-a073-472c150e9525-kube-api-access-sw52t\") pod \"maas-controller-7646859554-krtn2\" (UID: \"671dcff5-909c-456d-a073-472c150e9525\") " pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.107075 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.107045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.243953 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.243928    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646859554-krtn2"]
Jul 23 11:27:26.245918 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:27:26.245883    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671dcff5_909c_456d_a073_472c150e9525.slice/crio-c11da31b20cb940a23dc8934b1832d1617b443b1343c7ce944d8a4ed2289f1fa WatchSource:0}: Error finding container c11da31b20cb940a23dc8934b1832d1617b443b1343c7ce944d8a4ed2289f1fa: Status 404 returned error can't find the container with id c11da31b20cb940a23dc8934b1832d1617b443b1343c7ce944d8a4ed2289f1fa
Jul 23 11:27:26.917392 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.917308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-krtn2" event={"ID":"671dcff5-909c-456d-a073-472c150e9525","Type":"ContainerStarted","Data":"ca7aa7a287f45cd3322ca4482569fbc760e549c7f36f7452e41f8a42d79427a9"}
Jul 23 11:27:26.917392 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.917363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646859554-krtn2" event={"ID":"671dcff5-909c-456d-a073-472c150e9525","Type":"ContainerStarted","Data":"c11da31b20cb940a23dc8934b1832d1617b443b1343c7ce944d8a4ed2289f1fa"}
Jul 23 11:27:26.917572 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.917431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:27:26.943080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:26.943031    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7646859554-krtn2" podStartSLOduration=1.5670095480000001 podStartE2EDuration="1.943014486s" totalImagesPullingTime="376.004938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:27:26.942408982 +0000 UTC m=+1038.069272407" watchObservedRunningTime="2026-07-23 11:27:26.943014486 +0000 UTC m=+1038.069877910"
Jul 23 11:27:37.924630 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:27:37.924578    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7646859554-krtn2"
Jul 23 11:28:05.926655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:05.926596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:06.024501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:06.024470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:06.132900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:06.132864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:12.045639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:12.045574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:12.145905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:12.145867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:12.247222 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:12.247187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:12.372729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:12.372652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:18.281665 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:18.281629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:28:18.383334 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:28:18.383296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:30:09.305732 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:30:09.305703    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:30:09.308265 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:30:09.308239    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:30:56.040185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:30:56.040140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:32:04.914701 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:32:04.914668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:32:52.747654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:32:52.747551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:35:08.961266 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:08.961236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:35:09.047690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:09.047649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:35:09.336799 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:09.336772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:35:09.345119 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:09.345082    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:35:58.316059 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.316023    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"]
Jul 23 11:35:58.320374 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.320353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.323061 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.323036    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-544926b9-kserve-self-signed-certs\""
Jul 23 11:35:58.333352 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.333323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"]
Jul 23 11:35:58.343772 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.343731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:35:58.367329 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.367294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4xsh\" (UniqueName: \"kubernetes.io/projected/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-kube-api-access-n4xsh\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.367530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.367337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-model-cache\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.367530 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.367480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-home\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.367695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.367565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tls-certs\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.367695 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.367660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-dshm\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.367807 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.367705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tmp-dir\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469092 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tmp-dir\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469276 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xsh\" (UniqueName: \"kubernetes.io/projected/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-kube-api-access-n4xsh\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469276 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-model-cache\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469276 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-home\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469276 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tls-certs\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469434 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-dshm\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469535 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tmp-dir\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469578 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-model-cache\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.469658 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.469581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-home\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.471453 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.471425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-dshm\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.471885 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.471860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tls-certs\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.477681 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.477643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4xsh\" (UniqueName: \"kubernetes.io/projected/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-kube-api-access-n4xsh\") pod \"e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") " pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.629590 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.629497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:35:58.782646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:58.782598    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"]
Jul 23 11:35:58.785837 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:35:58.785806    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47db0ad3_64d6_496c_9e74_b9cbdcfe11ff.slice/crio-896f11fa7260ce2578c02c38cad3a9aa1a088690f4285be74a2f19db6a7f4a80 WatchSource:0}: Error finding container 896f11fa7260ce2578c02c38cad3a9aa1a088690f4285be74a2f19db6a7f4a80: Status 404 returned error can't find the container with id 896f11fa7260ce2578c02c38cad3a9aa1a088690f4285be74a2f19db6a7f4a80
Jul 23 11:35:59.643934 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:59.643894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7" event={"ID":"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff","Type":"ContainerStarted","Data":"10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463"}
Jul 23 11:35:59.644432 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:59.643946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7" event={"ID":"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff","Type":"ContainerStarted","Data":"896f11fa7260ce2578c02c38cad3a9aa1a088690f4285be74a2f19db6a7f4a80"}
Jul 23 11:35:59.662524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:35:59.662471    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7" podStartSLOduration=1.662455827 podStartE2EDuration="1.662455827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:35:59.659602478 +0000 UTC m=+1550.786465903" watchObservedRunningTime="2026-07-23 11:35:59.662455827 +0000 UTC m=+1550.789319308"
Jul 23 11:36:08.630302 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:08.630269    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:36:08.630850 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:08.630827    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:36:08.644914 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:08.644894    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:36:08.704086 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:08.704057    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:36:11.120513 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:11.120474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:36:51.892885 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:51.892847    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"]
Jul 23 11:36:51.914670 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:51.914630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:36:53.305375 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:36:53.305345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:37:06.916263 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:06.916186    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7" podUID="47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" containerName="main" containerID="cri-o://10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463" gracePeriod=45
Jul 23 11:37:07.176462 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.176408    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:37:07.212589 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tmp-dir\") pod \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") "
Jul 23 11:37:07.212710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4xsh\" (UniqueName: \"kubernetes.io/projected/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-kube-api-access-n4xsh\") pod \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") "
Jul 23 11:37:07.212710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212691    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tls-certs\") pod \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") "
Jul 23 11:37:07.212809 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212749    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-home\") pod \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") "
Jul 23 11:37:07.212809 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-model-cache\") pod \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") "
Jul 23 11:37:07.212919 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-dshm\") pod \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\" (UID: \"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff\") "
Jul 23 11:37:07.212919 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.212836    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" (UID: "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:07.213105 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.213066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-home" (OuterVolumeSpecName: "home") pod "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" (UID: "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:07.213215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.213075    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" (UID: "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:07.213273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.213220    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tmp-dir\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:37:07.215172 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.215142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-dshm" (OuterVolumeSpecName: "dshm") pod "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" (UID: "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:37:07.215273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.215200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" (UID: "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 11:37:07.215273 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.215223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-kube-api-access-n4xsh" (OuterVolumeSpecName: "kube-api-access-n4xsh") pod "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" (UID: "47db0ad3-64d6-496c-9e74-b9cbdcfe11ff"). InnerVolumeSpecName "kube-api-access-n4xsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:37:07.313673 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.313654    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4xsh\" (UniqueName: \"kubernetes.io/projected/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-kube-api-access-n4xsh\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:37:07.313770 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.313675    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-tls-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:37:07.313770 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.313684    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-home\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:37:07.313770 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.313693    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-model-cache\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:37:07.313770 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:07.313700    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff-dshm\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:37:08.000822 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.000789    2578 generic.go:356] "Generic (PLEG): container finished" podID="47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" containerID="10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463" exitCode=0
Jul 23 11:37:08.001219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.000833    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"
Jul 23 11:37:08.001219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.000871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7" event={"ID":"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff","Type":"ContainerDied","Data":"10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463"}
Jul 23 11:37:08.001219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.000914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7" event={"ID":"47db0ad3-64d6-496c-9e74-b9cbdcfe11ff","Type":"ContainerDied","Data":"896f11fa7260ce2578c02c38cad3a9aa1a088690f4285be74a2f19db6a7f4a80"}
Jul 23 11:37:08.001219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.000928    2578 scope.go:117] "RemoveContainer" containerID="10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463"
Jul 23 11:37:08.010052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.010026    2578 scope.go:117] "RemoveContainer" containerID="10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463"
Jul 23 11:37:08.010317 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:37:08.010300    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463\": container with ID starting with 10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463 not found: ID does not exist" containerID="10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463"
Jul 23 11:37:08.010361 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.010329    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463"} err="failed to get container status \"10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463\": rpc error: code = NotFound desc = could not find container \"10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463\": container with ID starting with 10e2a5c2d8a7efb530f4768d6b74626ceb7ad95b323d0bd33da7971f1a189463 not found: ID does not exist"
Jul 23 11:37:08.018672 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.018636    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"]
Jul 23 11:37:08.022982 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:08.022957    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-544926b9-kserve-7f6df4f979-k4sc7"]
Jul 23 11:37:09.319251 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:37:09.319219    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" path="/var/lib/kubelet/pods/47db0ad3-64d6-496c-9e74-b9cbdcfe11ff/volumes"
Jul 23 11:39:07.858057 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:39:07.858024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:39:07.973989 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:39:07.973950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:39:20.911645 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:39:20.911584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:03.736772 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:03.736682    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:09.368663 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:09.368629    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:40:09.378243 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:09.378219    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:40:29.197130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:29.197095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:32.055689 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:32.055644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:32.154921 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:32.154884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:32.490511 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:32.490423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:38.313902 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.313871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:38.414028 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.413987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:38.532554 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.532523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:38.832502 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.832473    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"]
Jul 23 11:40:38.832956 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.832943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" containerName="main"
Jul 23 11:40:38.833009 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.832958    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" containerName="main"
Jul 23 11:40:38.833045 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.833023    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="47db0ad3-64d6-496c-9e74-b9cbdcfe11ff" containerName="main"
Jul 23 11:40:38.836184 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.836169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.838938 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.838909    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9729caf1-openshift-default-dockercfg-kbxbv\""
Jul 23 11:40:38.857036 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.857006    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"]
Jul 23 11:40:38.984437 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-certs\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-envoy\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e834267-adce-43cf-891d-0c69a17b9c02-istiod-ca-cert\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-credential-socket\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e834267-adce-43cf-891d-0c69a17b9c02-istio-podinfo\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-istio-token\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-data\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-socket\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:38.984827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:38.984807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqskq\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-kube-api-access-nqskq\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e834267-adce-43cf-891d-0c69a17b9c02-istiod-ca-cert\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-credential-socket\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e834267-adce-43cf-891d-0c69a17b9c02-istio-podinfo\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-istio-token\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-data\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-socket\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqskq\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-kube-api-access-nqskq\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-certs\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.086693 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-envoy\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.087011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-credential-socket\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.087011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-data\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.087011 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.086998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-socket\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.087176 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.087023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-certs\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.087233 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.087210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e834267-adce-43cf-891d-0c69a17b9c02-istiod-ca-cert\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.089045 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.089018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-envoy\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.089158 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.089136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e834267-adce-43cf-891d-0c69a17b9c02-istio-podinfo\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.095735 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.095714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-istio-token\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.095921 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.095904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqskq\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-kube-api-access-nqskq\") pod \"e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") " pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.146690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.146651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:39.287830 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.287803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"]
Jul 23 11:40:39.289493 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:40:39.289463    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e834267_adce_43cf_891d_0c69a17b9c02.slice/crio-18bde36540bca568120b38875493ce93f9a104eb015c70d839d1f6b476a3e6df WatchSource:0}: Error finding container 18bde36540bca568120b38875493ce93f9a104eb015c70d839d1f6b476a3e6df: Status 404 returned error can't find the container with id 18bde36540bca568120b38875493ce93f9a104eb015c70d839d1f6b476a3e6df
Jul 23 11:40:39.291752 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.291713    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:40:39.291829 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.291801    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:40:39.291867 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.291842    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:40:39.619010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.618895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:39.719929 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:39.719899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:40.103577 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:40.103539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" event={"ID":"4e834267-adce-43cf-891d-0c69a17b9c02","Type":"ContainerStarted","Data":"d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"}
Jul 23 11:40:40.103763 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:40.103656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" event={"ID":"4e834267-adce-43cf-891d-0c69a17b9c02","Type":"ContainerStarted","Data":"18bde36540bca568120b38875493ce93f9a104eb015c70d839d1f6b476a3e6df"}
Jul 23 11:40:40.128755 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:40.128706    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" podStartSLOduration=2.128691408 podStartE2EDuration="2.128691408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:40:40.127032299 +0000 UTC m=+1831.253895748" watchObservedRunningTime="2026-07-23 11:40:40.128691408 +0000 UTC m=+1831.255554831"
Jul 23 11:40:40.147647 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:40.147594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:40.152900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:40.152876    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:41.109052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:41.109022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:41.109895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:41.109877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:41.585946 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:41.585862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:41.670665 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:41.670599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:41.745101 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:41.745059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:41.916170 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:41.916077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:42.273040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:42.273002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:42.370444 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:42.370413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:40:53.181042 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:53.180959    2578 generic.go:356] "Generic (PLEG): container finished" podID="4e834267-adce-43cf-891d-0c69a17b9c02" containerID="d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20" exitCode=0
Jul 23 11:40:53.181441 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:53.181035    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" event={"ID":"4e834267-adce-43cf-891d-0c69a17b9c02","Type":"ContainerDied","Data":"d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"}
Jul 23 11:40:53.181441 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:53.181410    2578 scope.go:117] "RemoveContainer" containerID="d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"
Jul 23 11:40:53.182458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:53.182422    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:40:53.182567 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:53.182507    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:40:53.182567 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:53.182545    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:40:54.188005 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:54.187972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" event={"ID":"4e834267-adce-43cf-891d-0c69a17b9c02","Type":"ContainerStarted","Data":"390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4"}
Jul 23 11:40:55.147069 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:55.147034    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:55.148552 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:55.148523    2578 patch_prober.go:28] interesting pod/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 23 11:40:55.148688 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:55.148586    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 23 11:40:56.109677 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:56.109646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:56.147742 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:56.147705    2578 patch_prober.go:28] interesting pod/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 23 11:40:56.148000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:56.147973    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 23 11:40:57.147687 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:57.147651    2578 patch_prober.go:28] interesting pod/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 23 11:40:57.148263 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:57.148232    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 23 11:40:58.147415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:58.147369    2578 patch_prober.go:28] interesting pod/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 23 11:40:58.147648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:58.147451    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 23 11:40:59.151585 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:59.151553    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:40:59.152630 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:40:59.152598    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:41:17.511657 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:17.511588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:22.252193 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.252160    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"]
Jul 23 11:41:22.252590 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.252369    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy" containerID="cri-o://390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4" gracePeriod=30
Jul 23 11:41:22.319972 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.319935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:22.425771 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.425731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:22.526823 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.526789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:22.748166 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.748131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:22.848877 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.848778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:22.956745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:22.956708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:23.312722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:23.312687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:23.763846 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:23.763813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:26.149903 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:26.149867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:26.259810 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:26.259775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:26.360654 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:26.360624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:26.860596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:26.860561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:26.961724 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:26.961691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:41:27.503539 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.503516    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:41:27.591669 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591569    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e834267-adce-43cf-891d-0c69a17b9c02-istiod-ca-cert\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.591669 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-envoy\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.591908 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591764    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-certs\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.591908 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591857    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqskq\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-kube-api-access-nqskq\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.591908 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-istio-token\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.592132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e834267-adce-43cf-891d-0c69a17b9c02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:41:27.592132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.591954    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-socket\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.592132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592001    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:41:27.592132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592016    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-credential-socket\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.592132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e834267-adce-43cf-891d-0c69a17b9c02-istio-podinfo\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.592132 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592091    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-data\") pod \"4e834267-adce-43cf-891d-0c69a17b9c02\" (UID: \"4e834267-adce-43cf-891d-0c69a17b9c02\") "
Jul 23 11:41:27.592424 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592215    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:41:27.592424 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:41:27.592550 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592532    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.592632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592556    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-workload-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.592632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592570    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-credential-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.592632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.592585    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e834267-adce-43cf-891d-0c69a17b9c02-istiod-ca-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.593124 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.593100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:41:27.594058 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.594026    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:41:27.594240 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.594218    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-kube-api-access-nqskq" (OuterVolumeSpecName: "kube-api-access-nqskq") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "kube-api-access-nqskq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:41:27.594316 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.594224    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:41:27.594316 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.594246    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e834267-adce-43cf-891d-0c69a17b9c02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e834267-adce-43cf-891d-0c69a17b9c02" (UID: "4e834267-adce-43cf-891d-0c69a17b9c02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 11:41:27.693130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.693088    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-envoy\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.693130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.693124    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqskq\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-kube-api-access-nqskq\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.693130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.693137    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e834267-adce-43cf-891d-0c69a17b9c02-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.693378 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.693149    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e834267-adce-43cf-891d-0c69a17b9c02-istio-podinfo\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:27.693378 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:27.693160    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e834267-adce-43cf-891d-0c69a17b9c02-istio-data\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:28.367226 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.367188    2578 generic.go:356] "Generic (PLEG): container finished" podID="4e834267-adce-43cf-891d-0c69a17b9c02" containerID="390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4" exitCode=0
Jul 23 11:41:28.367393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.367244    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"
Jul 23 11:41:28.367393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.367283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" event={"ID":"4e834267-adce-43cf-891d-0c69a17b9c02","Type":"ContainerDied","Data":"390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4"}
Jul 23 11:41:28.367393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.367338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl" event={"ID":"4e834267-adce-43cf-891d-0c69a17b9c02","Type":"ContainerDied","Data":"18bde36540bca568120b38875493ce93f9a104eb015c70d839d1f6b476a3e6df"}
Jul 23 11:41:28.367393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.367364    2578 scope.go:117] "RemoveContainer" containerID="390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4"
Jul 23 11:41:28.380699 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.380509    2578 scope.go:117] "RemoveContainer" containerID="d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"
Jul 23 11:41:28.389089 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.389069    2578 scope.go:117] "RemoveContainer" containerID="390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4"
Jul 23 11:41:28.389392 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:41:28.389371    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4\": container with ID starting with 390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4 not found: ID does not exist" containerID="390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4"
Jul 23 11:41:28.389462 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.389400    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4"} err="failed to get container status \"390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4\": rpc error: code = NotFound desc = could not find container \"390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4\": container with ID starting with 390c8821ea9d50d5c1370d7bb454be4604a94378d0c9043b16b665f7310981d4 not found: ID does not exist"
Jul 23 11:41:28.389462 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.389418    2578 scope.go:117] "RemoveContainer" containerID="d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"
Jul 23 11:41:28.389679 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:41:28.389655    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20\": container with ID starting with d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20 not found: ID does not exist" containerID="d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"
Jul 23 11:41:28.389738 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.389684    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20"} err="failed to get container status \"d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20\": rpc error: code = NotFound desc = could not find container \"d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20\": container with ID starting with d6310870393f07117c38093b381b0cfa2df59be2b9c5550dfb081e8010ad3a20 not found: ID does not exist"
Jul 23 11:41:28.390398 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.390378    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"]
Jul 23 11:41:28.393326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:28.393307    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9729caf1-openshift-default-77d759f9b7-b2hzl"]
Jul 23 11:41:29.318350 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:29.318316    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" path="/var/lib/kubelet/pods/4e834267-adce-43cf-891d-0c69a17b9c02/volumes"
Jul 23 11:41:51.145042 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145007    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"]
Jul 23 11:41:51.145694 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145675    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy"
Jul 23 11:41:51.145744 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145698    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy"
Jul 23 11:41:51.145744 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145729    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy"
Jul 23 11:41:51.145744 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145737    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy"
Jul 23 11:41:51.145875 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145864    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy"
Jul 23 11:41:51.145912 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.145880    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e834267-adce-43cf-891d-0c69a17b9c02" containerName="istio-proxy"
Jul 23 11:41:51.149617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.149587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:51.152871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.152843    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:41:51.155274 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.155255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"]
Jul 23 11:41:51.321304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.321273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46d69d18-f51f-428a-8e3c-7c7cbadc6b73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c\" (UID: \"46d69d18-f51f-428a-8e3c-7c7cbadc6b73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:51.422711 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.422587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46d69d18-f51f-428a-8e3c-7c7cbadc6b73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c\" (UID: \"46d69d18-f51f-428a-8e3c-7c7cbadc6b73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:51.424367 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.424331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46d69d18-f51f-428a-8e3c-7c7cbadc6b73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c\" (UID: \"46d69d18-f51f-428a-8e3c-7c7cbadc6b73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:51.462646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.462587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:51.602734 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.602705    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"]
Jul 23 11:41:51.604588 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:41:51.604555    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d69d18_f51f_428a_8e3c_7c7cbadc6b73.slice/crio-389dade59e10a10b682da9d0e430c212591949d209f7bfa11e5767cea19a6d7c WatchSource:0}: Error finding container 389dade59e10a10b682da9d0e430c212591949d209f7bfa11e5767cea19a6d7c: Status 404 returned error can't find the container with id 389dade59e10a10b682da9d0e430c212591949d209f7bfa11e5767cea19a6d7c
Jul 23 11:41:51.606482 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:51.606465    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:41:52.492930 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:52.492894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c" event={"ID":"46d69d18-f51f-428a-8e3c-7c7cbadc6b73","Type":"ContainerStarted","Data":"389dade59e10a10b682da9d0e430c212591949d209f7bfa11e5767cea19a6d7c"}
Jul 23 11:41:54.505836 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:54.505795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c" event={"ID":"46d69d18-f51f-428a-8e3c-7c7cbadc6b73","Type":"ContainerStarted","Data":"56ce6d8600340d90ac5da3bf9341736f2e6a9bdd872e26ebaf5099091079f7f5"}
Jul 23 11:41:54.524889 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:54.524835    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c" podStartSLOduration=1.1678709409999999 podStartE2EDuration="3.524817781s" totalImagesPullingTime="2.35694684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:41:54.523636437 +0000 UTC m=+1905.650499867" watchObservedRunningTime="2026-07-23 11:41:54.524817781 +0000 UTC m=+1905.651681183"
Jul 23 11:41:55.514762 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:55.514727    2578 generic.go:356] "Generic (PLEG): container finished" podID="46d69d18-f51f-428a-8e3c-7c7cbadc6b73" containerID="56ce6d8600340d90ac5da3bf9341736f2e6a9bdd872e26ebaf5099091079f7f5" exitCode=0
Jul 23 11:41:55.515140 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:55.514800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c" event={"ID":"46d69d18-f51f-428a-8e3c-7c7cbadc6b73","Type":"ContainerDied","Data":"56ce6d8600340d90ac5da3bf9341736f2e6a9bdd872e26ebaf5099091079f7f5"}
Jul 23 11:41:56.666834 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:56.666810    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:56.672207 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:56.672187    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46d69d18-f51f-428a-8e3c-7c7cbadc6b73-maas-api-service-ca\") pod \"46d69d18-f51f-428a-8e3c-7c7cbadc6b73\" (UID: \"46d69d18-f51f-428a-8e3c-7c7cbadc6b73\") "
Jul 23 11:41:56.672490 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:56.672468    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46d69d18-f51f-428a-8e3c-7c7cbadc6b73-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46d69d18-f51f-428a-8e3c-7c7cbadc6b73" (UID: "46d69d18-f51f-428a-8e3c-7c7cbadc6b73"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:41:56.773891 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:56.773803    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46d69d18-f51f-428a-8e3c-7c7cbadc6b73-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:41:57.526595 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:57.526568    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"
Jul 23 11:41:57.526804 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:57.526565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c" event={"ID":"46d69d18-f51f-428a-8e3c-7c7cbadc6b73","Type":"ContainerDied","Data":"389dade59e10a10b682da9d0e430c212591949d209f7bfa11e5767cea19a6d7c"}
Jul 23 11:41:57.526804 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:41:57.526692    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="389dade59e10a10b682da9d0e430c212591949d209f7bfa11e5767cea19a6d7c"
Jul 23 11:42:01.613664 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:01.613630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:06.220038 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:06.219994    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"]
Jul 23 11:42:06.221702 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:06.221664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:06.222332 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:06.222312    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cde04e19-7tv4c"]
Jul 23 11:42:06.397403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:06.397368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:06.640182 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:06.640146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:06.859964 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:06.859926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:07.155191 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.155157    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"]
Jul 23 11:42:07.155647 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.155628    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d69d18-f51f-428a-8e3c-7c7cbadc6b73" containerName="revoke-keys"
Jul 23 11:42:07.155647 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.155647    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d69d18-f51f-428a-8e3c-7c7cbadc6b73" containerName="revoke-keys"
Jul 23 11:42:07.155744 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.155714    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d69d18-f51f-428a-8e3c-7c7cbadc6b73" containerName="revoke-keys"
Jul 23 11:42:07.158728 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.158713    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.161550 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.161528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b54bb921-openshift-default-dockercfg-hqs9s\""
Jul 23 11:42:07.178641 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.178591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"]
Jul 23 11:42:07.183368 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.183327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:07.269633 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-envoy\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.269633 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-credential-socket\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-istio-token\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57263d34-c531-47f3-bf8f-333c845cee01-istio-podinfo\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-certs\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6qw\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-kube-api-access-6x6qw\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57263d34-c531-47f3-bf8f-333c845cee01-istiod-ca-cert\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.269975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-socket\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.270109 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.270039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-data\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.303989 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.303941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:07.318040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.318011    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46d69d18-f51f-428a-8e3c-7c7cbadc6b73" path="/var/lib/kubelet/pods/46d69d18-f51f-428a-8e3c-7c7cbadc6b73/volumes"
Jul 23 11:42:07.370850 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.370816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-credential-socket\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.370850 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.370855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-istio-token\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371112 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.370894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57263d34-c531-47f3-bf8f-333c845cee01-istio-podinfo\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371112 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.370942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-certs\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371112 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.370975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6qw\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-kube-api-access-6x6qw\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57263d34-c531-47f3-bf8f-333c845cee01-istiod-ca-cert\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-socket\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-credential-socket\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-data\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371302    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-certs\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371526 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-envoy\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371567 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-socket\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371637 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-data\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.371858 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.371819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57263d34-c531-47f3-bf8f-333c845cee01-istiod-ca-cert\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.373322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.373304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-envoy\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.373486 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.373465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57263d34-c531-47f3-bf8f-333c845cee01-istio-podinfo\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.379232 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.379204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-istio-token\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.379328 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.379288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6qw\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-kube-api-access-6x6qw\") pod \"e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") " pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.469355 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.469258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:07.627408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.627383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"]
Jul 23 11:42:07.629425 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:42:07.629399    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57263d34_c531_47f3_bf8f_333c845cee01.slice/crio-b2db4d11fe52bd76c9b034ef57929ddd738a768bbcc0a71839a33bad9fdcf51c WatchSource:0}: Error finding container b2db4d11fe52bd76c9b034ef57929ddd738a768bbcc0a71839a33bad9fdcf51c: Status 404 returned error can't find the container with id b2db4d11fe52bd76c9b034ef57929ddd738a768bbcc0a71839a33bad9fdcf51c
Jul 23 11:42:07.631505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.631474    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:42:07.631600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.631537    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:42:07.631600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:07.631567    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:42:08.587064 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:08.587028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" event={"ID":"57263d34-c531-47f3-bf8f-333c845cee01","Type":"ContainerStarted","Data":"55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"}
Jul 23 11:42:08.587461 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:08.587089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" event={"ID":"57263d34-c531-47f3-bf8f-333c845cee01","Type":"ContainerStarted","Data":"b2db4d11fe52bd76c9b034ef57929ddd738a768bbcc0a71839a33bad9fdcf51c"}
Jul 23 11:42:08.612029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:08.611979    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" podStartSLOduration=1.611964601 podStartE2EDuration="1.611964601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:42:08.609981754 +0000 UTC m=+1919.736845191" watchObservedRunningTime="2026-07-23 11:42:08.611964601 +0000 UTC m=+1919.738828103"
Jul 23 11:42:09.469850 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:09.469824    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:09.474958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:09.474933    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:09.592335 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:09.592302    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:09.593238 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:09.593217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:09.966888 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:09.966841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:10.070087 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:10.070053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:10.197110 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:10.197072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:10.492725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:10.492683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:10.920098 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:10.920053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:11.026077 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:11.026037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:23.679921 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:23.679824    2578 generic.go:356] "Generic (PLEG): container finished" podID="57263d34-c531-47f3-bf8f-333c845cee01" containerID="55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23" exitCode=0
Jul 23 11:42:23.679921 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:23.679902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" event={"ID":"57263d34-c531-47f3-bf8f-333c845cee01","Type":"ContainerDied","Data":"55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"}
Jul 23 11:42:23.680341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:23.680313    2578 scope.go:117] "RemoveContainer" containerID="55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"
Jul 23 11:42:23.681412 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:23.681384    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:42:23.681474 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:23.681453    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:42:23.681510 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:23.681483    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:42:24.592617 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:24.592570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:24.686784 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:24.686743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" event={"ID":"57263d34-c531-47f3-bf8f-333c845cee01","Type":"ContainerStarted","Data":"dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957"}
Jul 23 11:42:25.470238 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:25.470211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:25.471505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:25.471478    2578 patch_prober.go:28] interesting pod/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 23 11:42:25.471627 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:25.471540    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 23 11:42:26.469950 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:26.469913    2578 patch_prober.go:28] interesting pod/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 23 11:42:26.470311 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:26.469968    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 23 11:42:27.470587 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:27.470547    2578 patch_prober.go:28] interesting pod/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 23 11:42:27.471014 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:27.470648    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 23 11:42:28.470110 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:28.470069    2578 patch_prober.go:28] interesting pod/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 23 11:42:28.470290 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:28.470149    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 23 11:42:29.474235 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:29.474202    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:29.474649 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:29.474553    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:29.475212 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:29.475195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:46.183017 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:46.182979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:48.438041 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:48.438005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:48.532993 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:48.532961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:50.796412 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:50.796372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:51.966979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:51.966946    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"]
Jul 23 11:42:51.967403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:51.967202    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy" containerID="cri-o://dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957" gracePeriod=30
Jul 23 11:42:51.987661 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:51.987636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:52.224184 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:52.224110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:52.430473 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:52.430448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:52.723054 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:52.723020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:52.946473 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:52.946443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:55.473920 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:55.473881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:55.554526 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:55.554490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:55.615271 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:55.615242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:55.817540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:55.817515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:56.230952 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:56.230867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:56.331430 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:56.331397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:42:57.227270 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.227220    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:57.357251 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-envoy\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-credential-socket\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-data\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57263d34-c531-47f3-bf8f-333c845cee01-istiod-ca-cert\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x6qw\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-kube-api-access-6x6qw\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357660 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-istio-token\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357660 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-certs\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357660 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57263d34-c531-47f3-bf8f-333c845cee01-istio-podinfo\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-socket\") pod \"57263d34-c531-47f3-bf8f-333c845cee01\" (UID: \"57263d34-c531-47f3-bf8f-333c845cee01\") "
Jul 23 11:42:57.357839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357722    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:42:57.357839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.357805    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57263d34-c531-47f3-bf8f-333c845cee01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:42:57.358089 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.358043    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.358089 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.358068    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57263d34-c531-47f3-bf8f-333c845cee01-istiod-ca-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.358278 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.358141    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:42:57.358278 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.358187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:42:57.358402 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.358305    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-data" (OuterVolumeSpecName: "istio-data") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:42:57.359595 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.359566    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-istio-token" (OuterVolumeSpecName: "istio-token") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:42:57.359740 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.359637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:42:57.359786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.359757    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57263d34-c531-47f3-bf8f-333c845cee01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 11:42:57.359821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.359779    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-kube-api-access-6x6qw" (OuterVolumeSpecName: "kube-api-access-6x6qw") pod "57263d34-c531-47f3-bf8f-333c845cee01" (UID: "57263d34-c531-47f3-bf8f-333c845cee01"). InnerVolumeSpecName "kube-api-access-6x6qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:42:57.458873 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458836    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-envoy\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.458873 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458870    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-credential-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.459055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458884    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-istio-data\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.459055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458897    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x6qw\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-kube-api-access-6x6qw\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.459055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458910    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57263d34-c531-47f3-bf8f-333c845cee01-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.459055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458923    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57263d34-c531-47f3-bf8f-333c845cee01-istio-podinfo\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.459055 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.458935    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57263d34-c531-47f3-bf8f-333c845cee01-workload-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:42:57.865854 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.865821    2578 generic.go:356] "Generic (PLEG): container finished" podID="57263d34-c531-47f3-bf8f-333c845cee01" containerID="dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957" exitCode=0
Jul 23 11:42:57.866029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.865863    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"
Jul 23 11:42:57.866029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.865906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" event={"ID":"57263d34-c531-47f3-bf8f-333c845cee01","Type":"ContainerDied","Data":"dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957"}
Jul 23 11:42:57.866029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.865957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc" event={"ID":"57263d34-c531-47f3-bf8f-333c845cee01","Type":"ContainerDied","Data":"b2db4d11fe52bd76c9b034ef57929ddd738a768bbcc0a71839a33bad9fdcf51c"}
Jul 23 11:42:57.866029 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.865981    2578 scope.go:117] "RemoveContainer" containerID="dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957"
Jul 23 11:42:57.875430 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.875413    2578 scope.go:117] "RemoveContainer" containerID="55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"
Jul 23 11:42:57.883406 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.883385    2578 scope.go:117] "RemoveContainer" containerID="dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957"
Jul 23 11:42:57.883702 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:42:57.883678    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957\": container with ID starting with dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957 not found: ID does not exist" containerID="dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957"
Jul 23 11:42:57.883785 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.883707    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957"} err="failed to get container status \"dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957\": rpc error: code = NotFound desc = could not find container \"dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957\": container with ID starting with dd373059ef4087db18d2e8ae43d7658982746c6c7da1fe8fc0d981936f6d1957 not found: ID does not exist"
Jul 23 11:42:57.883785 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.883724    2578 scope.go:117] "RemoveContainer" containerID="55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"
Jul 23 11:42:57.883948 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:42:57.883933    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23\": container with ID starting with 55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23 not found: ID does not exist" containerID="55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"
Jul 23 11:42:57.883991 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.883951    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23"} err="failed to get container status \"55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23\": rpc error: code = NotFound desc = could not find container \"55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23\": container with ID starting with 55d3c42da68afc4719ce8b8f65a7b56cc89fdcdb33a876b663f4e87bed0e2c23 not found: ID does not exist"
Jul 23 11:42:57.888636 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.888602    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"]
Jul 23 11:42:57.892206 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:57.892186    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b54bb921-openshift-default-5b895b9fb9-xfrrc"]
Jul 23 11:42:59.318474 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:42:59.318441    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57263d34-c531-47f3-bf8f-333c845cee01" path="/var/lib/kubelet/pods/57263d34-c531-47f3-bf8f-333c845cee01/volumes"
Jul 23 11:43:30.917406 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:30.917358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:35.404463 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:35.404424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:35.561050 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:35.561011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:35.786237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:35.786204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:36.247678 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:36.247558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:36.358336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:36.358295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:36.458901 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:36.458863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:37.837099 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:37.837063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:43.834943 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:43.834913    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:43.892396 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:43.892356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:43.960755 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:43.960720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:44.060688 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:44.060659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:44.160895 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:44.160824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:43:44.515583 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:43:44.515544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:10.477432 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:10.477386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:16.642126 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:16.642082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:16.749576 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:16.749537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:16.842620 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:16.842573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:32.718871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:32.718778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:38.805798 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:38.805762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:38.905910 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:38.905875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:39.009296 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:39.009265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:49.515994 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:49.515957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:50.330395 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:50.330355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:52.054585 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:52.054548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:52.115184 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:52.115148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:56.573486 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:56.573433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:56.629126 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:56.629081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:56.708131 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:56.708092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:56.809811 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:56.809770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:56.909774 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:56.909676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:57.997616 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:57.997586    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:58.103334 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:58.103295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:44:59.417900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:44:59.417866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:05.241160 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:05.241119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:05.318344 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:05.318303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:05.919864 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:05.919821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:09.402065 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:09.402029    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:45:09.411354 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:09.411332    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:45:11.798646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:11.798588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:11.897886 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:11.897852    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:12.551540 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:12.551506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:12.651984 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:12.651941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:12.765199 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:12.765167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:15.719868 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:15.719822    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:15.800499 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:15.800465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:15.875490 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:15.875454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:15.987199 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:15.987119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:16.631052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:16.631009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:16.731782 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:16.731752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:20.110855 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:20.110815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:20.738976 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:20.738925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:20.837244 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:20.837209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:21.176678 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:21.176639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:27.070328 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.070282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:27.173765 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.173735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:27.426053 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.425961    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"]
Jul 23 11:45:27.426490 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.426471    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy"
Jul 23 11:45:27.426579 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.426493    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy"
Jul 23 11:45:27.426579 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.426509    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy"
Jul 23 11:45:27.426579 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.426517    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy"
Jul 23 11:45:27.426759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.426647    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy"
Jul 23 11:45:27.430040 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.430021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:27.432956 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.432929    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:45:27.438893 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.438873    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"]
Jul 23 11:45:27.439546 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.439523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8\" (UID: \"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:27.540628 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.540578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8\" (UID: \"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:27.541222 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.541200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8\" (UID: \"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:27.741625 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:27.741526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:28.086679 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:28.086650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"]
Jul 23 11:45:28.088481 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:45:28.088447    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c805fb5_de2a_42c9_bd62_4b4d6c7f96d9.slice/crio-0446f80128712d8a7557fb0d7d69d29ec4850509c0c63589bb4dfb32653e9625 WatchSource:0}: Error finding container 0446f80128712d8a7557fb0d7d69d29ec4850509c0c63589bb4dfb32653e9625: Status 404 returned error can't find the container with id 0446f80128712d8a7557fb0d7d69d29ec4850509c0c63589bb4dfb32653e9625
Jul 23 11:45:28.654307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:28.654200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8" event={"ID":"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9","Type":"ContainerStarted","Data":"584a01b300d66b947f237be05ba60180d1fb810bd2e572d2ec12412b96110aeb"}
Jul 23 11:45:28.654307 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:28.654256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8" event={"ID":"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9","Type":"ContainerStarted","Data":"0446f80128712d8a7557fb0d7d69d29ec4850509c0c63589bb4dfb32653e9625"}
Jul 23 11:45:28.673756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:28.673688    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8" podStartSLOduration=1.673672533 podStartE2EDuration="1.673672533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:45:28.671774954 +0000 UTC m=+2119.798638378" watchObservedRunningTime="2026-07-23 11:45:28.673672533 +0000 UTC m=+2119.800535955"
Jul 23 11:45:29.660258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:29.660225    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9" containerID="584a01b300d66b947f237be05ba60180d1fb810bd2e572d2ec12412b96110aeb" exitCode=0
Jul 23 11:45:29.660678 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:29.660314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8" event={"ID":"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9","Type":"ContainerDied","Data":"584a01b300d66b947f237be05ba60180d1fb810bd2e572d2ec12412b96110aeb"}
Jul 23 11:45:30.809987 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:30.809954    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:30.872699 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:30.872661    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9-maas-api-service-ca\") pod \"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9\" (UID: \"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9\") "
Jul 23 11:45:30.873063 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:30.873043    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9" (UID: "9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:45:30.973824 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:30.973743    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:45:31.671122 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:31.671042    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"
Jul 23 11:45:31.671122 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:31.671073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8" event={"ID":"9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9","Type":"ContainerDied","Data":"0446f80128712d8a7557fb0d7d69d29ec4850509c0c63589bb4dfb32653e9625"}
Jul 23 11:45:31.671122 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:31.671120    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0446f80128712d8a7557fb0d7d69d29ec4850509c0c63589bb4dfb32653e9625"
Jul 23 11:45:38.003759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:38.003696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:42.505232 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:42.505198    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"]
Jul 23 11:45:42.507720 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:42.507687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:42.508915 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:42.508891    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3403a9d3-m99h8"]
Jul 23 11:45:42.883532 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:42.883498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:43.318347 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:43.318312    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9" path="/var/lib/kubelet/pods/9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9/volumes"
Jul 23 11:45:48.951308 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:48.951274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:49.004873 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:49.004838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:49.209359 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:49.209273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:49.430499 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:49.430434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:49.543007 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:49.542968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:49.641855 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:49.641799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:49.756156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:49.756122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:55.607505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:55.607466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:55.710008 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:55.709976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:55.806160 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:55.806125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:45:55.951578 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:45:55.951481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:02.012563 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:02.012473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:02.112629 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:02.112574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:08.738826 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:08.738791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:09.039425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:09.039391    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:09.173086 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:09.173039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:11.862341 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:11.862297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:11.939546 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:11.939507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:12.003639 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:12.003588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:12.274889 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:12.274855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:12.629303 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:12.629210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:12.808907 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:12.808872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:16.347561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:16.347520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:23.050308 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:23.050271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:46.811969 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:46.811928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:46:55.534782 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.534745    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"]
Jul 23 11:46:55.535236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.535166    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9" containerName="revoke-keys"
Jul 23 11:46:55.535236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.535177    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9" containerName="revoke-keys"
Jul 23 11:46:55.535312 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.535256    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="57263d34-c531-47f3-bf8f-333c845cee01" containerName="istio-proxy"
Jul 23 11:46:55.535312 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.535269    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c805fb5-de2a-42c9-bd62-4b4d6c7f96d9" containerName="revoke-keys"
Jul 23 11:46:55.538429 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.538412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:55.541189 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.541170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:46:55.545061 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.545037    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"]
Jul 23 11:46:55.585480 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.585439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx\" (UID: \"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:55.686095 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.686058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx\" (UID: \"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:55.686709 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.686689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx\" (UID: \"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:55.852789 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.852701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:55.992727 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:55.992701    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"]
Jul 23 11:46:55.994783 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:46:55.994758    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7310ee_a4f7_4e04_a0e5_6ea9559b28ea.slice/crio-0aff45968142e02927bf57cdcbb37a1adc4963d5f6f46735b638bf040c342f38 WatchSource:0}: Error finding container 0aff45968142e02927bf57cdcbb37a1adc4963d5f6f46735b638bf040c342f38: Status 404 returned error can't find the container with id 0aff45968142e02927bf57cdcbb37a1adc4963d5f6f46735b638bf040c342f38
Jul 23 11:46:56.110272 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:56.110197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx" event={"ID":"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea","Type":"ContainerStarted","Data":"0aff45968142e02927bf57cdcbb37a1adc4963d5f6f46735b638bf040c342f38"}
Jul 23 11:46:57.117336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:57.117303    2578 generic.go:356] "Generic (PLEG): container finished" podID="ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea" containerID="4723c0198662ded915b30f68cf7a232dfd197e84836e7d02fc7260631560bffd" exitCode=0
Jul 23 11:46:57.117745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:57.117393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx" event={"ID":"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea","Type":"ContainerDied","Data":"4723c0198662ded915b30f68cf7a232dfd197e84836e7d02fc7260631560bffd"}
Jul 23 11:46:58.262577 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:58.262553    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:58.310490 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:58.310459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea-maas-api-service-ca\") pod \"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea\" (UID: \"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea\") "
Jul 23 11:46:58.310809 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:58.310789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea" (UID: "ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:46:58.411473 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:58.411400    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:46:59.129305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:59.129276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"
Jul 23 11:46:59.129305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:59.129300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx" event={"ID":"ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea","Type":"ContainerDied","Data":"0aff45968142e02927bf57cdcbb37a1adc4963d5f6f46735b638bf040c342f38"}
Jul 23 11:46:59.129515 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:46:59.129340    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aff45968142e02927bf57cdcbb37a1adc4963d5f6f46735b638bf040c342f38"
Jul 23 11:47:11.040805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:11.040766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:13.035081 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:13.035049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:13.096268 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:13.096231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:15.610625 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:15.610569    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"]
Jul 23 11:47:15.615134 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:15.615106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:15.615802 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:15.615785    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d0774c5e-5x5qx"]
Jul 23 11:47:17.318722 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:17.318686    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea" path="/var/lib/kubelet/pods/ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea/volumes"
Jul 23 11:47:17.683031 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:17.682917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:22.713445 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:22.713402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:49.373768 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:49.373727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:49.474900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:49.474855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:47:59.733986 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:47:59.733953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:00.032680 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:00.032641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:05.594633 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:05.594580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:05.741874 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:05.741843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:05.861698 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:05.861623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:06.067157 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:06.067121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:07.082237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:07.082204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:07.191975 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:07.191949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:07.293020 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:07.292958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:08.045958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:08.045922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:08.147318 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:08.147280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:08.245073 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:08.245037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:09.504266 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:09.504236    2578 scope.go:117] "RemoveContainer" containerID="56ce6d8600340d90ac5da3bf9341736f2e6a9bdd872e26ebaf5099091079f7f5"
Jul 23 11:48:09.586052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:09.586025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:15.678678 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:15.678637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:15.779088 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:15.779058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:16.325006 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:16.324973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:22.253316 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:22.253260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:22.316703 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:22.316664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:22.395322 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:22.395278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:22.494715 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:22.494683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:26.630855 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:26.630827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:32.950092 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:32.950057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:33.280481 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:33.280456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:54.080306 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:54.080274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:48:54.233581 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:48:54.233539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:00.945762 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:00.945726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:01.046145 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:01.046106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:01.270306 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:01.270269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:01.564581 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:01.564496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:01.707649 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:01.707600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:04.637713 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:04.637671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:04.724835 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:04.724802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:04.792971 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:04.792934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:04.892882 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:04.892785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:05.415146 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:05.415110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:05.529409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:05.529370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:09.108351 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.108311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:09.416640 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.416523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:09.668545 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.668458    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"]
Jul 23 11:49:09.669088 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.669064    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea" containerName="revoke-keys"
Jul 23 11:49:09.669152 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.669092    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea" containerName="revoke-keys"
Jul 23 11:49:09.669221 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.669208    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec7310ee-a4f7-4e04-a0e5-6ea9559b28ea" containerName="revoke-keys"
Jul 23 11:49:09.672692 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.672669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.675318 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.675296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4c7f56-openshift-default-dockercfg-hf2vq\""
Jul 23 11:49:09.682180 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.682159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"]
Jul 23 11:49:09.693589 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.693559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:09.747401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-credential-socket\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747401 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-istio-token\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpkdl\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-kube-api-access-wpkdl\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-certs\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86d36761-7943-485d-9977-5bcd19a1c877-istiod-ca-cert\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-socket\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-envoy\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747646 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86d36761-7943-485d-9977-5bcd19a1c877-istio-podinfo\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.747845 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.747688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-data\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849338 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpkdl\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-kube-api-access-wpkdl\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-certs\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86d36761-7943-485d-9977-5bcd19a1c877-istiod-ca-cert\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-socket\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-envoy\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86d36761-7943-485d-9977-5bcd19a1c877-istio-podinfo\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-data\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-credential-socket\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-istio-token\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.849871 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.849816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-certs\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.850237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.850211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-credential-socket\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.850345 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.850236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-socket\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.850404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.850342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86d36761-7943-485d-9977-5bcd19a1c877-istiod-ca-cert\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.850404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.850352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-data\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.851976 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.851956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-envoy\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.852501 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.852480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86d36761-7943-485d-9977-5bcd19a1c877-istio-podinfo\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.857932 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.857876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpkdl\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-kube-api-access-wpkdl\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.858302 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.858281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-istio-token\") pod \"e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") " pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:09.883794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.883759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:09.983849 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:09.983748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:10.124656 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.124631    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"]
Jul 23 11:49:10.125807 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:49:10.125781    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d36761_7943_485d_9977_5bcd19a1c877.slice/crio-46c24a670b66741f622f324a4c96ce6b16560f1647badf85c0defa31f7f47411 WatchSource:0}: Error finding container 46c24a670b66741f622f324a4c96ce6b16560f1647badf85c0defa31f7f47411: Status 404 returned error can't find the container with id 46c24a670b66741f622f324a4c96ce6b16560f1647badf85c0defa31f7f47411
Jul 23 11:49:10.127950 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.127923    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:49:10.128034 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.127982    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:49:10.128034 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.128009    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:49:10.843515 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.843483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" event={"ID":"86d36761-7943-485d-9977-5bcd19a1c877","Type":"ContainerStarted","Data":"bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"}
Jul 23 11:49:10.843728 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.843533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" event={"ID":"86d36761-7943-485d-9977-5bcd19a1c877","Type":"ContainerStarted","Data":"46c24a670b66741f622f324a4c96ce6b16560f1647badf85c0defa31f7f47411"}
Jul 23 11:49:10.867302 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.867254    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podStartSLOduration=1.8672374 podStartE2EDuration="1.8672374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:49:10.865652112 +0000 UTC m=+2341.992515562" watchObservedRunningTime="2026-07-23 11:49:10.8672374 +0000 UTC m=+2341.994100822"
Jul 23 11:49:10.984626 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:10.984568    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:11.989342 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:11.989309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:12.815369 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:12.815329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:12.854740 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:12.854706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:12.855702 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:12.855681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:12.901591 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:12.901548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:12.956869 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:12.956840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:13.489552 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:13.489520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:13.586905 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:13.586873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:13.683553 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:13.683519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:17.280961 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:17.280925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:23.915725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:23.915696    2578 generic.go:356] "Generic (PLEG): container finished" podID="86d36761-7943-485d-9977-5bcd19a1c877" containerID="bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43" exitCode=0
Jul 23 11:49:23.916113 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:23.915775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" event={"ID":"86d36761-7943-485d-9977-5bcd19a1c877","Type":"ContainerDied","Data":"bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"}
Jul 23 11:49:23.916154 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:23.916139    2578 scope.go:117] "RemoveContainer" containerID="bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"
Jul 23 11:49:23.917151 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:23.917105    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:49:23.917224 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:23.917209    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:49:23.917302 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:23.917287    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:49:24.922580 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:24.922547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" event={"ID":"86d36761-7943-485d-9977-5bcd19a1c877","Type":"ContainerStarted","Data":"a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1"}
Jul 23 11:49:24.984748 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:24.984709    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:24.985911 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:24.985884    2578 patch_prober.go:28] interesting pod/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 23 11:49:24.986044 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:24.985934    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 23 11:49:25.984924 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:25.984891    2578 patch_prober.go:28] interesting pod/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 23 11:49:25.985340 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:25.984950    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 23 11:49:26.985147 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:26.985097    2578 patch_prober.go:28] interesting pod/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 23 11:49:26.985524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:26.985171    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 23 11:49:27.195366 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:27.195335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:27.299469 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:27.299432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:27.855353 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:27.855325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:27.984748 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:27.984716    2578 patch_prober.go:28] interesting pod/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 23 11:49:27.984922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:27.984772    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 23 11:49:28.987869 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:28.987835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:28.988821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:28.988804    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:49:34.829919 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:34.829876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:35.498643 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:35.498574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:49:35.598393 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:49:35.598355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:50:09.434504 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:50:09.434472    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:50:09.444709 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:50:09.444688    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:50:19.122596 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:50:19.122563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:50:46.824471 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:50:46.824386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:50:46.925846 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:50:46.925810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:12.408981 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:12.408948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:13.279707 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.279646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:13.409304 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.409265    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"]
Jul 23 11:51:13.413020 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.413000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:13.415937 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.415909    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:51:13.421352 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.421220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"]
Jul 23 11:51:13.527958 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.527919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/572c3f42-3747-4bfb-adc7-843fbace3841-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2\" (UID: \"572c3f42-3747-4bfb-adc7-843fbace3841\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:13.629650 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.629532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/572c3f42-3747-4bfb-adc7-843fbace3841-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2\" (UID: \"572c3f42-3747-4bfb-adc7-843fbace3841\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:13.630200 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.630180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/572c3f42-3747-4bfb-adc7-843fbace3841-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2\" (UID: \"572c3f42-3747-4bfb-adc7-843fbace3841\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:13.726520 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.726480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:13.881049 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:13.881021    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"]
Jul 23 11:51:13.883096 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:51:13.883060    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572c3f42_3747_4bfb_adc7_843fbace3841.slice/crio-a8b5ea0046cfc50244b7995b7b32391a3bed6da1b88f7b16df10394923803257 WatchSource:0}: Error finding container a8b5ea0046cfc50244b7995b7b32391a3bed6da1b88f7b16df10394923803257: Status 404 returned error can't find the container with id a8b5ea0046cfc50244b7995b7b32391a3bed6da1b88f7b16df10394923803257
Jul 23 11:51:14.052584 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:14.052536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:14.153228 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:14.153152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:14.519655 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:14.519600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2" event={"ID":"572c3f42-3747-4bfb-adc7-843fbace3841","Type":"ContainerStarted","Data":"f537c7c4de2f0890f8374ab9f6f438a2d1f537d7e2eb24d032e2413c74d84d91"}
Jul 23 11:51:14.520046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:14.519673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2" event={"ID":"572c3f42-3747-4bfb-adc7-843fbace3841","Type":"ContainerStarted","Data":"a8b5ea0046cfc50244b7995b7b32391a3bed6da1b88f7b16df10394923803257"}
Jul 23 11:51:14.538025 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:14.537971    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2" podStartSLOduration=1.537955663 podStartE2EDuration="1.537955663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:51:14.535946735 +0000 UTC m=+2465.662810180" watchObservedRunningTime="2026-07-23 11:51:14.537955663 +0000 UTC m=+2465.664819088"
Jul 23 11:51:15.527478 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:15.527448    2578 generic.go:356] "Generic (PLEG): container finished" podID="572c3f42-3747-4bfb-adc7-843fbace3841" containerID="f537c7c4de2f0890f8374ab9f6f438a2d1f537d7e2eb24d032e2413c74d84d91" exitCode=0
Jul 23 11:51:15.527890 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:15.527521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2" event={"ID":"572c3f42-3747-4bfb-adc7-843fbace3841","Type":"ContainerDied","Data":"f537c7c4de2f0890f8374ab9f6f438a2d1f537d7e2eb24d032e2413c74d84d91"}
Jul 23 11:51:16.287015 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:16.286976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:16.387926 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:16.387894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:16.672840 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:16.672814    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:16.759215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:16.759189    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/572c3f42-3747-4bfb-adc7-843fbace3841-maas-api-service-ca\") pod \"572c3f42-3747-4bfb-adc7-843fbace3841\" (UID: \"572c3f42-3747-4bfb-adc7-843fbace3841\") "
Jul 23 11:51:16.759517 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:16.759494    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572c3f42-3747-4bfb-adc7-843fbace3841-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "572c3f42-3747-4bfb-adc7-843fbace3841" (UID: "572c3f42-3747-4bfb-adc7-843fbace3841"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:51:16.860161 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:16.860103    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/572c3f42-3747-4bfb-adc7-843fbace3841-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:51:17.539843 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:17.539811    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"
Jul 23 11:51:17.539997 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:17.539859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2" event={"ID":"572c3f42-3747-4bfb-adc7-843fbace3841","Type":"ContainerDied","Data":"a8b5ea0046cfc50244b7995b7b32391a3bed6da1b88f7b16df10394923803257"}
Jul 23 11:51:17.539997 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:17.539907    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8b5ea0046cfc50244b7995b7b32391a3bed6da1b88f7b16df10394923803257"
Jul 23 11:51:23.908277 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:23.908241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:28.487726 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:28.487685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:28.512543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:28.512510    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"]
Jul 23 11:51:28.514619 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:28.514577    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9c6be2-mhwr2"]
Jul 23 11:51:29.318053 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:29.318025    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572c3f42-3747-4bfb-adc7-843fbace3841" path="/var/lib/kubelet/pods/572c3f42-3747-4bfb-adc7-843fbace3841/volumes"
Jul 23 11:51:30.037042 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:30.036993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:34.603189 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:34.603150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:34.655175 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:34.655129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:34.864404 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:34.864294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:35.079860 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.079809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:35.185455 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.185373    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"]
Jul 23 11:51:35.186093 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.186073    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572c3f42-3747-4bfb-adc7-843fbace3841" containerName="revoke-keys"
Jul 23 11:51:35.186152 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.186097    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="572c3f42-3747-4bfb-adc7-843fbace3841" containerName="revoke-keys"
Jul 23 11:51:35.186234 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.186221    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="572c3f42-3747-4bfb-adc7-843fbace3841" containerName="revoke-keys"
Jul 23 11:51:35.190886 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.190868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:35.193786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.193762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:51:35.196003 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.195980    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"]
Jul 23 11:51:35.238436 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.238407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef53235b-1a87-400e-b9c4-64ef1fc00031-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85\" (UID: \"ef53235b-1a87-400e-b9c4-64ef1fc00031\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:35.339312 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.339281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef53235b-1a87-400e-b9c4-64ef1fc00031-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85\" (UID: \"ef53235b-1a87-400e-b9c4-64ef1fc00031\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:35.339970 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.339947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef53235b-1a87-400e-b9c4-64ef1fc00031-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85\" (UID: \"ef53235b-1a87-400e-b9c4-64ef1fc00031\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:35.503910 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.503833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:35.667237 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.667203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"]
Jul 23 11:51:35.668792 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:51:35.668766    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef53235b_1a87_400e_b9c4_64ef1fc00031.slice/crio-7988d29f16e4bae7a74d887dfeb32c7cfdd027744cc48ae05b8e11165cd3fdea WatchSource:0}: Error finding container 7988d29f16e4bae7a74d887dfeb32c7cfdd027744cc48ae05b8e11165cd3fdea: Status 404 returned error can't find the container with id 7988d29f16e4bae7a74d887dfeb32c7cfdd027744cc48ae05b8e11165cd3fdea
Jul 23 11:51:35.831185 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.831157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:35.928021 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:35.927993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:36.648996 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:36.648914    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef53235b-1a87-400e-b9c4-64ef1fc00031" containerID="f0c723f83e9d9460dec148370ce3214c321bcdf3c95a9207bf4f75837fe06b2b" exitCode=0
Jul 23 11:51:36.649156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:36.649007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85" event={"ID":"ef53235b-1a87-400e-b9c4-64ef1fc00031","Type":"ContainerDied","Data":"f0c723f83e9d9460dec148370ce3214c321bcdf3c95a9207bf4f75837fe06b2b"}
Jul 23 11:51:36.649156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:36.649066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85" event={"ID":"ef53235b-1a87-400e-b9c4-64ef1fc00031","Type":"ContainerStarted","Data":"7988d29f16e4bae7a74d887dfeb32c7cfdd027744cc48ae05b8e11165cd3fdea"}
Jul 23 11:51:37.797438 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:37.797415    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:37.863745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:37.863721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef53235b-1a87-400e-b9c4-64ef1fc00031-maas-api-service-ca\") pod \"ef53235b-1a87-400e-b9c4-64ef1fc00031\" (UID: \"ef53235b-1a87-400e-b9c4-64ef1fc00031\") "
Jul 23 11:51:37.864043 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:37.864021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef53235b-1a87-400e-b9c4-64ef1fc00031-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef53235b-1a87-400e-b9c4-64ef1fc00031" (UID: "ef53235b-1a87-400e-b9c4-64ef1fc00031"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:51:37.964706 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:37.964640    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef53235b-1a87-400e-b9c4-64ef1fc00031-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:51:38.661542 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:38.661517    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"
Jul 23 11:51:38.661542 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:38.661528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85" event={"ID":"ef53235b-1a87-400e-b9c4-64ef1fc00031","Type":"ContainerDied","Data":"7988d29f16e4bae7a74d887dfeb32c7cfdd027744cc48ae05b8e11165cd3fdea"}
Jul 23 11:51:38.661784 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:38.661569    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7988d29f16e4bae7a74d887dfeb32c7cfdd027744cc48ae05b8e11165cd3fdea"
Jul 23 11:51:45.619357 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:45.619324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:50.262830 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:50.262794    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"]
Jul 23 11:51:50.264856 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:50.264833    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c7f56-8js85"]
Jul 23 11:51:50.480406 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:50.480369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:50.649593 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:50.649510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:51.318219 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:51.318188    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef53235b-1a87-400e-b9c4-64ef1fc00031" path="/var/lib/kubelet/pods/ef53235b-1a87-400e-b9c4-64ef1fc00031/volumes"
Jul 23 11:51:56.446190 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:56.446152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:56.505808 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:56.505771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:56.691990 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:56.691952    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"]
Jul 23 11:51:56.692232 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:56.692193    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy" containerID="cri-o://a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1" gracePeriod=30
Jul 23 11:51:56.743517 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:56.743433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:56.947361 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:56.947323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:57.248827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:57.248772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:57.570591 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:57.570554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:58.130922 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:58.130890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:51:58.991035 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:58.991003    2578 patch_prober.go:28] interesting pod/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 11:51:58.991491 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:51:58.991059    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 11:52:00.553873 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:00.553830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:00.640409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:00.640354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:00.707246 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:00.707208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:00.895243 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:00.895153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:01.246225 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:01.246136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:01.350900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:01.350864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:01.962554 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:01.962487    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:52:02.090396 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090364    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-istio-token\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.090568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpkdl\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-kube-api-access-wpkdl\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.090568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-data\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.090568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090464    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86d36761-7943-485d-9977-5bcd19a1c877-istiod-ca-cert\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.090568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-credential-socket\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.090568 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-socket\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-envoy\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86d36761-7943-485d-9977-5bcd19a1c877-istio-podinfo\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-certs\") pod \"86d36761-7943-485d-9977-5bcd19a1c877\" (UID: \"86d36761-7943-485d-9977-5bcd19a1c877\") "
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090854    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.090904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d36761-7943-485d-9977-5bcd19a1c877-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.091139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.091229    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-credential-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.091249    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.091254 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.091262    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-workload-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.091858 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.091275    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86d36761-7943-485d-9977-5bcd19a1c877-istiod-ca-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.091858 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.091478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-data" (OuterVolumeSpecName: "istio-data") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:52:02.092816 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.092790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-kube-api-access-wpkdl" (OuterVolumeSpecName: "kube-api-access-wpkdl") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "kube-api-access-wpkdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:52:02.092945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.092927    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86d36761-7943-485d-9977-5bcd19a1c877-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 11:52:02.093039 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.093013    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-istio-token" (OuterVolumeSpecName: "istio-token") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:52:02.093169 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.093048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86d36761-7943-485d-9977-5bcd19a1c877" (UID: "86d36761-7943-485d-9977-5bcd19a1c877"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:52:02.192295 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.192260    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.192295 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.192289    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpkdl\" (UniqueName: \"kubernetes.io/projected/86d36761-7943-485d-9977-5bcd19a1c877-kube-api-access-wpkdl\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.192295 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.192299    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-data\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.192516 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.192307    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86d36761-7943-485d-9977-5bcd19a1c877-istio-envoy\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.192516 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.192316    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86d36761-7943-485d-9977-5bcd19a1c877-istio-podinfo\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:02.797791 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.797757    2578 generic.go:356] "Generic (PLEG): container finished" podID="86d36761-7943-485d-9977-5bcd19a1c877" containerID="a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1" exitCode=0
Jul 23 11:52:02.797968 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.797828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"
Jul 23 11:52:02.797968 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.797830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" event={"ID":"86d36761-7943-485d-9977-5bcd19a1c877","Type":"ContainerDied","Data":"a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1"}
Jul 23 11:52:02.797968 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.797949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925" event={"ID":"86d36761-7943-485d-9977-5bcd19a1c877","Type":"ContainerDied","Data":"46c24a670b66741f622f324a4c96ce6b16560f1647badf85c0defa31f7f47411"}
Jul 23 11:52:02.797968 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.797970    2578 scope.go:117] "RemoveContainer" containerID="a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1"
Jul 23 11:52:02.808010 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.807992    2578 scope.go:117] "RemoveContainer" containerID="bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"
Jul 23 11:52:02.816199 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.816098    2578 scope.go:117] "RemoveContainer" containerID="a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1"
Jul 23 11:52:02.816372 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:52:02.816355    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1\": container with ID starting with a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1 not found: ID does not exist" containerID="a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1"
Jul 23 11:52:02.816408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.816380    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1"} err="failed to get container status \"a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1\": rpc error: code = NotFound desc = could not find container \"a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1\": container with ID starting with a7b51267f02dda717bb0cda87d3e79cd0b005af1bff0dc17903c1a5001d758f1 not found: ID does not exist"
Jul 23 11:52:02.816408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.816398    2578 scope.go:117] "RemoveContainer" containerID="bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"
Jul 23 11:52:02.816620 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:52:02.816589    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43\": container with ID starting with bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43 not found: ID does not exist" containerID="bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"
Jul 23 11:52:02.816665 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.816625    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43"} err="failed to get container status \"bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43\": rpc error: code = NotFound desc = could not find container \"bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43\": container with ID starting with bc277f0ac90c630c462421515b678a9313e3ee6ac1b240ae1a0d5c6d5ad7ec43 not found: ID does not exist"
Jul 23 11:52:02.821337 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.821317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"]
Jul 23 11:52:02.825943 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:02.825922    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4c7f56-openshift-default-cf46fb545-j2925"]
Jul 23 11:52:03.317926 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:03.317893    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d36761-7943-485d-9977-5bcd19a1c877" path="/var/lib/kubelet/pods/86d36761-7943-485d-9977-5bcd19a1c877/volumes"
Jul 23 11:52:04.928239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:04.928205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:05.379819 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.379788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:05.663239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663137    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"]
Jul 23 11:52:05.663599 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663584    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy"
Jul 23 11:52:05.663599 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663600    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy"
Jul 23 11:52:05.663689 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663631    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef53235b-1a87-400e-b9c4-64ef1fc00031" containerName="revoke-keys"
Jul 23 11:52:05.663689 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663637    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef53235b-1a87-400e-b9c4-64ef1fc00031" containerName="revoke-keys"
Jul 23 11:52:05.663751 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663707    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy"
Jul 23 11:52:05.663751 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.663717    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef53235b-1a87-400e-b9c4-64ef1fc00031" containerName="revoke-keys"
Jul 23 11:52:05.668184 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.668166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.671166 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.671139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a9439f-openshift-default-dockercfg-7bk5n\""
Jul 23 11:52:05.678730 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.678707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"]
Jul 23 11:52:05.692750 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.692719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:05.727136 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-data\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727234 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfxvj\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-kube-api-access-hfxvj\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727234 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-envoy\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-certs\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-socket\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727321 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-podinfo\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727426 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-token\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727426 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-credential-socket\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.727426 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.727418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8787ab6f-558d-4902-a81d-21f9e5213a5d-istiod-ca-cert\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828398 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8787ab6f-558d-4902-a81d-21f9e5213a5d-istiod-ca-cert\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828509 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-data\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828509 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfxvj\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-kube-api-access-hfxvj\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828509 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-envoy\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828509 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-certs\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-socket\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-podinfo\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-token\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-credential-socket\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.828948 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-data\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.829000 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.828971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-socket\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.829051 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.829016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-certs\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.829231 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.829206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8787ab6f-558d-4902-a81d-21f9e5213a5d-istiod-ca-cert\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.829278 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.829222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-credential-socket\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.830859 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.830832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-envoy\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.831059 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.831043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-podinfo\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.839216 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.839171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfxvj\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-kube-api-access-hfxvj\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.840264 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.840239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-token\") pod \"e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") " pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:05.980500 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:05.980430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:06.006018 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.005951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:06.120281 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.120252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"]
Jul 23 11:52:06.121693 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:52:06.121665    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8787ab6f_558d_4902_a81d_21f9e5213a5d.slice/crio-c892730cb9beedf8ebfa32370c5c87514fc76f033023ee6f18b3775b5d938c7a WatchSource:0}: Error finding container c892730cb9beedf8ebfa32370c5c87514fc76f033023ee6f18b3775b5d938c7a: Status 404 returned error can't find the container with id c892730cb9beedf8ebfa32370c5c87514fc76f033023ee6f18b3775b5d938c7a
Jul 23 11:52:06.123971 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.123942    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:52:06.124061 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.124006    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:52:06.124061 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.124033    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:52:06.828648 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.828588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" event={"ID":"8787ab6f-558d-4902-a81d-21f9e5213a5d","Type":"ContainerStarted","Data":"b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"}
Jul 23 11:52:06.828817 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.828700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" event={"ID":"8787ab6f-558d-4902-a81d-21f9e5213a5d","Type":"ContainerStarted","Data":"c892730cb9beedf8ebfa32370c5c87514fc76f033023ee6f18b3775b5d938c7a"}
Jul 23 11:52:06.856141 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.856097    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podStartSLOduration=1.8560837380000001 podStartE2EDuration="1.856083738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:52:06.852730549 +0000 UTC m=+2517.979593990" watchObservedRunningTime="2026-07-23 11:52:06.856083738 +0000 UTC m=+2517.982947161"
Jul 23 11:52:06.981506 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:06.981479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:07.985733 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:07.985696    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:08.760959 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:08.760916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:08.840615 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:08.840585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:08.841645 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:08.841599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:08.854802 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:08.854774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:08.913028 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:08.912993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:09.318861 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:09.318828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:09.460403 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:09.460371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:09.552294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:09.552268    2578 scope.go:117] "RemoveContainer" containerID="584a01b300d66b947f237be05ba60180d1fb810bd2e572d2ec12412b96110aeb"
Jul 23 11:52:09.569336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:09.569268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:13.224898 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:13.224864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:21.687524 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:21.687492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:21.785870 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:21.785836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:24.440242 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.439307    2578 patch_prober.go:28] interesting pod/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:43680->10.133.0.65:15021: read: connection reset by peer" start-of-body=
Jul 23 11:52:24.440242 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.439382    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:43680->10.133.0.65:15021: read: connection reset by peer"
Jul 23 11:52:24.932729 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.932701    2578 generic.go:356] "Generic (PLEG): container finished" podID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerID="b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24" exitCode=0
Jul 23 11:52:24.932907 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.932773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" event={"ID":"8787ab6f-558d-4902-a81d-21f9e5213a5d","Type":"ContainerDied","Data":"b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"}
Jul 23 11:52:24.933160 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.933143    2578 scope.go:117] "RemoveContainer" containerID="b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"
Jul 23 11:52:24.934287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.934258    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:52:24.934367 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.934350    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:52:24.934415 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:24.934401    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:52:25.941356 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:25.941311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" event={"ID":"8787ab6f-558d-4902-a81d-21f9e5213a5d","Type":"ContainerStarted","Data":"7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908"}
Jul 23 11:52:25.980941 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:25.980907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:25.981285 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:25.981261    2578 patch_prober.go:28] interesting pod/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 23 11:52:25.981376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:25.981320    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 23 11:52:26.981756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:26.981716    2578 patch_prober.go:28] interesting pod/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 23 11:52:26.982223 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:26.981777    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 23 11:52:27.980877 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:27.980841    2578 patch_prober.go:28] interesting pod/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 23 11:52:27.981056 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:27.980907    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 23 11:52:28.981205 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:28.981170    2578 patch_prober.go:28] interesting pod/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 23 11:52:28.981627 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:28.981227    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 23 11:52:29.985248 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:29.985221    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:29.985674 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:29.985480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:29.986194 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:29.986176    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:52:30.429941 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:30.429910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:30.529833 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:30.529801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:36.345561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:36.345523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:41.242166 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:41.242114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:41.606409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:41.606371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:48.004786 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.004746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:48.111759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.111722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:48.300974 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.300941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:48.516576 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.516539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:48.653456 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.653362    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"]
Jul 23 11:52:48.653940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.653914    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy"
Jul 23 11:52:48.653940 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.653934    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy"
Jul 23 11:52:48.654094 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.654052    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d36761-7943-485d-9977-5bcd19a1c877" containerName="istio-proxy"
Jul 23 11:52:48.657508 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.657486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:48.660924 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.660906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:52:48.666525 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.666500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"]
Jul 23 11:52:48.753505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.753472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd072b2-a693-4c5c-8bd7-fa0b5629508e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc\" (UID: \"6cd072b2-a693-4c5c-8bd7-fa0b5629508e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:48.854425 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.854389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd072b2-a693-4c5c-8bd7-fa0b5629508e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc\" (UID: \"6cd072b2-a693-4c5c-8bd7-fa0b5629508e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:48.855080 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.855062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd072b2-a693-4c5c-8bd7-fa0b5629508e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc\" (UID: \"6cd072b2-a693-4c5c-8bd7-fa0b5629508e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:48.971229 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:48.971149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:49.118959 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:49.118926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"]
Jul 23 11:52:49.130996 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:52:49.130968    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd072b2_a693_4c5c_8bd7_fa0b5629508e.slice/crio-ec5d0e20e6a5c9230a5eecf9b8579d234245bb377870f22459eb6065294a10ca WatchSource:0}: Error finding container ec5d0e20e6a5c9230a5eecf9b8579d234245bb377870f22459eb6065294a10ca: Status 404 returned error can't find the container with id ec5d0e20e6a5c9230a5eecf9b8579d234245bb377870f22459eb6065294a10ca
Jul 23 11:52:50.079074 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:50.079043    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cd072b2-a693-4c5c-8bd7-fa0b5629508e" containerID="0bd724fe4541591075ff11d405794e1adcbdd62ed2dcbc3730d700cfd2950291" exitCode=0
Jul 23 11:52:50.079229 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:50.079088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc" event={"ID":"6cd072b2-a693-4c5c-8bd7-fa0b5629508e","Type":"ContainerDied","Data":"0bd724fe4541591075ff11d405794e1adcbdd62ed2dcbc3730d700cfd2950291"}
Jul 23 11:52:50.079229 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:50.079151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc" event={"ID":"6cd072b2-a693-4c5c-8bd7-fa0b5629508e","Type":"ContainerStarted","Data":"ec5d0e20e6a5c9230a5eecf9b8579d234245bb377870f22459eb6065294a10ca"}
Jul 23 11:52:50.614363 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:50.614331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:50.716538 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:50.716509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:51.227311 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:51.227287    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:51.274049 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:51.274015    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd072b2-a693-4c5c-8bd7-fa0b5629508e-maas-api-service-ca\") pod \"6cd072b2-a693-4c5c-8bd7-fa0b5629508e\" (UID: \"6cd072b2-a693-4c5c-8bd7-fa0b5629508e\") "
Jul 23 11:52:51.274389 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:51.274367    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd072b2-a693-4c5c-8bd7-fa0b5629508e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6cd072b2-a693-4c5c-8bd7-fa0b5629508e" (UID: "6cd072b2-a693-4c5c-8bd7-fa0b5629508e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:52:51.375033 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:51.374951    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd072b2-a693-4c5c-8bd7-fa0b5629508e-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:52:52.091173 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:52.091147    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"
Jul 23 11:52:52.091585 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:52.091186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc" event={"ID":"6cd072b2-a693-4c5c-8bd7-fa0b5629508e","Type":"ContainerDied","Data":"ec5d0e20e6a5c9230a5eecf9b8579d234245bb377870f22459eb6065294a10ca"}
Jul 23 11:52:52.091585 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:52.091234    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec5d0e20e6a5c9230a5eecf9b8579d234245bb377870f22459eb6065294a10ca"
Jul 23 11:52:59.300130 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:59.300098    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:52:59.401326 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:52:59.401287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:04.598813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:04.598779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:08.738137 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:08.738096    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"]
Jul 23 11:53:08.740303 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:08.740279    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a9439f-t8lxc"]
Jul 23 11:53:08.754752 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:08.754718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:09.135508 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:09.135477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:09.318305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:09.318265    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd072b2-a693-4c5c-8bd7-fa0b5629508e" path="/var/lib/kubelet/pods/6cd072b2-a693-4c5c-8bd7-fa0b5629508e/volumes"
Jul 23 11:53:09.579533 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:09.579500    2578 scope.go:117] "RemoveContainer" containerID="4723c0198662ded915b30f68cf7a232dfd197e84836e7d02fc7260631560bffd"
Jul 23 11:53:15.060376 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.060336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:15.153516 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.153472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:15.362454 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.362378    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"]
Jul 23 11:53:15.362635 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.362576    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy" containerID="cri-o://7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908" gracePeriod=30
Jul 23 11:53:15.367084 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.367049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:15.564391 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.564357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:15.910147 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:15.910111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:16.214140 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:16.214000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:16.310805 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:16.310776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:18.790745 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:18.790710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:18.892944 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:18.892899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:18.997059 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:18.997026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:19.096250 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:19.096161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:19.471589 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:19.471497    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:19.572444 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:19.572410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:20.631439 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.631378    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:53:20.757198 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757165    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8787ab6f-558d-4902-a81d-21f9e5213a5d-istiod-ca-cert\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757397 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-token\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757397 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757244    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-data\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757397 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-envoy\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757446    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-certs\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfxvj\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-kube-api-access-hfxvj\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757600 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-podinfo\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757639    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-credential-socket\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757644    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8787ab6f-558d-4902-a81d-21f9e5213a5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:53:20.757794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-socket\") pod \"8787ab6f-558d-4902-a81d-21f9e5213a5d\" (UID: \"8787ab6f-558d-4902-a81d-21f9e5213a5d\") "
Jul 23 11:53:20.757794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.757758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:53:20.758062 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.758035    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8787ab6f-558d-4902-a81d-21f9e5213a5d-istiod-ca-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.758062 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.758063    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.758249 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.758062    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:53:20.758249 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.758120    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:53:20.758249 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.758211    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:53:20.759673 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.759645    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 11:53:20.759792 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.759716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 11:53:20.759916 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.759899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-kube-api-access-hfxvj" (OuterVolumeSpecName: "kube-api-access-hfxvj") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "kube-api-access-hfxvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:53:20.760014 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.759993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "8787ab6f-558d-4902-a81d-21f9e5213a5d" (UID: "8787ab6f-558d-4902-a81d-21f9e5213a5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:53:20.858794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858755    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfxvj\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-kube-api-access-hfxvj\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.858794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858786    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-podinfo\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.858794 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858799    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-credential-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.859046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858810    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-workload-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.859046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858823    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.859046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858836    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-data\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:20.859046 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:20.858846    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8787ab6f-558d-4902-a81d-21f9e5213a5d-istio-envoy\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:53:21.257337 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.257305    2578 generic.go:356] "Generic (PLEG): container finished" podID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerID="7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908" exitCode=0
Jul 23 11:53:21.257537 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.257372    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"
Jul 23 11:53:21.257537 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.257389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" event={"ID":"8787ab6f-558d-4902-a81d-21f9e5213a5d","Type":"ContainerDied","Data":"7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908"}
Jul 23 11:53:21.257537 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.257459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2" event={"ID":"8787ab6f-558d-4902-a81d-21f9e5213a5d","Type":"ContainerDied","Data":"c892730cb9beedf8ebfa32370c5c87514fc76f033023ee6f18b3775b5d938c7a"}
Jul 23 11:53:21.257537 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.257492    2578 scope.go:117] "RemoveContainer" containerID="7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908"
Jul 23 11:53:21.267215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.267195    2578 scope.go:117] "RemoveContainer" containerID="b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"
Jul 23 11:53:21.276158 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.276138    2578 scope.go:117] "RemoveContainer" containerID="7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908"
Jul 23 11:53:21.276441 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:53:21.276416    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908\": container with ID starting with 7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908 not found: ID does not exist" containerID="7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908"
Jul 23 11:53:21.276534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.276453    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908"} err="failed to get container status \"7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908\": rpc error: code = NotFound desc = could not find container \"7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908\": container with ID starting with 7aeececb5f36a5b5f70fda547f64e370adc7acf9a786aa8e4a041403c2963908 not found: ID does not exist"
Jul 23 11:53:21.276534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.276478    2578 scope.go:117] "RemoveContainer" containerID="b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"
Jul 23 11:53:21.276759 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:53:21.276741    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24\": container with ID starting with b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24 not found: ID does not exist" containerID="b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"
Jul 23 11:53:21.276811 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.276766    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24"} err="failed to get container status \"b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24\": rpc error: code = NotFound desc = could not find container \"b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24\": container with ID starting with b4ca2e69012af013bcb4b3c2365d24f6c58e0109e5182a7d8f9d22aec5fc3d24 not found: ID does not exist"
Jul 23 11:53:21.293818 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.293795    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"]
Jul 23 11:53:21.302710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.302684    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a9439f-openshift-default-7bb85ffd9-9p9k2"]
Jul 23 11:53:21.318056 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:21.318030    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" path="/var/lib/kubelet/pods/8787ab6f-558d-4902-a81d-21f9e5213a5d/volumes"
Jul 23 11:53:23.308192 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.308149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:23.641305 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.641217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:23.952272 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952170    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"]
Jul 23 11:53:23.952782 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952761    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy"
Jul 23 11:53:23.952782 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952783    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy"
Jul 23 11:53:23.952945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952810    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd072b2-a693-4c5c-8bd7-fa0b5629508e" containerName="revoke-keys"
Jul 23 11:53:23.952945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952818    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd072b2-a693-4c5c-8bd7-fa0b5629508e" containerName="revoke-keys"
Jul 23 11:53:23.952945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952839    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy"
Jul 23 11:53:23.952945 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952848    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy"
Jul 23 11:53:23.953156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952962    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy"
Jul 23 11:53:23.953156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952976    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8787ab6f-558d-4902-a81d-21f9e5213a5d" containerName="istio-proxy"
Jul 23 11:53:23.953156 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.952991    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd072b2-a693-4c5c-8bd7-fa0b5629508e" containerName="revoke-keys"
Jul 23 11:53:23.957686 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.957659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:23.960632 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.960593    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c713d8-openshift-default-dockercfg-kd7np\""
Jul 23 11:53:23.971115 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.971087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"]
Jul 23 11:53:23.981598 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:23.981550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:24.092578 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-envoy\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.092578 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-certs\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.092839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfvd\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-kube-api-access-cdfvd\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.092839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istiod-ca-cert\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.092839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-token\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.092839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-data\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.093052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-socket\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.093052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-podinfo\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.093052 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.092959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-credential-socket\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194534 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfvd\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-kube-api-access-cdfvd\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istiod-ca-cert\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-token\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-data\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194756 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-socket\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-podinfo\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-credential-socket\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-envoy\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.194979 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.194889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-certs\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.195178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.195153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-data\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.195235 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.195186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-socket\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.195294 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.195251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-credential-socket\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.195352 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.195306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-certs\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.195595 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.195574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istiod-ca-cert\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.197176 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.197148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-envoy\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.197332 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.197317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-podinfo\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.204789 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.204710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-token\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.205287 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.205252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfvd\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-kube-api-access-cdfvd\") pod \"e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") " pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.268832 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.268778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:24.429844 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.429793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:24.430466 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.430444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"]
Jul 23 11:53:24.431352 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:53:24.431330    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7c7763_df00_4d93_a0f7_2fba10c7fa90.slice/crio-b29fdcb5f4cc69caa43b66ac03dace2d4922ab655b142fc80579c84a854607c4 WatchSource:0}: Error finding container b29fdcb5f4cc69caa43b66ac03dace2d4922ab655b142fc80579c84a854607c4: Status 404 returned error can't find the container with id b29fdcb5f4cc69caa43b66ac03dace2d4922ab655b142fc80579c84a854607c4
Jul 23 11:53:24.433458 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.433428    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:53:24.433543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.433492    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:53:24.433543 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:24.433520    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:53:25.288346 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:25.288306    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" event={"ID":"1f7c7763-df00-4d93-a0f7-2fba10c7fa90","Type":"ContainerStarted","Data":"f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"}
Jul 23 11:53:25.288502 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:25.288392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" event={"ID":"1f7c7763-df00-4d93-a0f7-2fba10c7fa90","Type":"ContainerStarted","Data":"b29fdcb5f4cc69caa43b66ac03dace2d4922ab655b142fc80579c84a854607c4"}
Jul 23 11:53:25.311469 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:25.311404    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podStartSLOduration=2.311388503 podStartE2EDuration="2.311388503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:53:25.311011821 +0000 UTC m=+2596.437875246" watchObservedRunningTime="2026-07-23 11:53:25.311388503 +0000 UTC m=+2596.438251927"
Jul 23 11:53:26.269246 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:26.269204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:26.274452 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:26.274426    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:26.294243 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:26.294208    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:26.295349 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:26.295320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:27.186511 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:27.186479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:27.298221 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:27.298168    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:27.394331 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:27.394289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:27.524342 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:27.524313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:27.882651 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:27.882548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:27.980542 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:27.980506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:30.017813 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:30.017780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:30.122101 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:30.122065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:31.659563 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:31.659491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:41.294988 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.294952    2578 patch_prober.go:28] interesting pod/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 11:53:41.295409 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.295003    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 11:53:41.389466 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.389430    2578 generic.go:356] "Generic (PLEG): container finished" podID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerID="f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab" exitCode=0
Jul 23 11:53:41.389663 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.389507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" event={"ID":"1f7c7763-df00-4d93-a0f7-2fba10c7fa90","Type":"ContainerDied","Data":"f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"}
Jul 23 11:53:41.389923 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.389906    2578 scope.go:117] "RemoveContainer" containerID="f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"
Jul 23 11:53:41.390998 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.390968    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:53:41.391076 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.391062    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:53:41.391114 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.391101    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 11:53:41.706665 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.706572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:41.804854 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:41.804815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:42.397347 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:42.397315    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" event={"ID":"1f7c7763-df00-4d93-a0f7-2fba10c7fa90","Type":"ContainerStarted","Data":"e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38"}
Jul 23 11:53:43.269593 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:43.269555    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:43.269916 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:43.269892    2578 patch_prober.go:28] interesting pod/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 11:53:43.269974 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:43.269956    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 11:53:44.269297 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:44.269265    2578 patch_prober.go:28] interesting pod/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 11:53:44.269710 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:44.269320    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 11:53:45.270162 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:45.270126    2578 patch_prober.go:28] interesting pod/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 11:53:45.270561 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:45.270181    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 11:53:46.269505 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:46.269464    2578 patch_prober.go:28] interesting pod/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 11:53:46.269777 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:46.269520    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 11:53:47.273827 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:47.273797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:47.274202 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:47.274174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:47.275076 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:47.275058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 11:53:48.672469 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:48.672434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:48.771285 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:48.771230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:53:56.786164 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:53:56.786129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:54:22.579239 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:54:22.579200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:54:30.136923 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:54:30.136883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:55:09.471034 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:55:09.470954    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:55:09.481236 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:55:09.481212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 11:56:24.305495 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:56:24.305462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:56:24.871690 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:56:24.871656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:56:35.077160 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:56:35.077121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:56:36.380900 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:56:36.380866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:56:36.535493 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:56:36.535448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:02.461809 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:02.461764    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:06.164560 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:06.164526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:38.098466 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:38.098432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:39.032337 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:39.032282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:51.442484 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:51.442405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:51.542163 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:51.542126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:57:55.913155 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:57:55.913114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:58:09.638215 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:09.638135    2578 scope.go:117] "RemoveContainer" containerID="f537c7c4de2f0890f8374ab9f6f438a2d1f537d7e2eb24d032e2413c74d84d91"
Jul 23 11:58:09.648408 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:09.648374    2578 scope.go:117] "RemoveContainer" containerID="f0c723f83e9d9460dec148370ce3214c321bcdf3c95a9207bf4f75837fe06b2b"
Jul 23 11:58:29.119348 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:29.119313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:58:42.722126 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:42.722090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:58:42.821352 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:42.821315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:58:49.464831 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:49.464771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:58:49.568749 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:58:49.568698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:09.673711 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:09.673678    2578 scope.go:117] "RemoveContainer" containerID="0bd724fe4541591075ff11d405794e1adcbdd62ed2dcbc3730d700cfd2950291"
Jul 23 11:59:12.307457 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:12.307422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:13.288664 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:13.288630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:17.381221 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.381184    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7447-140657969439536"]
Jul 23 11:59:17.386348 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.386330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:17.389502 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.389476    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sdt2h\""
Jul 23 11:59:17.391348 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.391320    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969439536"]
Jul 23 11:59:17.495150 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.495116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczqk\" (UniqueName: \"kubernetes.io/projected/ee113b06-a06c-427b-b6db-83fdab8e240e-kube-api-access-gczqk\") pod \"test-curl-7447-140657969439536\" (UID: \"ee113b06-a06c-427b-b6db-83fdab8e240e\") " pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:17.595716 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.595685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczqk\" (UniqueName: \"kubernetes.io/projected/ee113b06-a06c-427b-b6db-83fdab8e240e-kube-api-access-gczqk\") pod \"test-curl-7447-140657969439536\" (UID: \"ee113b06-a06c-427b-b6db-83fdab8e240e\") " pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:17.604560 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.604524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczqk\" (UniqueName: \"kubernetes.io/projected/ee113b06-a06c-427b-b6db-83fdab8e240e-kube-api-access-gczqk\") pod \"test-curl-7447-140657969439536\" (UID: \"ee113b06-a06c-427b-b6db-83fdab8e240e\") " pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:17.697161 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.697065    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:17.832258 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.832231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7447-140657969439536"]
Jul 23 11:59:17.834238 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:59:17.834208    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee113b06_a06c_427b_b6db_83fdab8e240e.slice/crio-7f337f1360941bb9a00288bee40ca8ee30ef077cd8fbb774c5d0af93ddbf0f97 WatchSource:0}: Error finding container 7f337f1360941bb9a00288bee40ca8ee30ef077cd8fbb774c5d0af93ddbf0f97: Status 404 returned error can't find the container with id 7f337f1360941bb9a00288bee40ca8ee30ef077cd8fbb774c5d0af93ddbf0f97
Jul 23 11:59:17.835579 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:17.835562    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 11:59:18.261510 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:18.261471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969439536" event={"ID":"ee113b06-a06c-427b-b6db-83fdab8e240e","Type":"ContainerStarted","Data":"7f337f1360941bb9a00288bee40ca8ee30ef077cd8fbb774c5d0af93ddbf0f97"}
Jul 23 11:59:19.268806 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:19.268771    2578 generic.go:356] "Generic (PLEG): container finished" podID="ee113b06-a06c-427b-b6db-83fdab8e240e" containerID="d5f326468bb67d8a92445edb28e7b60b33ff0ede30288a6562be3af72cdec766" exitCode=0
Jul 23 11:59:19.269222 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:19.268856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7447-140657969439536" event={"ID":"ee113b06-a06c-427b-b6db-83fdab8e240e","Type":"ContainerDied","Data":"d5f326468bb67d8a92445edb28e7b60b33ff0ede30288a6562be3af72cdec766"}
Jul 23 11:59:20.413884 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.413858    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:20.435837 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.435807    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7447-140657969439536_ee113b06-a06c-427b-b6db-83fdab8e240e/test-curl-7447-140657969439536/0.log"
Jul 23 11:59:20.460621 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.460578    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7447-140657969439536"]
Jul 23 11:59:20.464076 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.464054    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7447-140657969439536"]
Jul 23 11:59:20.525825 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.525743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gczqk\" (UniqueName: \"kubernetes.io/projected/ee113b06-a06c-427b-b6db-83fdab8e240e-kube-api-access-gczqk\") pod \"ee113b06-a06c-427b-b6db-83fdab8e240e\" (UID: \"ee113b06-a06c-427b-b6db-83fdab8e240e\") "
Jul 23 11:59:20.527803 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.527768    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee113b06-a06c-427b-b6db-83fdab8e240e-kube-api-access-gczqk" (OuterVolumeSpecName: "kube-api-access-gczqk") pod "ee113b06-a06c-427b-b6db-83fdab8e240e" (UID: "ee113b06-a06c-427b-b6db-83fdab8e240e"). InnerVolumeSpecName "kube-api-access-gczqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 11:59:20.627349 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:20.627321    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gczqk\" (UniqueName: \"kubernetes.io/projected/ee113b06-a06c-427b-b6db-83fdab8e240e-kube-api-access-gczqk\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:59:21.279977 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:21.279941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:21.279977 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:21.279957    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f337f1360941bb9a00288bee40ca8ee30ef077cd8fbb774c5d0af93ddbf0f97"
Jul 23 11:59:21.290808 ip-10-0-132-128 kubenswrapper[2578]: E0723 11:59:21.290779    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7447-140657969439536\" is forbidden: User \"system:node:ip-10-0-132-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-128.ec2.internal' and this object" podUID="ee113b06-a06c-427b-b6db-83fdab8e240e" pod="opendatahub/test-curl-7447-140657969439536"
Jul 23 11:59:21.318757 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:21.318733    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee113b06-a06c-427b-b6db-83fdab8e240e" path="/var/lib/kubelet/pods/ee113b06-a06c-427b-b6db-83fdab8e240e/volumes"
Jul 23 11:59:32.562717 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.562639    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"]
Jul 23 11:59:32.563121 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.563107    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee113b06-a06c-427b-b6db-83fdab8e240e" containerName="test-curl-7447-140657969439536"
Jul 23 11:59:32.563165 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.563122    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee113b06-a06c-427b-b6db-83fdab8e240e" containerName="test-curl-7447-140657969439536"
Jul 23 11:59:32.563197 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.563189    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee113b06-a06c-427b-b6db-83fdab8e240e" containerName="test-curl-7447-140657969439536"
Jul 23 11:59:32.566441 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.566424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:32.570725 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.570707    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wx4jb\""
Jul 23 11:59:32.579942 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.579923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"]
Jul 23 11:59:32.749034 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.749001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb195a0-a99f-4e07-8fb5-5091afc2ac8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r\" (UID: \"efb195a0-a99f-4e07-8fb5-5091afc2ac8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:32.849821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.849740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb195a0-a99f-4e07-8fb5-5091afc2ac8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r\" (UID: \"efb195a0-a99f-4e07-8fb5-5091afc2ac8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:32.850348 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.850325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb195a0-a99f-4e07-8fb5-5091afc2ac8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r\" (UID: \"efb195a0-a99f-4e07-8fb5-5091afc2ac8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:32.876266 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:32.876238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:33.013537 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:33.013512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"]
Jul 23 11:59:33.016305 ip-10-0-132-128 kubenswrapper[2578]: W0723 11:59:33.016277    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb195a0_a99f_4e07_8fb5_5091afc2ac8e.slice/crio-6452444339e96116e7c6f699f84f345c6d7fb5e8e98e9b6d961d8c15d3457ca4 WatchSource:0}: Error finding container 6452444339e96116e7c6f699f84f345c6d7fb5e8e98e9b6d961d8c15d3457ca4: Status 404 returned error can't find the container with id 6452444339e96116e7c6f699f84f345c6d7fb5e8e98e9b6d961d8c15d3457ca4
Jul 23 11:59:33.111759 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:33.111675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:33.212740 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:33.212709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:33.358178 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:33.358145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r" event={"ID":"efb195a0-a99f-4e07-8fb5-5091afc2ac8e","Type":"ContainerStarted","Data":"d2ee8793ab7949d1a23c40037bc9e7ff44b6007dd93aab12e047506febdf73e2"}
Jul 23 11:59:33.358301 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:33.358208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r" event={"ID":"efb195a0-a99f-4e07-8fb5-5091afc2ac8e","Type":"ContainerStarted","Data":"6452444339e96116e7c6f699f84f345c6d7fb5e8e98e9b6d961d8c15d3457ca4"}
Jul 23 11:59:33.375839 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:33.375723    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r" podStartSLOduration=1.375706443 podStartE2EDuration="1.375706443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 11:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 11:59:33.374536867 +0000 UTC m=+2964.501400292" watchObservedRunningTime="2026-07-23 11:59:33.375706443 +0000 UTC m=+2964.502569867"
Jul 23 11:59:34.364519 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:34.364488    2578 generic.go:356] "Generic (PLEG): container finished" podID="efb195a0-a99f-4e07-8fb5-5091afc2ac8e" containerID="d2ee8793ab7949d1a23c40037bc9e7ff44b6007dd93aab12e047506febdf73e2" exitCode=0
Jul 23 11:59:34.364934 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:34.364579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r" event={"ID":"efb195a0-a99f-4e07-8fb5-5091afc2ac8e","Type":"ContainerDied","Data":"d2ee8793ab7949d1a23c40037bc9e7ff44b6007dd93aab12e047506febdf73e2"}
Jul 23 11:59:35.508300 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:35.508274    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:35.678193 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:35.678109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb195a0-a99f-4e07-8fb5-5091afc2ac8e-maas-api-service-ca\") pod \"efb195a0-a99f-4e07-8fb5-5091afc2ac8e\" (UID: \"efb195a0-a99f-4e07-8fb5-5091afc2ac8e\") "
Jul 23 11:59:35.678464 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:35.678441    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb195a0-a99f-4e07-8fb5-5091afc2ac8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "efb195a0-a99f-4e07-8fb5-5091afc2ac8e" (UID: "efb195a0-a99f-4e07-8fb5-5091afc2ac8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 11:59:35.779336 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:35.779303    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efb195a0-a99f-4e07-8fb5-5091afc2ac8e-maas-api-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 11:59:36.376217 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:36.376184    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"
Jul 23 11:59:36.376399 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:36.376212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r" event={"ID":"efb195a0-a99f-4e07-8fb5-5091afc2ac8e","Type":"ContainerDied","Data":"6452444339e96116e7c6f699f84f345c6d7fb5e8e98e9b6d961d8c15d3457ca4"}
Jul 23 11:59:36.376399 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:36.376260    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6452444339e96116e7c6f699f84f345c6d7fb5e8e98e9b6d961d8c15d3457ca4"
Jul 23 11:59:43.313584 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:43.313524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:47.632384 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:47.632349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:47.646048 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:47.646018    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"]
Jul 23 11:59:47.647911 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:47.647891    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-839b3c-zht7r"]
Jul 23 11:59:48.041821 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:48.041788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:49.319438 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:49.319406    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb195a0-a99f-4e07-8fb5-5091afc2ac8e" path="/var/lib/kubelet/pods/efb195a0-a99f-4e07-8fb5-5091afc2ac8e/volumes"
Jul 23 11:59:54.296512 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:54.296478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:54.358738 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:54.358706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:54.595583 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:54.595511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:54.837358 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:54.837325    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:55.740527 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:55.740492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 11:59:55.839349 ip-10-0-132-128 kubenswrapper[2578]: I0723 11:59:55.839308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:05.582902 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:05.582866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:09.504263 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:09.504236    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 12:00:09.514044 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:09.514021    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 12:00:10.045998 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:10.045968    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:10.445092 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:10.445016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:14.045190 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:14.045157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:16.960657 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:16.960615    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"]
Jul 23 12:00:16.961119 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:16.960913    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" containerID="cri-o://e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38" gracePeriod=30
Jul 23 12:00:17.276551 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:17.276522    2578 patch_prober.go:28] interesting pod/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 12:00:17.276721 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:17.276589    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 12:00:17.310032 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:17.310002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:17.370219 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:17.370197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:22.224194 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.224139    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 12:00:22.330761 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-envoy\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.330883 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330786    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-data\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.330883 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-token\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.330883 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-podinfo\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.330883 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330851    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istiod-ca-cert\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.330883 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330880    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-socket\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.331129 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdfvd\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-kube-api-access-cdfvd\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.331129 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-credential-socket\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.331129 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.330991    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-certs\") pod \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\" (UID: \"1f7c7763-df00-4d93-a0f7-2fba10c7fa90\") "
Jul 23 12:00:22.331287 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.331225    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:00:22.331349 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.331317    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.331349 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.331311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 12:00:22.331792 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.331769    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:00:22.331974 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.331815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:00:22.331974 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.331917    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:00:22.332996 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.332972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 12:00:22.333218 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.333184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:00:22.333334 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.333311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 12:00:22.333450 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.333427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-kube-api-access-cdfvd" (OuterVolumeSpecName: "kube-api-access-cdfvd") pod "1f7c7763-df00-4d93-a0f7-2fba10c7fa90" (UID: "1f7c7763-df00-4d93-a0f7-2fba10c7fa90"). InnerVolumeSpecName "kube-api-access-cdfvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 12:00:22.431994 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.431971    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.431994 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.431993    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-podinfo\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.432115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.432002    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istiod-ca-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.432115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.432011    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdfvd\" (UniqueName: \"kubernetes.io/projected/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-kube-api-access-cdfvd\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.432115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.432020    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-credential-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.432115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.432029    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-workload-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.432115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.432036    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-envoy\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.432115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.432043    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f7c7763-df00-4d93-a0f7-2fba10c7fa90-istio-data\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\""
Jul 23 12:00:22.628093 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.628058    2578 generic.go:356] "Generic (PLEG): container finished" podID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerID="e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38" exitCode=0
Jul 23 12:00:22.628237 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.628110    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"
Jul 23 12:00:22.628237 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.628142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" event={"ID":"1f7c7763-df00-4d93-a0f7-2fba10c7fa90","Type":"ContainerDied","Data":"e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38"}
Jul 23 12:00:22.628237 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.628193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg" event={"ID":"1f7c7763-df00-4d93-a0f7-2fba10c7fa90","Type":"ContainerDied","Data":"b29fdcb5f4cc69caa43b66ac03dace2d4922ab655b142fc80579c84a854607c4"}
Jul 23 12:00:22.628237 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.628214    2578 scope.go:117] "RemoveContainer" containerID="e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38"
Jul 23 12:00:22.637884 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.637867    2578 scope.go:117] "RemoveContainer" containerID="f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"
Jul 23 12:00:22.646900 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.646872    2578 scope.go:117] "RemoveContainer" containerID="e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38"
Jul 23 12:00:22.647169 ip-10-0-132-128 kubenswrapper[2578]: E0723 12:00:22.647147    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38\": container with ID starting with e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38 not found: ID does not exist" containerID="e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38"
Jul 23 12:00:22.647263 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.647175    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38"} err="failed to get container status \"e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38\": rpc error: code = NotFound desc = could not find container \"e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38\": container with ID starting with e809192e59e08b48c89cff76c16603f84480c3c5941fbb8fb4905a4f4760bb38 not found: ID does not exist"
Jul 23 12:00:22.647263 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.647191    2578 scope.go:117] "RemoveContainer" containerID="f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"
Jul 23 12:00:22.647437 ip-10-0-132-128 kubenswrapper[2578]: E0723 12:00:22.647419    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab\": container with ID starting with f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab not found: ID does not exist" containerID="f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"
Jul 23 12:00:22.647505 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.647442    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab"} err="failed to get container status \"f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab\": rpc error: code = NotFound desc = could not find container \"f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab\": container with ID starting with f74423669252815d1a6dce77370180a09e415a346fd5d9540b85b3a1933eaaab not found: ID does not exist"
Jul 23 12:00:22.651189 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.651166    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"]
Jul 23 12:00:22.655405 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:22.655385    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c713d8-openshift-default-dfc45bf59-xjjfg"]
Jul 23 12:00:23.015557 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.015532    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rqwzb_e06a4e7e-1ff6-4821-80c9-4b44a868ecf6/manager/0.log"
Jul 23 12:00:23.142589 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.142565    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6fl8h_d6c5ddce-cdfc-4a47-9537-44d20050b08a/manager/0.log"
Jul 23 12:00:23.263845 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.263819    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7646859554-krtn2_671dcff5-909c-456d-a073-472c150e9525/manager/0.log"
Jul 23 12:00:23.317798 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.317730    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" path="/var/lib/kubelet/pods/1f7c7763-df00-4d93-a0f7-2fba10c7fa90/volumes"
Jul 23 12:00:23.403330 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.403305    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lgchh_bf0223d1-5635-4f2d-b403-d026cfab0be9/server/0.log"
Jul 23 12:00:23.521428 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.521402    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-52f5x_82c4a4cf-8181-416e-b223-6fa822ac03e3/manager/0.log"
Jul 23 12:00:23.773686 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.773657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-bqrzq_bfe4374b-316b-4c26-bea9-699dfd48e6d2/copy-manifests/0.log"
Jul 23 12:00:23.789862 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:23.789838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-bqrzq_bfe4374b-316b-4c26-bea9-699dfd48e6d2/manager/0.log"
Jul 23 12:00:24.276423 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:24.276389    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-757c9f4cdb-4dzrc_631df4bd-e09c-4026-aae8-1759c00dc754/maas-api/0.log"
Jul 23 12:00:24.725256 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:24.725179    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7hn7c_16b38334-4f2d-4522-81cf-5b9049ad49b0/postgres/0.log"
Jul 23 12:00:26.135291 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:26.135263    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jg6hb_b1075b13-201a-4724-aeed-bd3d30cfe8db/manager/0.log"
Jul 23 12:00:26.245762 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:26.245740    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d8crn_5d27c531-72a9-43da-a8c1-44ab27ef6e75/manager/0.log"
Jul 23 12:00:26.363645 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:26.363626    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r2w4r_f7c73f01-af5d-42ce-ad03-a01da3a432f2/kuadrant-console-plugin/0.log"
Jul 23 12:00:26.494436 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:26.494363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sjkbq_b7decbd9-8951-4fd4-b148-86efe397f686/registry-server/0.log"
Jul 23 12:00:26.871919 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:26.871882    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bkzfp_cc4e7879-1d5c-4c4a-afb1-66aade51c50d/manager/0.log"
Jul 23 12:00:27.468333 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:27.468300    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-dqjfr_787385ca-bc72-4875-87ca-31783768bc6b/kube-auth-proxy/0.log"
Jul 23 12:00:27.703491 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:27.703461    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/1.log"
Jul 23 12:00:27.826071 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:27.826046    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-ktq2x_12ddfbaa-a3fa-4e64-98f7-3c03350b4465/payload-pre-processing/0.log"
Jul 23 12:00:27.947878 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:27.947852    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vlmnk_384a55a8-71bb-45ea-8cdb-2bf411630c54/payload-processing/0.log"
Jul 23 12:00:28.056391 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:28.056366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-569c94756d-ml9wr_68096475-59bd-489d-bbf3-75abe8d33dbe/router/0.log"
Jul 23 12:00:28.391176 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:28.391148    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rq9w5_59d0fff7-646b-4e00-9789-f678e35d77f6/main/0.log"
Jul 23 12:00:28.494473 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:28.494445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:28.594579 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:28.594553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:28.718945 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:28.718881    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs9w4h_619dc8db-7c02-4339-9856-61670ccf3936/main/0.log"
Jul 23 12:00:28.836244 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:28.836210    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xvvpm_89760988-fb0e-4312-8f16-fe62fdd95ded/main/0.log"
Jul 23 12:00:34.131954 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:34.131919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:34.227794 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:34.227723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log" limit=1024
Jul 23 12:00:37.257378 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:37.257338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6xkjn_9f32602e-69a4-48a7-8841-0e1ef0600081/global-pull-secret-syncer/0.log"
Jul 23 12:00:37.347643 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:37.347621    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5g24p_c695be04-8b12-47ea-a6e7-13920359544b/konnectivity-agent/0.log"
Jul 23 12:00:37.459645 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:37.459623    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-128.ec2.internal_f55fef534baa21e90d350e1062068982/haproxy/0.log"
Jul 23 12:00:42.544656 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:42.544623    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jg6hb_b1075b13-201a-4724-aeed-bd3d30cfe8db/manager/0.log"
Jul 23 12:00:42.567464 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:42.567427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d8crn_5d27c531-72a9-43da-a8c1-44ab27ef6e75/manager/0.log"
Jul 23 12:00:42.591843 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:42.591824    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r2w4r_f7c73f01-af5d-42ce-ad03-a01da3a432f2/kuadrant-console-plugin/0.log"
Jul 23 12:00:42.647214 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:42.647188    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sjkbq_b7decbd9-8951-4fd4-b148-86efe397f686/registry-server/0.log"
Jul 23 12:00:42.984831 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:42.984748    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bkzfp_cc4e7879-1d5c-4c4a-afb1-66aade51c50d/manager/0.log"
Jul 23 12:00:44.792129 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.792097    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/alertmanager/0.log"
Jul 23 12:00:44.820265 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.820246    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/config-reloader/0.log"
Jul 23 12:00:44.849415 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.849393    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/kube-rbac-proxy-web/0.log"
Jul 23 12:00:44.870409 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.870378    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/kube-rbac-proxy/0.log"
Jul 23 12:00:44.896179 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.896158    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/kube-rbac-proxy-metric/0.log"
Jul 23 12:00:44.920115 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.920098    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/prom-label-proxy/0.log"
Jul 23 12:00:44.945550 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:44.945531    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a83c791-9693-45a8-886a-6266951e2569/init-config-reloader/0.log"
Jul 23 12:00:45.033429 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.033406    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-brc27_67a5ee68-4ffb-4bc3-a29d-c463ee81fce2/kube-state-metrics/0.log"
Jul 23 12:00:45.066630 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.066591    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-brc27_67a5ee68-4ffb-4bc3-a29d-c463ee81fce2/kube-rbac-proxy-main/0.log"
Jul 23 12:00:45.089572 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.089551    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-brc27_67a5ee68-4ffb-4bc3-a29d-c463ee81fce2/kube-rbac-proxy-self/0.log"
Jul 23 12:00:45.348708 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.348643    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6d9c_d0b91f50-c496-4449-b88f-e3dd9ffd861b/node-exporter/0.log"
Jul 23 12:00:45.368175 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.368152    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6d9c_d0b91f50-c496-4449-b88f-e3dd9ffd861b/kube-rbac-proxy/0.log"
Jul 23 12:00:45.394798 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.394784    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6d9c_d0b91f50-c496-4449-b88f-e3dd9ffd861b/init-textfile/0.log"
Jul 23 12:00:45.420169 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.420143    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-7bkws_4497f9e5-a6cf-4a34-913c-c1f759b87452/kube-rbac-proxy-main/0.log"
Jul 23 12:00:45.441786 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.441765    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-7bkws_4497f9e5-a6cf-4a34-913c-c1f759b87452/kube-rbac-proxy-self/0.log"
Jul 23 12:00:45.461981 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.461966    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-7bkws_4497f9e5-a6cf-4a34-913c-c1f759b87452/openshift-state-metrics/0.log"
Jul 23 12:00:45.742536 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:45.742517    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-kvvbh_3ce6a924-5ffb-4b4e-b7ca-bfe42ab25d41/prometheus-operator-admission-webhook/0.log"
Jul 23 12:00:47.881368 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.881332    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/1.log"
Jul 23 12:00:47.885826 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.885802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqmr6_b055d2c6-e3c0-4ebd-94f4-a16bb027142b/console-operator/2.log"
Jul 23 12:00:47.932624 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.932589    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"]
Jul 23 12:00:47.933081 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933062    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy"
Jul 23 12:00:47.933197 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933083    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy"
Jul 23 12:00:47.933197 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933101    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb195a0-a99f-4e07-8fb5-5091afc2ac8e" containerName="revoke-keys"
Jul 23 12:00:47.933197 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933109    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb195a0-a99f-4e07-8fb5-5091afc2ac8e" containerName="revoke-keys"
Jul 23 12:00:47.933360 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933262    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy"
Jul 23 12:00:47.933360 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933280    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7c7763-df00-4d93-a0f7-2fba10c7fa90" containerName="istio-proxy"
Jul 23 12:00:47.933360 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.933293    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb195a0-a99f-4e07-8fb5-5091afc2ac8e" containerName="revoke-keys"
Jul 23 12:00:47.938004 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.937984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:47.943055 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.943036    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j8hbw\"/\"default-dockercfg-5ql9l\""
Jul 23 12:00:47.943172 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.943140    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8hbw\"/\"openshift-service-ca.crt\""
Jul 23 12:00:47.944304 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.944286    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8hbw\"/\"kube-root-ca.crt\""
Jul 23 12:00:47.964036 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:47.964016    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"]
Jul 23 12:00:48.032328 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.032299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-lib-modules\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.032469 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.032336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np6fz\" (UniqueName: \"kubernetes.io/projected/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-kube-api-access-np6fz\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.032469 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.032356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-sys\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.032469 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.032412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-podres\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.032639 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.032502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-proc\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.133873 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.133802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np6fz\" (UniqueName: \"kubernetes.io/projected/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-kube-api-access-np6fz\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.133873 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.133837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-sys\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134056 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.133855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-podres\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134056 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.133923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-proc\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134056 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.133936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-sys\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134056 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.134001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-proc\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134056 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.134057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-lib-modules\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134260 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.134078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-podres\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.134260 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.134134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-lib-modules\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.143627 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.143588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np6fz\" (UniqueName: \"kubernetes.io/projected/5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e-kube-api-access-np6fz\") pod \"perf-node-gather-daemonset-thhr6\" (UID: \"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e\") " pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.248516 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.248489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.477481 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.477399    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65444d4566-92k4p_3e65f506-975b-4170-b2db-ab9859d1d9b5/console/0.log"
Jul 23 12:00:48.583908 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.583884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"]
Jul 23 12:00:48.586067 ip-10-0-132-128 kubenswrapper[2578]: W0723 12:00:48.586046    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5479d4e0_9cf6_480d_b7e8_5c8a5d04bc6e.slice/crio-75925c5160ab6c70e1da0ef8d09f77e75a979633c5ddcece0a13d882cec83167 WatchSource:0}: Error finding container 75925c5160ab6c70e1da0ef8d09f77e75a979633c5ddcece0a13d882cec83167: Status 404 returned error can't find the container with id 75925c5160ab6c70e1da0ef8d09f77e75a979633c5ddcece0a13d882cec83167
Jul 23 12:00:48.762542 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.762513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6" event={"ID":"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e","Type":"ContainerStarted","Data":"e02b685459ef01a041e8fc6d1746632dbb7ff49751a5928fd2e221b0aa5135e0"}
Jul 23 12:00:48.762740 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.762567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6" event={"ID":"5479d4e0-9cf6-480d-b7e8-5c8a5d04bc6e","Type":"ContainerStarted","Data":"75925c5160ab6c70e1da0ef8d09f77e75a979633c5ddcece0a13d882cec83167"}
Jul 23 12:00:48.762740 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.762596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:48.780590 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:48.780548    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6" podStartSLOduration=1.7805339500000001 podStartE2EDuration="1.78053395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 12:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 12:00:48.779570647 +0000 UTC m=+3039.906434095" watchObservedRunningTime="2026-07-23 12:00:48.78053395 +0000 UTC m=+3039.907397373"
Jul 23 12:00:49.086504 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:49.086438    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-ws5mf_c295923b-2916-4988-907b-f04dec19385f/volume-data-source-validator/0.log"
Jul 23 12:00:50.107961 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:50.107931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mwxv_8a586995-b097-4f70-8338-3bcae2cb2a4e/dns/0.log"
Jul 23 12:00:50.132421 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:50.132396    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5mwxv_8a586995-b097-4f70-8338-3bcae2cb2a4e/kube-rbac-proxy/0.log"
Jul 23 12:00:50.260905 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:50.260869    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2xgb_aab206a7-a67f-4b16-9d4d-55775dc248c9/dns-node-resolver/0.log"
Jul 23 12:00:50.838754 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:50.838723    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-fc4c86759-4ngsd_7923730d-7e26-48be-ab03-1fb72df85234/registry/0.log"
Jul 23 12:00:50.902735 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:50.902712    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vphwl_369dab9d-4a01-4c58-b914-a51165a15b46/node-ca/0.log"
Jul 23 12:00:52.048017 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.047986    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-dqjfr_787385ca-bc72-4875-87ca-31783768bc6b/kube-auth-proxy/0.log"
Jul 23 12:00:52.102410 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.102385    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/0.log"
Jul 23 12:00:52.129392 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.129367    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/1.log"
Jul 23 12:00:52.158235 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.158213    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-ktq2x_12ddfbaa-a3fa-4e64-98f7-3c03350b4465/payload-pre-processing/0.log"
Jul 23 12:00:52.186952 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.186928    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vlmnk_384a55a8-71bb-45ea-8cdb-2bf411630c54/payload-processing/0.log"
Jul 23 12:00:52.208338 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.208317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-569c94756d-ml9wr_68096475-59bd-489d-bbf3-75abe8d33dbe/router/0.log"
Jul 23 12:00:52.963969 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:52.963940    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h968h_1c5e155a-84d3-4e55-b8d7-00d71a6652a5/serve-healthcheck-canary/0.log"
Jul 23 12:00:53.609292 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:53.609262    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lvl9r_2f8ce6d1-a39a-4633-9109-e3e04595e711/kube-rbac-proxy/0.log"
Jul 23 12:00:53.645072 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:53.645048    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lvl9r_2f8ce6d1-a39a-4633-9109-e3e04595e711/exporter/0.log"
Jul 23 12:00:53.676689 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:53.676663    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lvl9r_2f8ce6d1-a39a-4633-9109-e3e04595e711/extractor/0.log"
Jul 23 12:00:54.777794 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:54.777768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j8hbw/perf-node-gather-daemonset-thhr6"
Jul 23 12:00:56.000147 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.000114    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rqwzb_e06a4e7e-1ff6-4821-80c9-4b44a868ecf6/manager/0.log"
Jul 23 12:00:56.181839 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.181808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6fl8h_d6c5ddce-cdfc-4a47-9537-44d20050b08a/manager/0.log"
Jul 23 12:00:56.282686 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.282654    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7646859554-krtn2_671dcff5-909c-456d-a073-472c150e9525/manager/0.log"
Jul 23 12:00:56.303363 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.303338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lgchh_bf0223d1-5635-4f2d-b403-d026cfab0be9/server/0.log"
Jul 23 12:00:56.373575 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.373545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-52f5x_82c4a4cf-8181-416e-b223-6fa822ac03e3/manager/0.log"
Jul 23 12:00:56.513382 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.513348    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-bqrzq_bfe4374b-316b-4c26-bea9-699dfd48e6d2/manager/0.log"
Jul 23 12:00:56.530126 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:56.530098    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684564f56d-bqrzq_bfe4374b-316b-4c26-bea9-699dfd48e6d2/copy-manifests/0.log"
Jul 23 12:00:58.064873 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.064839    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w7kjx_01c6c31d-3742-449e-aaeb-ff32914b731b/openshift-lws-operator/0.log"
Jul 23 12:00:58.330860 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.330831    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-dqjfr_787385ca-bc72-4875-87ca-31783768bc6b/kube-auth-proxy/0.log"
Jul 23 12:00:58.367244 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.367203    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/0.log"
Jul 23 12:00:58.393453 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.393423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/1.log"
Jul 23 12:00:58.413856 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.413827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-ktq2x_12ddfbaa-a3fa-4e64-98f7-3c03350b4465/payload-pre-processing/0.log"
Jul 23 12:00:58.434528 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.434503    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vlmnk_384a55a8-71bb-45ea-8cdb-2bf411630c54/payload-processing/0.log"
Jul 23 12:00:58.449913 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:58.449886    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-569c94756d-ml9wr_68096475-59bd-489d-bbf3-75abe8d33dbe/router/0.log"
Jul 23 12:00:59.839823 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:59.839789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fffd658f5-dqjfr_787385ca-bc72-4875-87ca-31783768bc6b/kube-auth-proxy/0.log"
Jul 23 12:00:59.882952 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:59.882878    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/0.log"
Jul 23 12:00:59.908267 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:59.908243    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wxwvf_5fdaa0c4-6022-495d-b08f-4c5c6e509ebd/istio-proxy/1.log"
Jul 23 12:00:59.930283 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:59.930262    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-ktq2x_12ddfbaa-a3fa-4e64-98f7-3c03350b4465/payload-pre-processing/0.log"
Jul 23 12:00:59.953506 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:59.953482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-vlmnk_384a55a8-71bb-45ea-8cdb-2bf411630c54/payload-processing/0.log"
Jul 23 12:00:59.969334 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:00:59.969314    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-569c94756d-ml9wr_68096475-59bd-489d-bbf3-75abe8d33dbe/router/0.log"
Jul 23 12:01:04.717984 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:04.717949    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4q8g5_c068fdaa-072c-41d5-baff-f5351b43b4b0/kube-multus/0.log"
Jul 23 12:01:05.067322 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.067294    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/kube-multus-additional-cni-plugins/0.log"
Jul 23 12:01:05.089849 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.089821    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/egress-router-binary-copy/0.log"
Jul 23 12:01:05.109565 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.109539    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/cni-plugins/0.log"
Jul 23 12:01:05.129848 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.129823    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/bond-cni-plugin/0.log"
Jul 23 12:01:05.151190 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.151163    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/routeoverride-cni/0.log"
Jul 23 12:01:05.169502 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.169474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/whereabouts-cni-bincopy/0.log"
Jul 23 12:01:05.191044 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.191015    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gb6sq_9413a10a-efcd-48c3-bc00-8be7e2d8d849/whereabouts-cni/0.log"
Jul 23 12:01:05.252815 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.252784    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b8svt_2949fccc-8b43-42a4-89e2-48d257ab3736/network-metrics-daemon/0.log"
Jul 23 12:01:05.270322 ip-10-0-132-128 kubenswrapper[2578]: I0723 12:01:05.270292    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b8svt_2949fccc-8b43-42a4-89e2-48d257ab3736/kube-rbac-proxy/0.log"